Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)R

raldone01

@ raldone01 @lemmy.world

Posts
4
Comments
177
Joined
2 yr. ago

  • The first GPT-4-class AI model anyone can download has arrived: Llama 405B

    Jump

  • My memory sticks are all DDR4 with 32GB@2133MT/s.

  • The first GPT-4-class AI model anyone can download has arrived: Llama 405B

    Jump

  • Each card has 24GB so 48GB vram total. I use ollama it fills whatever vrams is available on both cards and runs the rest on the CPU cores.

  • The first GPT-4-class AI model anyone can download has arrived: Llama 405B

    Jump

  • My specs because you asked:

     
        
CPU: Intel(R) Xeon(R) E5-2699 v3 (72) @ 3.60 GHz
GPU 1: NVIDIA Tesla P40 [Discrete]
GPU 2: NVIDIA Tesla P40 [Discrete]
GPU 3: Matrox Electronics Systems Ltd. MGA G200EH
Memory: 66.75 GiB / 251.75 GiB (27%)
Swap: 75.50 MiB / 40.00 GiB (0%)

  • The first GPT-4-class AI model anyone can download has arrived: Llama 405B

    Jump

  • What are you asking exactly?

    What do you want to run? I assume you have a 24GB GPU and 64GB host RAM?

  • The first GPT-4-class AI model anyone can download has arrived: Llama 405B

    Jump

  • I regularly run llama3 70b unqantized on two P40s and CPU at like 7tokens/s. It's usable but not very fast.

  • Suggestion for buying drive

    Jump

  • True multiple drives speed up reads significantly. As long as the videos are sequential read speeds can be very fast (600MB/s) even on one drive though. Results may vary.

  • Suggestion for buying drive

    Jump

  • I have a ~40TB HDD array and jellyfin is super fast. Just put the database and cache files on a SSD.

    For bulk storage of 4k videos with high bitrates HDDs are way cheaper.

  • Llama 3.1 is Meta's latest salvo in the battle for AI dominance

    Jump

  • Llama3.1 33b would be so cool. It would be a nice middle ground for my machine.

  • New youtube layout?

    Jump

  • At least on linux rm is very fast

  • New youtube layout?

    Jump

  • I use tubearchivist. It has a jellyfin addon but it could really use some improvements on how it exposes the videos.

  • Show us your dashboards

    Jump

  • What did you use to get the information for the current internet throughput?

  • Many Network Interfaces per VM/CT - Good Practice?

    Jump

  • Full pass through has no advantage when my reverse proxy terminates ssl and internal services are http only right?

    Regardless of fqdn nginx has to decrypt and restream anyways.

  • Where to buy server replacement hdd to match existing RAID configured drives?

    Jump

  • I think mixing RAM sticks is mostly fine today. Maybe you won't get 100% performance but I don't think it will be very noticeable. You may still run into issues with some capacity combinations depending on the mainboard/cpu. Regarding clock speeds usually all run on the clock of the slowest one.

    Matching RAM latency also matters for performance.

    When using different capacity RAM channels matter so take care on the order of population.

  • Patrick Breyer and Pirate Party lose EU Parliament seats

    Jump

  • There may be even better voting systems but 3-2-1 would be a nice change. This way strategic voting gets at least somewhat mitigated and might force people to actually invest some time and look at the agenda of some other parties too because they have to vote for 3 parties.

  • Solar project to destroy thousands of Joshua trees in the Mojave Desert

    Jump

  • I am always really annoyed when perfectly flat space in Austria is wasted with solar panels WHEN there are huge flat roofed buildings around.

    I hope they are not also chopping down trees.

  • Little bobby 👦

    Jump

  • Happy 30th birthday to RFC 1631 ("NAT"), the "short term solution" we all rely on

    Jump

  • At least I have a nice static and proper ipv6 prefix.

    However when I asked for a reverse dns entry they could only give me one for ipv4... So now my Mail server only uses ipv4. :-(

  • Hot Potato License

    Jump

  • There are a few flaws.

    There should be a clause forcing it to remain open source. Another clause should be that the license must not be changed. A warrenty and liability disclaimer would be also good. Otherwise a splendid license.

  • Big Tech to EU: "Drop Dead"

    Jump

  • While I don't like Apple losing them in the EU would be bad. Forcing them to open up their garden is way better.

    Less competition is bad for the consumer (usually). If they break laws though they must not sell in the EU.