Overview
An extremely high-end workstation featuring a 96-core AMD Threadripper processor, designed for the most demanding computational tasks. This specific configuration also includes a top-tier GPU.
Role in this knowledge base
This represents the pinnacle of the hardware tested, used to run the largest version of the Llama model (405 billion parameters), to demonstrate the limits of local LLM deployment.
Key facts
- This system was equipped with an Nvidia 6000 Ada GPU and 512GB of RAM, pulling over 1200 Watts.