Overview

A graphics card designed for small form factor (SFF) systems, featuring the Ada Lovelace architecture. It offers substantial VRAM and a relatively low power draw, making it suitable for specific professional workloads and AI tasks.

Role in this knowledge base

Discussed as a viable hardware option for running large language models locally due to its balance of performance, VRAM (20GB ECC), and power efficiency (70W).

Key facts

  • It possesses 20GB of ECC VRAM and operates within a 70W power envelope, negating the need for external power connectors.

Sources