Definition
AI models, particularly LLMs, that are run on a user’s own hardware rather than accessed via a cloud-based API.
Why it matters (in Poovi’s context)
Offers potential cost savings and enhanced privacy by eliminating API fees and keeping data local. The video explores the feasibility and performance of various local models.
Key properties or components
- Run on local hardware
- Requires significant RAM/GPU
- Potential cost savings
- Enhanced privacy
Contradictions or debates
None.