Definition
A technique aimed at minimising the number of ‘tokens’ (units of text) processed by Large Language Models (LLMs). This is crucial for managing computational costs and improving efficiency.
Why it matters (in Poovi’s context)
Directly addresses the cost and efficiency concerns associated with running advanced AI models like GPT-6 Astra, making them more accessible and sustainable for users.
Key properties or components
- Task decomposition
- Model collaboration
- Optimised processing
- Cost management
Contradictions or debates
None.