volume_mute
Of the choices below, which is a main reason why large language models consume significant compute resources?
publish date: 2025/09/17 06:45:16.402502 UTC
volume_mute
Correct Answer
They process billions of parameters to generate accurate responses
Explanation
The number of parameters in LLMss are usually massive and this means having to use sophisticated systems-like GPUs-to handle the processing. RAG does consume compute resources, but this is a small part of the overall LLM. LLMs use complex linear algebra but this is not a key reason for the heavy use of compute resources. Human feedback and evaluation is a small part of the process for developing and LLM.
Reference
AWS Certified AI Practitioner (AIF-C01) Study Guide, Tom Taulli