volume_mute

Of the choices below, which is a main reason why large language models consume significant compute resources?

publish date2025/09/17 06:45:16.402502 UTC

volume_mute

Correct Answer

They process billions of parameters to generate accurate responses

Explanation

The number of parameters in LLMss are usually massive and this means having to use sophisticated systems-like GPUs-to handle the processing.  RAG does consume compute resources, but this is a small part of the overall LLM. LLMs use complex linear algebra but this is not a key reason for the heavy use of compute resources.  Human feedback and evaluation is a small part of the process for developing and LLM.

Reference

AWS Certified AI Practitioner (AIF-C01) Study Guide, Tom Taulli


Quizzes you can take where this question appears