volume_mute
What's a benefit of using a distilled model in Bedrock?
publish date: 2025/09/21 20:58:48.006893 UTC
volume_mute
Correct Answer
It reduces compute requirements, making it suitable for edge devices
Explanation
This type of model uses less power and has a smaller footprint, which makes it better for edge devices. The context window would likely be smaller as the model is smaller. This type of model does not mean that the reponses will be more creative. The accuracy of larger models will likely be higher.
Reference
AWS Certified AI Practitioner (AIF-C01) Study Guide, Tom Taulli