volume_mute

What's a benefit of using a distilled model in Bedrock?

publish date2025/09/21 20:58:48.006893 UTC

volume_mute

Correct Answer

It reduces compute requirements, making it suitable for edge devices

Explanation

This type of model uses less power and has a smaller footprint, which makes it better for edge devices.  The context window would likely be smaller as the model is smaller.  This type of model does not mean that the reponses will be more creative.  The accuracy of larger models will likely be higher.

Reference

AWS Certified AI Practitioner (AIF-C01) Study Guide, Tom Taulli


Quizzes you can take where this question appears