About the talk
This presentation explores how game companies can leverage AWS to prepare small language models that run directly on phones and desktop computers. We’ll demonstrate practical approaches for fine-tuning open-source models for specific gaming needs, enhancing them through distillation techniques, and optimizing for edge performance. Learn how to enable function calling capabilities that let these models trigger actions within your applications. We’ll showcase an efficient AWS feedback loop that continuously improves model responses by collecting user interactions and eliminating generic “slate” answers through targeted updates. Discover how this approach delivers responsive AI experiences while enhancing privacy, reducing costs, and enabling offline functionality across your customer devices.
Takeaway
– Develop and deploy Small Language Models for Multiple Platform.
– Implementing SLM Optimizations and function calling for operational techniques and triggering in-game actions.
– How to build a Continuous Improvement feedback loop to improve the AI experience.
Experience level needed: Beginner, Intermediate