How Does AI Model Distillation Work for Startups Right Now

How does AI model distillation work for startups? It's the process of training a smaller, cheaper student model to copy a larger teacher model's outputs, and in 2025 and 2026 it became the main reason some AI products got dramatically cheaper to run without getting any worse.