Distillation as a technique in which a less capable AI model is trained on the outputs of a stronger one. The aim is to help the less capable models replicate some of the larger model’s capabilities at a lower cost.
aiweekly.co.in
“Where Machines Make Headlines.”