Knowledge distillation

Metamorphic-Based Many-Objective Distillation of LLMs for Code-related Tasks

Knowledge distillation compresses large language models (LLMs) into more compact and efficient versions that achieve similar accuracy …

Annibale Panichella