|
|
|
<br>DeepSeek-R1 is based on DeepSeek-V3, a mixture of specialists (MoE) model recently [open-sourced](https://learninghub.fulljam.com) by DeepSeek. This base model is fine-tuned using Group Relative Policy Optimization (GRPO), a reasoning-oriented variant of RL. The research study group also performed understanding distillation from DeepSeek-R1 to open-source Qwen and [bytes-the-dust.com](https://bytes-the-dust.com/index.php/User:IslaVandermark) Llama designs and released several variations of each |