Reply to thread

Message: <blockquote data-quote="MihiCherub" data-source="post: 30496402" data-attributes="member: 238676">The DeepSeek R1 model is a versatile, powerful AI tool that’s set to revolutionize how businesses and individuals interact with technology. Whether you’re automating workflows or enhancing user experiences, the R1 is a game-changer.Open-Source Model You Can Run Locally<img src="https://dp-cdn-deepseek.obs.cn-east-3.myhuaweicloud.com/api-docs/deepseek_r1_example_en.gif" alt="" class="fr-fic fr-dii fr-draggable " style="width: 771px" /><img src="https://huggingface.co/deepseek-ai/DeepSeek-R1/resolve/main/figures/benchmark.jpg" alt="" class="fr-fic fr-dii fr-draggable " style="width: 770px" /><h3></h3><h3>DeepSeek-R1-Evaluation  </h3> <table style='width: 100%'><tr><th>Category</th><th>Benchmark (Metric)</th><th>Claude-3.5-Sonnet-1022</th><th>GPT-4o 0513</th><th>DeepSeek V3</th><th>OpenAI o1-mini</th><th>OpenAI o1-1217</th><th>DeepSeek R1</th></tr><tr><td></td><td>Architecture</td><td>-</td><td>-</td><td>MoE</td><td>-</td><td>-</td><td>MoE</td></tr><tr><td></td><td># Activated Params</td><td>-</td><td>-</td><td>37B</td><td>-</td><td>-</td><td>37B</td></tr><tr><td></td><td># Total Params</td><td>-</td><td>-</td><td>671B</td><td>-</td><td>-</td><td>671B</td></tr><tr><td>English</td><td>MMLU (Pass@1)</td><td>88.3</td><td>87.2</td><td>88.5</td><td>85.2</td><td>91.8</td><td>90.8</td></tr><tr><td></td><td>MMLU-Redux (EM)</td><td>88.9</td><td>88.0</td><td>89.1</td><td>86.7</td><td>-</td><td>92.9</td></tr><tr><td></td><td>MMLU-Pro (EM)</td><td>78.0</td><td>72.6</td><td>75.9</td><td>80.3</td><td>-</td><td>84.0</td></tr><tr><td></td><td>DROP (3-shot F1)</td><td>88.3</td><td>83.7</td><td>91.6</td><td>83.9</td><td>90.2</td><td>92.2</td></tr><tr><td></td><td>IF-Eval (Prompt Strict)</td><td>86.5</td><td>84.3</td><td>86.1</td><td>84.8</td><td>-</td><td>83.3</td></tr><tr><td></td><td>GPQA-Diamond (Pass@1)</td><td>65.0</td><td>49.9</td><td>59.1</td><td>60.0</td><td>75.7</td><td>71.5</td></tr><tr><td></td><td>SimpleQA (Correct)</td><td>28.4</td><td>38.2</td><td>24.9</td><td>7.0</td><td>47.0</td><td>30.1</td></tr><tr><td></td><td>FRAMES (Acc.)</td><td>72.5</td><td>80.5</td><td>73.3</td><td>76.9</td><td>-</td><td>82.5</td></tr><tr><td></td><td>AlpacaEval2.0 (LC-winrate)</td><td>52.0</td><td>51.1</td><td>70.0</td><td>57.8</td><td>-</td><td>87.6</td></tr><tr><td></td><td>ArenaHard (GPT-4-1106)</td><td>85.2</td><td>80.4</td><td>85.5</td><td>92.0</td><td>-</td><td>92.3</td></tr><tr><td>Code</td><td>LiveCodeBench (Pass@1-COT)</td><td>33.8</td><td>34.2</td><td>-</td><td>53.8</td><td>63.4</td><td>65.9</td></tr><tr><td></td><td>Codeforces (Percentile)</td><td>20.3</td><td>23.6</td><td>58.7</td><td>93.4</td><td>96.6</td><td>96.3</td></tr><tr><td></td><td>Codeforces (Rating)</td><td>717</td><td>759</td><td>1134</td><td>1820</td><td>2061</td><td>2029</td></tr><tr><td></td><td>SWE Verified (Resolved)</td><td>50.8</td><td>38.8</td><td>42.0</td><td>41.6</td><td>48.9</td><td>49.2</td></tr><tr><td></td><td>Aider-Polyglot (Acc.)</td><td>45.3</td><td>16.0</td><td>49.6</td><td>32.9</td><td>61.7</td><td>53.3</td></tr><tr><td>Math</td><td>AIME 2024 (Pass@1)</td><td>16.0</td><td>9.3</td><td>39.2</td><td>63.6</td><td>79.2</td><td>79.8</td></tr><tr><td></td><td>MATH-500 (Pass@1)</td><td>78.3</td><td>74.6</td><td>90.2</td><td>90.0</td><td>96.4</td><td>97.3</td></tr><tr><td></td><td>CNMO 2024 (Pass@1)</td><td>13.1</td><td>10.8</td><td>43.2</td><td>67.6</td><td>-</td><td>78.8</td></tr><tr><td>Chinese</td><td>CLUEWSC (EM)</td><td>85.4</td><td>87.9</td><td>90.9</td><td>89.9</td><td>-</td><td>92.8</td></tr><tr><td></td><td>C-Eval (EM)</td><td>76.7</td><td>76.0</td><td>86.5</td><td>68.9</td><td>-</td><td>91.8</td></tr><tr><td></td><td>C-SimpleQA (Correct)</td><td>55.4</td><td>58.7</td><td>68.0</td><td>40.3</td><td>-</td><td>63.7</td></tr></table>DeepSeek R1 release <a href="https://api-docs.deepseek.com/news/news250120" target="_blank">https://api-docs.deepseek.com/news/news250120</a>- Online chat <a href="https://chat.deepseek.com/" target="_blank">https://chat.deepseek.com/</a>- Deepseek coder <a href="https://huggingface.co/spaces/akhaliq/anychat" target="_blank">https://huggingface.co/spaces/akhaliq/anychat</a>- Higgingface <a href="https://huggingface.co/deepseek-ai/DeepSeek-R1" target="_blank">https://huggingface.co/deepseek-ai/DeepSeek-R1</a>DeepSeek Math Capabilities: Precision Meets PowerDeepSeek’s math capabilities are designed to handle a wide range of mathematical tasks, from basic arithmetic to advanced calculus, linear algebra, and statistical analysis. Its AI-driven engine ensures accurate problem-solving, step-by-step explanations, and the ability to tackle complex equations with ease. Whether you're a student, educator, or professional, DeepSeek can simplify math challenges and provide clear, logical solutions.</blockquote>

Verification: Asuwa dahayen wadi kalama keeyada?

Top Bottom