{"id":6481,"date":"2025-04-02T15:35:15","date_gmt":"2025-04-02T07:35:15","guid":{"rendered":"https:\/\/witology.com.tw\/?p=6481"},"modified":"2025-12-29T15:41:20","modified_gmt":"2025-12-29T07:41:20","slug":"https-witology-com-tw-post-6481","status":"publish","type":"post","link":"https:\/\/witology.com.tw\/en\/post\/6481\/","title":{"rendered":"April_AI Model Feature\uff5cDeepSeek: The technology innovation that shakes the world(Next)"},"content":{"rendered":"<p><strong>Author: Mr. Lin Weizhi, Executive Vice President, Ji-Pu Industrial Trend Research Institute<\/strong><\/p>\n<p><strong><span class=\"s6\">DeepSeek-V3<\/span><span class=\"s6\">Model overview<\/span><\/strong><\/p>\n<p><span class=\"s4\">DeepSeek<\/span><span class=\"s4\">In 2024<\/span><span class=\"s4\">Christmas<\/span><span class=\"s4\">rolled out<\/span><span class=\"s4\">DeepSeek<\/span><span class=\"s4\">-V3<\/span><span class=\"s4\">Model.<\/span><span class=\"s4\">is based on<\/span><span class=\"s4\">Transformer organization<\/span><span class=\"s4\">and<\/span><span class=\"s4\">king (chess piece)<\/span><span class=\"s4\">referred to above<\/span><span class=\"s4\">Mixture-of-Experts. <\/span><span class=\"s4\">MoE<\/span><span class=\"s4\">) Structure<\/span><span class=\"s4\">Made some innovations<\/span><span class=\"s4\">Its total number of parameters reaches<\/span><span class=\"s4\">6710<\/span><span class=\"s4\">billion<\/span><span class=\"s4\">(math.) genus<\/span><span class=\"s4\">and each layer<\/span><span class=\"s4\">256 experts<\/span><span class=\"s4\">center<\/span><span class=\"s4\">Activate only<\/span><span class=\"s4\">8<\/span><span class=\"s4\">+1<\/span><span class=\"s4\">individual<\/span><span class=\"s4\">(math.) genus<\/span><span class=\"s4\">Up to<\/span><span class=\"s4\">The process is efficient and precise.<\/span><span class=\"s4\">It has three major innovations:<\/span><\/p>\n<div class=\"s17\">One, <span class=\"s4\">Customized Model Racks<\/span><span class=\"s4\">organization<\/span><span class=\"s4\">(<\/span><span class=\"s4\">only<\/span><span class=\"s4\">Select 8+1 experts<\/span><span class=\"s4\">::<\/span><span class=\"s4\">8 R's.<\/span><span class=\"s4\">o<\/span><span class=\"s4\">uted Expert<\/span> <span class=\"s4\">+1 S<\/span><span class=\"s4\">hared<\/span> <span class=\"s4\">E<\/span><span class=\"s4\">xpert<\/span><span class=\"s4\">)<\/span><\/div>\n<p class=\"s18\"><span class=\"s4\">The key to DeepSeek-V3's ability to strike an excellent balance between performance and computational efficiency is its carefully designed customized model architecture. The core innovation is<\/span><span class=\"s4\">because of<\/span><strong><span class=\"s6\">Mixture-of-Experts, autonomous R&amp;D. <\/span><span class=\"s6\">MoE<\/span><span class=\"s6\">)<\/span><\/strong><span class=\"s4\"><strong>Mechanism<\/strong>The<\/span><span class=\"s4\">By being more compact and miniaturized,<\/span><strong><span class=\"s6\">More Expert Designs<\/span><\/strong><span class=\"s4\">The Government of the Hong Kong Special Administrative Region (HKSAR) has also introduced additional<div class=\"su-members\" style=\"background-color:#ffffff;border-color:#cccccc;color:#666666\">For more details, please register or log in.<a href=\"\/log-in\/\">Member Login<\/a>.<\/div><\/span><\/p>","protected":false},"excerpt":{"rendered":"<p>\u4f5c\u8005\uff1a\u667a\u749e\u7522\u696d\u8da8\u52e2\u7814\u7a76\u6240\u57f7\u884c\u526f\u7e3d \u6797\u5049\u667a DeepSeek-V3\u6a21\u578b\u6982\u8ff0 DeepSeek\u65bc2024\u5e74\u8056\u8a95\u7bc0\u63a8 [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":6478,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"rank_math_title":"","rank_math_description":"DeepSeek-V3\u6a21\u578b\u6982\u8ff0DeepSeek\u65bc2024\u5e74\u8056\u8a95\u7bc0\u63a8\u51faDeepSeek-V3\u6a21\u578b\uff0c\u662f\u57fa\u65bc\u201dTransformer\u67b6\u69cb\u201d\uff0c\u4e26\u5c07\u4e0a\u6587\u6240\u63d0\u53ca\u7684\u5c08\u5bb6\u6df7\u5408Mixture-of-Experts,MoE\u67b6\u69cb\u505a\u4e86\u4e00\u4e9b\u5275\u65b0\uff0c\u5176\u7e3d\u53c3\u6578\u91cf\u9054\u52306710\u5104\uff0c\u4e14\u6bcf\u5c64256\u500b\u5c08\u5bb6\u4e2d\u50c5\u555f\u52d58+","rank_math_focus_keyword":"Transformer\u67b6\u69cb","rank_math_robots":null,"footnotes":""},"categories":[52],"tags":[],"class_list":["post-6481","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech"],"_links":{"self":[{"href":"https:\/\/witology.com.tw\/en\/wp-json\/wp\/v2\/posts\/6481","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/witology.com.tw\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/witology.com.tw\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/witology.com.tw\/en\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/witology.com.tw\/en\/wp-json\/wp\/v2\/comments?post=6481"}],"version-history":[{"count":3,"href":"https:\/\/witology.com.tw\/en\/wp-json\/wp\/v2\/posts\/6481\/revisions"}],"predecessor-version":[{"id":7067,"href":"https:\/\/witology.com.tw\/en\/wp-json\/wp\/v2\/posts\/6481\/revisions\/7067"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/witology.com.tw\/en\/wp-json\/wp\/v2\/media\/6478"}],"wp:attachment":[{"href":"https:\/\/witology.com.tw\/en\/wp-json\/wp\/v2\/media?parent=6481"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/witology.com.tw\/en\/wp-json\/wp\/v2\/categories?post=6481"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/witology.com.tw\/en\/wp-json\/wp\/v2\/tags?post=6481"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}