{"id":1555,"date":"2024-04-11T04:58:40","date_gmt":"2024-04-11T04:58:40","guid":{"rendered":"https:\/\/tastycounter.net\/index.php\/2024\/04\/11\/intel-trinh-lang-chip-ai-gaudi-3-nhanh-hon-50-so-voi-h100-cua-nvidia\/"},"modified":"2024-04-11T04:58:40","modified_gmt":"2024-04-11T04:58:40","slug":"intel-trinh-lang-chip-ai-gaudi-3-nhanh-hon-50-so-voi-h100-cua-nvidia","status":"publish","type":"post","link":"https:\/\/tastycounter.net\/index.php\/2024\/04\/11\/intel-trinh-lang-chip-ai-gaudi-3-nhanh-hon-50-so-voi-h100-cua-nvidia\/","title":{"rendered":"Intel tr\u00ecnh l\u00e0ng chip AI Gaudi 3, nhanh h\u01a1n 50% so v\u1edbi H100 c\u1ee7a NVIDIA"},"content":{"rendered":"<\/p>\n<div class=\"content-detail textview\">\n<div class=\"audio\"><audio controls><\/audio><\/div>\n<p>Intel v\u1eeba ch\u00ednh th\u1ee9c c\u00f4ng b\u1ed1 d\u00f2ng chip x\u1eed l\u00fd AI m\u1edbi nh\u1ea5t c\u00f3 t\u00ean g\u1ecdi Gaudi 3, v\u1edbi m\u1ee5c ti\u00eau th\u00e1ch th\u1ee9c v\u1ecb th\u1ebf d\u1eabn \u0111\u1ea7u m\u00e0 NVIDIA hi\u1ec7n \u0111ang n\u1eafm gi\u1eef trong ng\u00e0nh c\u00f4ng nghi\u1ec7p AI. Con chip m\u1edbi h\u1ee9a h\u1eb9n s\u1ebd c\u1ea3i thi\u1ec7n \u0111\u00e1ng k\u1ec3 hi\u1ec7u n\u0103ng v\u00e0 hi\u1ec7u su\u1ea5t so v\u1edbi GPU H100 c\u1ee7a NVIDIA, v\u00e0 th\u1eadm ch\u00ed l\u00e0 c\u1ea3 MI300X c\u1ee7a AMD.<\/p>\n<p>Theo tuy\u00ean b\u1ed1 c\u1ee7a Intel, Gaudi 3 cho kh\u1ea3 n\u0103ng ti\u1ebft ki\u1ec7m n\u0103ng l\u01b0\u1ee3ng h\u01a1n g\u1ea5p \u0111\u00f4i v\u00e0 c\u00f3 th\u1ec3 th\u1ef1c hi\u1ec7n c\u00e1c t\u00e1c v\u1ee5 AI nhanh h\u01a1n g\u1ea5p r\u01b0\u1ee1i so v\u1edbi H100. Nh\u1eefng con s\u1ed1 \u1ea5n t\u01b0\u1ee3ng n\u00e0y v\u1ec1 l\u00fd thuy\u1ebft n\u00e0y c\u00f3 th\u1ec3 gi\u00fap c\u1eaft gi\u1ea3m \u0111\u00e1ng k\u1ec3 m\u1ee9c chi ph\u00ed v\u1ed1n c\u1ef1c k\u1ef3 t\u1ed1n k\u00e9m li\u00ean quan \u0111\u1ebfn vi\u1ec7c \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh AI l\u1edbn. Con chip n\u00e0y c\u0169ng \u0111i k\u00e8m v\u1edbi nhi\u1ec1u m\u00f4-\u0111un kh\u00e1c nhau, bao g\u1ed3m c\u1ea5u h\u00ecnh 8 chip tr\u00ean bo m\u1ea1ch ch\u1ee7 v\u00e0 card t\u01b0\u01a1ng th\u00edch v\u1edbi c\u00e1c thi\u1ebft k\u1ebf m\u00e1y ch\u1ee7 Intel hi\u1ec7n c\u00f3.<\/p>\n<p>Intel cho bi\u1ebft h\u1ecd \u0111\u00e3 th\u1eed nghi\u1ec7m con chip n\u00e0y tr\u00ean c\u00e1c m\u00f4 h\u00ecnh AI ph\u1ed5 bi\u1ebfn t\u1eeb d\u1ef1 \u00e1n Llama 2 v\u00e0 Falcon c\u1ee7a Meta. K\u1ebft qu\u1ea3 cho th\u1ea5y Gaudi 3 c\u00f3 kh\u1ea3 n\u0103ng hu\u1ea5n luy\u1ec7n t\u1ed1t \u0111\u1ed1i v\u1edbi c\u00e1c m\u00f4 h\u00ecnh AI, \u0111\u1ed3ng th\u1eddi \u0111\u00e1p \u1ee9ng kh\u1ea3 n\u0103ng ch\u1ea1y hi\u1ec7u qu\u1ea3 c\u00e1c \u1ee9ng d\u1ee5ng ph\u1ee9c t\u1ea1p.<\/p>\n<p>Theo d\u1eef li\u1ec7u \u0111\u00e1nh gi\u00e1 benchmark n\u1ed9i b\u1ed9 c\u1ee7a Intel, Gaudi 3 nhanh h\u01a1n H100 trung b\u00ecnh 50% khi \u0111\u00e0o t\u1ea1o c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn nh\u01b0 Llama v\u1edbi 7 t\u1ef7 v\u00e0 13 t\u1ef7 tham s\u1ed1, c\u0169ng nh\u01b0 GPT-3 v\u1edbi 175 t\u1ef7 tham s\u1ed1. Ngo\u00e0i ra, Gaudi 3 \u0111\u01b0\u1ee3c k\u1ef3 v\u1ecdng s\u1ebd \u0111\u1ea1t hi\u1ec7u su\u1ea5t s\u1eed d\u1ee5ng n\u0103ng l\u01b0\u1ee3ng t\u1ed1t h\u01a1n 40% so v\u1edbi H100 trong c\u00e1c t\u00e1c v\u1ee5 suy lu\u1eadn.<\/p>\n<p>\u201cSo v\u1edbi Nvidia H100, Intel Gaudi 3 d\u1ef1 ki\u1ebfn s\u1ebd mang l\u1ea1i th\u1eddi gian \u0111\u00e0o t\u1ea1o trung b\u00ecnh nhanh h\u01a1n 50% tr\u00ean c\u00e1c model Llama2 v\u1edbi th\u00f4ng s\u1ed1 7B v\u00e0 13B c\u0169ng nh\u01b0 m\u1eabu th\u00f4ng s\u1ed1 GPT-3 175B. Ngo\u00e0i ra, th\u00f4ng l\u01b0\u1ee3ng suy lu\u1eadn c\u1ee7a b\u1ed9 t\u0103ng t\u1ed1c Intel Gaudi 3 \u0111\u01b0\u1ee3c d\u1ef1 \u0111o\u00e1n s\u1ebd v\u01b0\u1ee3t tr\u1ed9i h\u01a1n H100 trung b\u00ecnh 50%1 v\u00e0 40% \u0111\u1ed1i v\u1edbi hi\u1ec7u su\u1ea5t n\u0103ng l\u01b0\u1ee3ng suy lu\u1eadn trung b\u00ecnh tr\u00ean c\u00e1c tham s\u1ed1 Llama 7B v\u00e0 70B, c\u0169ng nh\u01b0 c\u00e1c m\u00f4 h\u00ecnh tham s\u1ed1 Falcon 180B\u201d.<\/p>\n<div id=\"articleads\" class=\"adbox adsense in-article\"><ins class=\"adsbygoogle\" style=\"text-align:center\" data-ad-format=\"fluid\" data-ad-layout=\"in-article\" data-ad-client=\"ca-pub-9275417305531302\" data-ad-slot=\"2079243249\"><\/ins><\/div>\n<p>Chi ti\u1ebft th\u00f4ng s\u1ed1 k\u1ef9 thu\u1eadt \u0111\u1ea7y \u0111\u1ee7 c\u1ee7a Gaudi 3 \u0111\u01b0\u1ee3c li\u1ec7t k\u00ea trong h\u00ecnh \u1ea3nh b\u00ean d\u01b0\u1edbi:<\/p>\n<figure><img decoding=\"async\" src=\"https:\/\/st.quantrimang.com\/photos\/image\/holder.png\" class=\"lazy\" data-src=\"https:\/\/st.quantrimang.com\/photos\/image\/2024\/04\/10\/intel-trinh-lang-chip-ai-gaudi-31.jpg\"><\/figure>\n<p>Gaudi 3 k\u1ebft n\u1ed1i v\u1edbi CPU ch\u1ee7 th\u00f4ng qua li\u00ean k\u1ebft PCIe Gen 5 x16 t\u1ed1c \u0111\u1ed9 cao. Intel c\u0169ng \u0111ang ph\u00e1t tri\u1ec3n c\u00e1c bi\u1ebfn th\u1ec3 l\u00e0m m\u00e1t b\u1eb1ng ch\u1ea5t l\u1ecfng \u0111\u1ec3 c\u00f3 hi\u1ec7u su\u1ea5t cao h\u01a1n n\u1eefa.<\/p>\n<p>S\u1ef1 ra m\u1eaft c\u1ee7a Gaudi 3 ch\u00ednh l\u00e0 l\u1eddi th\u00e1nh th\u1ee9c c\u00f3 s\u1ee9c n\u1eb7ng \u0111\u1ea7u ti\u00ean m\u00e0 Intel \u0111\u01b0a ra \u0111\u1ed1i v\u1edbi s\u1ef1 th\u1ed1ng tr\u1ecb c\u1ee7a NVIDIA, \u01b0\u1edbc t\u00ednh \u0111ang chi\u1ebfm kho\u1ea3ng 80% th\u1ecb ph\u1ea7n th\u1ecb tr\u01b0\u1eddng chip AI to\u00e0n c\u1ea7u. V\u1edbi vi\u1ec7c c\u00e1c kh\u00e1ch h\u00e0ng nh\u01b0 Dell, HP v\u00e0 Supermicro \u0111ang x\u00e2y d\u1ef1ng m\u00e1y ch\u1ee7 v\u1edbi chip m\u1edbi, Intel ho\u00e0n to\u00e0n c\u00f3 th\u1ec3 t\u1ef1 tin s\u1ebd gi\u00e0nh \u0111\u01b0\u1ee3c m\u1ed9t th\u1ecb ph\u1ea7n \u0111\u00e1ng k\u1ec3 trong th\u1eddi gian t\u1edbi. Gaudi 3 s\u1ebd c\u00f3 s\u1eb5n cho c\u00e1c OEM l\u1edbn c\u1ee7a Intel \u2013 bao g\u1ed3m Dell Technologies, HPE, Lenovo v\u00e0 Supermicro \u2013 v\u00e0o qu\u00fd 2 n\u0103m 2024.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Intel v\u1eeba ch\u00ednh th\u1ee9c c\u00f4ng b\u1ed1 d\u00f2ng chip x\u1eed l\u00fd AI m\u1edbi nh\u1ea5t c\u00f3 t\u00ean g\u1ecdi Gaudi 3, v\u1edbi m\u1ee5c ti\u00eau th\u00e1ch th\u1ee9c v\u1ecb th\u1ebf d\u1eabn \u0111\u1ea7u m\u00e0 NVIDIA hi\u1ec7n \u0111ang n\u1eafm gi\u1eef trong ng\u00e0nh c\u00f4ng nghi\u1ec7p AI. Con chip m\u1edbi h\u1ee9a h\u1eb9n s\u1ebd c\u1ea3i thi\u1ec7n \u0111\u00e1ng k\u1ec3 hi\u1ec7u n\u0103ng v\u00e0 hi\u1ec7u su\u1ea5t so v\u1edbi [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1555","post","type-post","status-publish","format-standard","hentry","category-khong-phan-loai"],"_links":{"self":[{"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/posts\/1555","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/comments?post=1555"}],"version-history":[{"count":0,"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/posts\/1555\/revisions"}],"wp:attachment":[{"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/media?parent=1555"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/categories?post=1555"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/tags?post=1555"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}