{"id":664,"date":"2023-11-14T07:39:47","date_gmt":"2023-11-14T07:39:47","guid":{"rendered":"https:\/\/tastycounter.net\/index.php\/2023\/11\/14\/nvidia-hgx-h200-giai-phap-moi-nhat-cho-gpu-may-chu-ai-tong-hop\/"},"modified":"2023-11-14T07:39:47","modified_gmt":"2023-11-14T07:39:47","slug":"nvidia-hgx-h200-giai-phap-moi-nhat-cho-gpu-may-chu-ai-tong-hop","status":"publish","type":"post","link":"https:\/\/tastycounter.net\/index.php\/2023\/11\/14\/nvidia-hgx-h200-giai-phap-moi-nhat-cho-gpu-may-chu-ai-tong-hop\/","title":{"rendered":"NVIDIA HGX H200: Gi\u1ea3i ph\u00e1p m\u1edbi nh\u1ea5t cho GPU m\u00e1y ch\u1ee7 AI t\u1ed5ng h\u1ee3p"},"content":{"rendered":"<\/p>\n<div class=\"content-detail textview\">\n<div class=\"audio\"><audio controls><\/audio><\/div>\n<p>Song song v\u1edbi s\u1ef1 b\u00f9ng n\u1ed5 c\u1ee7a l\u0129nh v\u1ef1c Tr\u00ed tu\u1ec7 nh\u00e2n t\u1ea1o, NVIDIA \u0111\u00e3 ki\u1ebfm \u0111\u01b0\u1ee3c r\u1ea5t nhi\u1ec1u ti\u1ec1n trong n\u0103m qua t\u1eeb c\u00e1c c\u00f4ng ty nh\u01b0 Microsoft, OpenAI v\u00e0 h\u00e0ng lo\u1ea1t \u00f4ng l\u1edbn c\u00f4ng ngh\u1ec7 kh\u00e1c nh\u1edd nh\u1eefng h\u1ee3p \u0111\u1ed3ng cung \u1ee9ng GPU cao c\u1ea5p cho m\u1ea3ng AI s\u00e1ng t\u1ea1o \u0111\u1ea7y ti\u1ec1m n\u0103ng. Ti\u1ebfp n\u1ed1i th\u00e0nh c\u00f4ng \u0111\u00f3, h\u00f4m nay, NVIDIA ti\u1ebfp t\u1ee5c c\u00f4ng b\u1ed1 th\u1ebf h\u1ec7 GPU AI m\u1edbi h\u1ee9a h\u1eb9n mang l\u1ea1i cho t\u1ed1c \u0111\u1ed9 v\u00e0 hi\u1ec7u su\u1ea5t t\u1ed1i \u01b0u h\u01a1n n\u1eefa cho c\u00e1c d\u1ecbch v\u1ee5 AI quy m\u00f4 l\u1edbn.<\/p>\n<p>NVIDIA v\u1eeba ch\u00ednh th\u1ee9c tr\u00ecnh l\u00e0ng HGX H200, gi\u1ea3i ph\u00e1p \u0111\u1ed3 h\u1ecda m\u1edbi d\u1ef1a tr\u00ean ki\u1ebfn tr\u00fac chip Hopper v\u00e0 GPU H200 Tensor Core c\u1ee7a c\u00f4ng ty. HGX H200 l\u00e0 m\u1eabu GPU \u0111\u1ea7u ti\u00ean cung c\u1ea5p HBM3e \u2014 b\u1ed9 nh\u1edb l\u1edbn h\u01a1n, nhanh h\u01a1n \u0111\u1ec3 th\u00fac \u0111\u1ea9y kh\u1ea3 n\u0103ng x\u1eed l\u00fd nh\u1eefng t\u00e1c v\u1ee5 n\u1eb7ng c\u1ee7a AI t\u1ed5ng h\u1ee3p v\u00e0 c\u00e1c m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn, \u0111\u1ed3ng th\u1eddi th\u00fac \u0111\u1ea9y t\u00ednh to\u00e1n khoa h\u1ecdc cho kh\u1ed1i l\u01b0\u1ee3ng c\u00f4ng vi\u1ec7c HPC. V\u1edbi HBM3e, NVIDIA H200 cung c\u1ea5p b\u1ed9 nh\u1edb 141GB t\u1ed1c \u0111\u1ed9 4,8 terabyte\/gi\u00e2y, g\u1ea7n g\u1ea5p \u0111\u00f4i v\u1ec1 dung l\u01b0\u1ee3ng v\u00e0 b\u0103ng th\u00f4ng g\u1ea5p 2,4 l\u1ea7n so v\u1edbi ng\u01b0\u1eddi ti\u1ec1n nhi\u1ec7m A100.<\/p>\n<p>Ngo\u00e0i ra, NVIDIA c\u0169ng tuy\u00ean b\u1ed1 r\u1eb1ng CPU m\u1edbi s\u1ebd cung c\u1ea5p t\u1ed1c \u0111\u1ed9 suy lu\u1eadn nhanh g\u1ea7n g\u1ea5p \u0111\u00f4i so v\u1edbi H100 khi ch\u1ea1y m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn Llama 2.<\/p>\n<figure><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/st.quantrimang.com\/photos\/image\/holder.png\" alt=\"NVIDIA HGX H200\" width=\"2344\" height=\"1140\" class=\"lazy\" data-src=\"https:\/\/st.quantrimang.com\/photos\/image\/2023\/11\/14\/nvidia-hgx-h200-ra-mat1.jpg\"><figcaption>NVIDIA HGX H200<\/figcaption><\/figure>\n<div id=\"articleads\" class=\"adbox adsense in-article\"><ins class=\"adsbygoogle\" style=\"text-align:center\" data-ad-format=\"fluid\" data-ad-layout=\"in-article\" data-ad-client=\"ca-pub-9275417305531302\" data-ad-slot=\"2079243249\"><\/ins><\/div>\n<p>C\u00f4ng ty cho bi\u1ebft m\u1ed9t s\u1ed1 n\u1ec1n t\u1ea3ng \u0111\u00e1m m\u00e2y h\u00e0ng \u0111\u1ea7u trong ng\u00e0nh, bao g\u1ed3m Microsoft Azure, Amazon Web Services, Google Cloud v\u00e0 Oracle Cloud Infrastructure \u0111\u1ec1u \u0111\u00e3 \u0111\u0103ng k\u00fd mua GPU HGX H200. M\u1eabu GPU m\u1edbi n\u00e0y c\u00f3 th\u1ec3 \u0111\u01b0\u1ee3c s\u1eed d\u1ee5ng trong c\u1ea5u h\u00ecnh b\u1ed1n v\u00e0 t\u00e1m chi\u1ec1u, t\u01b0\u01a1ng th\u00edch v\u1edbi h\u1ec7 th\u1ed1ng ph\u1ea7n c\u1ee9ng v\u00e0 ph\u1ea7n m\u1ec1m HGX H100 c\u0169 h\u01a1n. Trong \u0111\u00f3, HGX H200 t\u00e1m chi\u1ec1u cung c\u1ea5p h\u01a1n 32 petaflop hi\u1ec7u n\u0103ng \u0111i\u1ec7n to\u00e1n h\u1ecdc s\u00e2u FP8 v\u00e0 1,1TB b\u1ed9 nh\u1edb b\u0103ng th\u00f4ng cao t\u1ed5ng h\u1ee3p \u0111\u1ec3 mang l\u1ea1i hi\u1ec7u su\u1ea5t cao nh\u1ea5t trong c\u00e1c \u1ee9ng d\u1ee5ng AI v\u00e0 HPC t\u1ed5ng h\u1ee3p.<\/p>\n<p>B\u00ean c\u1ea1nh \u0111\u00f3, m\u1ed9t s\u1ed1 \u0111\u1ed1i t\u00e1c ph\u1ea7n c\u1ee9ng m\u00e1y ch\u1ee7, bao g\u1ed3m ASRock Rack, ASUS, Dell Technologies, GIGABYTE, Hewlett Packard Enterprise, Lenovo v\u00e0 m\u1ed9t s\u1ed1 c\u00f4ng ty kh\u00e1c c\u0169ng \u0111ang c\u00f3 k\u1ebf ho\u1ea1ch n\u00e2ng c\u1ea5p h\u1ec7 th\u1ed1ng H100 hi\u1ec7n t\u1ea1i l\u00ean H200 m\u1edbi.<\/p>\n<p>GPU HGX H200 s\u1ebd xu\u1ea5t hi\u1ec7n trong h\u1ec7 th\u1ed1ng c\u1ee7a c\u00e1c c\u00f4ng ty m\u00e1y ch\u1ee7 PC v\u00e0 d\u1ecbch v\u1ee5 \u0111\u00e1m m\u00e2y \u0111\u00f3 v\u00e0o kho\u1ea3ng qu\u00fd 2 n\u0103m 2024. Tr\u01b0\u1edbc \u0111\u00f3, NVIDIA c\u0169ng \u0111\u00e3 c\u00f4ng b\u1ed1 n\u1ec1n t\u1ea3ng AI th\u1ebf h\u1ec7 GH200 Grace Hopper, d\u1ef1 ki\u1ebfn s\u1ebd xu\u1ea5t x\u01b0\u1edfng v\u00e0o qu\u00fd 2 n\u0103m 2024.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Song song v\u1edbi s\u1ef1 b\u00f9ng n\u1ed5 c\u1ee7a l\u0129nh v\u1ef1c Tr\u00ed tu\u1ec7 nh\u00e2n t\u1ea1o, NVIDIA \u0111\u00e3 ki\u1ebfm \u0111\u01b0\u1ee3c r\u1ea5t nhi\u1ec1u ti\u1ec1n trong n\u0103m qua t\u1eeb c\u00e1c c\u00f4ng ty nh\u01b0 Microsoft, OpenAI v\u00e0 h\u00e0ng lo\u1ea1t \u00f4ng l\u1edbn c\u00f4ng ngh\u1ec7 kh\u00e1c nh\u1edd nh\u1eefng h\u1ee3p \u0111\u1ed3ng cung \u1ee9ng GPU cao c\u1ea5p cho m\u1ea3ng AI s\u00e1ng t\u1ea1o \u0111\u1ea7y ti\u1ec1m n\u0103ng. [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-664","post","type-post","status-publish","format-standard","hentry","category-khong-phan-loai"],"_links":{"self":[{"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/posts\/664","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/comments?post=664"}],"version-history":[{"count":0,"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/posts\/664\/revisions"}],"wp:attachment":[{"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/media?parent=664"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/categories?post=664"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tastycounter.net\/index.php\/wp-json\/wp\/v2\/tags?post=664"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}