6ä»¶ã®ã¢ãã«
Nemotron 3 Ultra
nvidia/nemotron-3-ultra-550b-a55bNVIDIA Nemotron 3 Ultraã¯ãNVIDIAã®æå 端ã®ããã³ãã£ã¢æšè«ã»ãªãŒã±ã¹ãã¬ãŒã·ã§ã³ã¢ãã«ã§ã550Båã®ç·ãã©ã¡ãŒã¿ã®ãã¡55Båã®ã¢ã¯ãã£ããã©ã¡ãŒã¿ãæã€ïŒMoEïŒããã€ããªããTransformer-Mambaã®æ··åå°éå®¶ã¢ãŒããã¯ãã£äžã«æ§ç¯ãããŠããã...
Nemotron 3 Super
nemotron-3-super-120b-a12bNVIDIA Nemotron 3 Superã¯ã120Bãã©ã¡ãŒã¿ã®ãªãŒãã³ãã€ããªããMoEã¢ãã«ã§ãæå€§èšç®å¹çãšè€éãªãã«ããšãŒãžã§ã³ãã¢ããªã±ãŒã·ã§ã³ã«ããã粟床ã®ããã«ãããã12Bãã©ã¡ãŒã¿ãã¢ã¯ãã£ããŒãããŸãããã€ããªããMamba-TransformerMixture-of-Experts ã¢ãŒããã¯ãã£ãšãã«ãããŒã¯ã³äºæž¬(MTP)ã«åºã¥ããŠãããäž»èŠãªãªãŒãã³ã¢ãã«ãšæ¯èŒããŠ50%以äžé«ãããŒã¯ã³çæãå®çŸããŸãã
Nemotron 3 Nano 30B A3B
nvidia/nemotron-3-nano-30b-a3bNVIDIA Nemotron 3 Nano 30B A3Bã¯ãéçºè ãç¹åãããšãŒãžã§ã³ãã£ãã¯AIã·ã¹ãã ãæ§ç¯ããããã®ãæé«ã®èšç®å¹çãšç²ŸåºŠãåããå°èŠæš¡èšèªMoEã¢ãã«ã§ãã ãã®ã¢ãã«ã¯å®å šã«ãªãŒãã³ã§ããããªãŒãã³ãŠã§ã€ããããŒã¿ã»ãããã¬ã·ããåããŠãããããéçºè ã¯æå€§éã®ãã©ã€ãã·ãŒãšã»ãã¥ãªãã£ã®ããã«ãã¢ãã«ãç°¡åã«ã«ã¹ã¿ãã€ãºãæé©åãããã³èªç€Ÿã€ã³ãã©ã¹ãã©ã¯ãã£ã«ãããã€ã§ããŸãã
Llama 3.3 Nemotron Super 49B V1.5
nvidia/llama-3.3-nemotron-super-49b-v1.5Llama-3.3-Nemotron-Super-49Bv1.5ã¯ãMeta ã®Llama-3.3-70B-InstructããæŽŸçãã49Bãã©ã¡ãŒã¿ã®è±èªäžå¿ã®æšè«/ãã£ããã¢ãã«ã§ã128Kã®ã³ã³ããã¹ããŠã£ã³ããŠãåããŠããŸããæ°åŠãã³ãŒããç§åŠããã«ãã¿ãŒã³ãã£ããã«ãããSFTãéããŠãšãŒãžã§ã³ãã¯ãŒã¯ãããŒ(RAGãããŒã«åŒã³åºã)çšã«åŸåŠç¿ããããã®åŸè€æ°ã®RL段éãç¶ããŸãã
Llama 3.1 Nemotron Ultra 253B v1
nvidia/llama-3.1-nemotron-ultra-253b-v1Llama-3.1-Nemotron-Ultra-253B-v1ã¯ãé«åºŠãªæšè«ã人éãšã®ã€ã³ã¿ã©ã¯ãã£ããªãã£ãããæ€çŽ¢æ¡åŒµçæïŒRAGïŒãããã³ããŒã«åŒã³åºãã¿ã¹ã¯ã«æé©åãããå€§èŠæš¡èšèªã¢ãã«ïŒLLMïŒã§ããMeta ã®Llama-3.1-405B-Instruct ããæŽŸçããŠããããã¥ãŒã©ã«ã¢ãŒããã¯ãã£ãµãŒãïŒNASïŒã䜿çšããŠå€§å¹ ã«ã«ã¹ã¿ãã€ãºãããŠãããå¹çã®åäžãã¡ã¢ãªäœ¿çšéã®åæžãæšè«ã¬ã€ãã³ã·ã®æ¹åãå®çŸãããŠããŸãã
Llama 3.1 Nemotron 70B Instruct
nvidia/llama-3.1-nemotron-70b-instructNVIDIAã®Llama 3.1 Nemotron 70Bã¯ãæ£ç¢ºã§æçšãªå¿çãçæããããã«èšèšãããèšèªã¢ãã«ã§ãã[Llama 3.1 70Bã¢ãŒããã¯ãã£](/models/meta-llama/llama-3.1-70b-instruct)ãšäººéãã£ãŒãããã¯ããã®åŒ·ååŠç¿(RLHF)ãæŽ»çšããèªåã¢ã©ã€ã¡ã³ããã³ãããŒã¯ã§åªããæ§èœãçºæ®ããŸãã