LLM-jp-3.1 vs Claude Haiku 4.5ïŒåœç£ãªãŒãã³æ¥æ¬èªã¢ãã« vs æµ·å€ã¯ããŒãºã
æ¥æ¬èªãéèŠãããšãããåœç£ã®æ¥æ¬èªç¹åãªãŒãã³ã¢ãã«ããšãæµ·å€ã®é«éã¯ããŒãºãã¢ãã«ããšããå¯Ÿç §çãªéžæè¢ããããŸããåœç«æ å ±åŠç ç©¶æïŒNIIïŒã® LLM-jp-3.1 ãšãAnthropic ã® Claude Haiku 4.5 ã§ãããã®èšäºã§ã¯ãæ¥æ¬èªéèŠã®çšéã§åœç£ãªãŒãã³ãã©ããŸã§æŠããããèŠãŠãããŸãã
çµè«ããèšããšã**ãæ¥æ¬èªã®æç« ã»äººæç³»ã¿ã¹ã¯ãªã LLM-jp-3.1ãã³ãŒãã£ã³ã°ãé床ã»ã³ã¹ããªã Haiku 4.5ã**ã§ãã
ã¹ããã¯æ¯èŒ
| é ç® | LLM-jp-3.1 8x13B instruct4 | Claude Haiku 4.5 |
|---|---|---|
| æäŸå | åœç«æ å ±åŠç ç©¶æïŒNIIïŒ | Anthropic |
| ã¢ãã«IDïŒFastMetalïŒ | llm-jp-3.1-8x13b-instruct4 | anthropic-claude-haiku-4-5 |
| ã©ã€ã»ã³ã¹ | ãªãŒãã³ïŒéã¿å ¬éïŒ | ã¯ããŒãºã |
| ã¢ãŒããã¯ã㣠| MoEïŒç·73BïŒã¢ã¯ãã£ã22BïŒ | éå ¬é |
| å ¥å | ããã¹ã | ããã¹ãã»ç»å |
| äž»ãªåŒ·ã¿ | æ¥æ¬èªã»äººæç³»ã¿ã¹ã¯ | é床ã»äœã³ã¹ãã»ã³ãŒãã£ã³ã° |
匷ã¿ã®éã
LLM-jp-3.1 ã¯ãæ¥æ¬ã®ç ç©¶æ©é¢ãéçºããæ¥æ¬èªç¹åã®ãªãŒãã³ã¢ãã«ã§ãããã©ãã°ã·ããã® llm-jp-3.1-8x13b-instruct4ïŒç·73BïŒã¢ã¯ãã£ã22BïŒã¯ãæ¥æ¬èªè©äŸ¡ã§ GPT-4-0613 ãäžåããšãããç¹ã«äººæç³»ïŒhumanitiesïŒã«ããŽãªã§æãé«ãã¹ã³ã¢ãèšé²ããŠããŸããæç€ºè¿œåŸæ§ãäžä»£ã远ã£ãŠå€§ããæ¹åããŸãããéã¿ãå
¬éãããŠãããèªåã§ã®ãã¹ãã£ã³ã°ãç ç©¶çšéã«äœ¿ããç¹ãç¹åŸŽã§ããåœç£ã»ãªãŒãã³ãšããæ§æ Œã¯ãæ¥æ¬èªã®ãã¥ã¢ã³ã¹ãéææ§ãéèŠããçŸå Žã§äŸ¡å€ããããŸãã
Claude Haiku 4.5 ã¯ãã¯ããŒãºããªããé床ã»ã³ã¹ãã»ã³ãŒãã£ã³ã°ã®ãã©ã³ã¹ã«åªããŸããæéã¯å®ããSonnet ç³»ã®2å以äžã®é床ã§åããŸããSWE-bench Verified ã§ 73% ãšãäžäœã«èèããã³ãŒãã£ã³ã°åãæã¡ãããã¹ãã«å ããŠç»åãæ±ããŸããæ¥ã ã®äœæ¥ã®äž»åãšããŠå¹ åºã䜿ããã¢ãã«ã§ãã
FastMetal ã§ã®å建ãŠã®å®éã®åäŸ¡ã¯æéããŒãžã§ã確èªãã ããã
ããããã®åŒ±ç¹
LLM-jp-3.1 ã®æ³šæç¹ïŒ ã³ãŒãã£ã³ã°ãæ°åŠã®ã¿ã¹ã¯ã§ã¯ã仿©é¢ã®ã¢ãã«ã«æ¯ã¹ãŠæ§èœãå£ãåŸåããããä»åŸã®æ¹å課é¡ãšãããŠããŸããæèé·ãæ§ããã§ãç»åã¯æ±ããŸãããæ±çšã®å®åå šè¬ã§ææ°ã®ããã³ãã£ã¢æ©ãšåŒµãåãã¢ãã«ã§ã¯ãªããæ¥æ¬èªã»äººæç³»ãšããåŸæåéã§éžã¶ã¢ãã«ã§ãã
Claude Haiku 4.5 ã®æ³šæç¹ïŒ ã¯ããŒãºããªã®ã§éã¿ã¯äœ¿ãããèªåã§ã®ãã¹ãã£ã³ã°ãæ¹å€ã¯ã§ããŸãããæ¥æ¬èªç¹åã®ã¢ãã«ã§ã¯ãªããããç¹çŽ°ãªæ¥æ¬èªè¡šçŸãææç©ã®è³ªãå·Šå³ããçšéã§ã¯ãå®éã«æ¯ã¹ãŠã¿ã䟡å€ããããŸãã
䜿ãåã
- LLM-jp-3.1 ãåãã±ãŒã¹ â æ¥æ¬èªã®æç« çæã»èŠçŽã人æç³»ã®ç¥èã¿ã¹ã¯ãåœç£ã»ãªãŒãã³ã§ããããšèªäœãèŠä»¶ã«ãªãç ç©¶ã»å ¬å ±çšéã
- Claude Haiku 4.5 ãåãã±ãŒã¹ â ã³ãŒãã£ã³ã°ãå«ãå®åå šè¬ã倧éã®ãªã¯ãšã¹ããéãå®ãæãããå Žé¢ãç»åå ¥åãå¿ èŠãªçšéã
äž¡æ¹è©Šã
æ¥æ¬èªã®å質ã¯ããã³ãããŒã¯ã®é äœã§ã¯ãªãèªåã®å®ããã³ããã§ç¢ºãããã®ã確å®ã§ããFastMetal ãªããåã API ããŒã»åãåå»ºãŠæ®é«ã®ãŸãŸ model ãå·®ãæ¿ããã ãã§äž¡æ¹ãæ¯èŒã§ããŸãã
# LLM-jp-3.1 8x13B instruct4
curl https://api.fastmetal.ai/v1/chat/completions \
-H "Authorization: Bearer $FASTMETAL_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model": "llm-jp-3.1-8x13b-instruct4", "messages": [{"role": "user", "content": "ããã«ã¡ã¯"}]}'
# Claude Haiku 4.5ïŒmodel ãå·®ãæ¿ããã ãïŒ
curl https://api.fastmetal.ai/v1/chat/completions \
-H "Authorization: Bearer $FASTMETAL_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model": "anthropic-claude-haiku-4-5", "messages": [{"role": "user", "content": "ããã«ã¡ã¯"}]}'
ãããã質å
Q. æ¥æ¬èªãªãã©ã¡ããäžã§ããïŒ æ¥æ¬èªã®æç« ã人æç³»ã¿ã¹ã¯ã§ã¯ LLM-jp-3.1 ã匷ã¿ãçºæ®ããŸãããã ãçšéã«ãã£ãŠå·®ãåºããããå®ããã³ããã§ã®æ¯èŒãããããããŸããHaiku 4.5 ãæ¥æ¬èªã¯å®çšçã§ãã
Q. ã³ãŒãã£ã³ã°ãªãã©ã¡ãã§ããïŒ Claude Haiku 4.5 ã§ããSWE-bench Verified 73% ãšå®å®ããã³ãŒãã£ã³ã°åãæã¡ãŸããLLM-jp-3.1 ã¯ã³ãŒãã£ã³ã°ã»æ°åŠãçžå¯ŸçãªåŒ±ç¹ã§ãã
Q. LLM-jp-3.1 ã¯ãªãŒãã³ã¢ãã«ã§ããïŒ ã¯ããåœç«æ å ±åŠç ç©¶æãéã¿ãå ¬éããŠãããæ¥æ¬èªç¹åã®ãªãŒãã³ã¢ãã«ã§ãã
ãŸãšã
æ¥æ¬èªã»äººæç³»ãªã LLM-jp-3.1ãã³ãŒãã£ã³ã°ãé床ã»ã³ã¹ããªã Claude Haiku 4.5 ââåœç£ãªãŒãã³ãšæµ·å€ã¯ããŒãºãã¯ãåŸæåéãã¯ã£ããåãããŸããæ¥æ¬èªéèŠã®çŸå Žã§ã¯ãäž¡æ¹ãåãããŒã§è©ŠããŠèŠæ¥µããã®ãããããã§ãã
åã¢ãã«ã®è©³çŽ°ã¯ llm-jp-3.1 ã¬ãã¥ãŒãš Claude Haiku 4.5 ã¬ãã¥ãŒã察å¿ã¢ãã«ã¯ã¢ãã«ã«ã¿ãã°ãã芧ãã ããã