PLaMo 3 Support Merged into llama.cpp
Analysis
Key Takeaways
- •PLaMo 3 model support has been added to llama.cpp.
- •PLaMo 3 is a 31B parameter model trained on English and Japanese.
- •The model uses a hybrid architecture with SWA and traditional attention.
“PLaMo 3 NICT 31B Base is a 31B model pre-trained on English and Japanese datasets, developed by Preferred Networks, Inc. collaborative with National Institute of Information and Communications Technology, NICT.”