AMA about K2 Horizon, Meet our team from IFM
Hi r/LocalLLaMA
We’re researchers at the Institute of Foundation Models (IFM), an AI research lab dedicated to open and independent development of frontier-class foundation models.
We recently released K2 Horizon a connected fleet of six fully open models with size ranging from 0.9B to 375B. In addition to weights, we also open-sourced training data and recipes, training code, intermediate checkpoints, fine-grained training logs and evals.
Ask us anything about pre-training and data mixes, post-training, small models on-device, MoVA and sparse attention, deployment, what’s out now, and what’s coming next.
Participating in the AMA:
- Hector Liu u/hunterhector
- Alexander Moreno u/IFMAlex
- Mikhail Yurochkin u/my-moonfolk
- Rupesh Srivastava u/k2pt
- Junlin Chen u/Junlin_Chen110
- Haonan Li u/East-Career9147
We'll be live Mon, Oct 5, 8–10 PM PT. Questions are open now, so drop yours anytime!
- ⬇️ Download: https://huggingface.co/collections/IFM/k2-horizon
- 💻 Code: https://github.com/ifm-ai
- 📊 Training logs: https://wandb.ai/llm360
- 📝 Blog: https://ifm.ai/blog/k2/
Join IFM on Discord: https://ifm.ai/discord
https://preview.redd.it/awu0r6fbowsh1.png?width=3240&format=png&auto=…