Orai has just released a language model called Kimu.

Based on Gemma 2, they have created models with 2B and 9B parameters. They have successfully injected the knowledge required to speak and understand Basque into the base model.

I have converted both Kimu models to the GGUF format and published them on Hugging Face. This makes it possible to use the Kimu model with applications like Llama.cpp or Ollama.

Kimu models in the Hugging Face repository

At the same time, @urtzai has published these models in the Ollama model catalog, making them even easier to use via Ollama.

Just install Ollama, and by running the following command you can get it up and running:

ollama run itzune/kimu:2b

Kimu models in the Ollama catalog

An important step by Orai; we finally have a small and lightweight model that performs well in Basque.

An essential step to ensure Basque does not fall behind in the LLM application space!

First tests with the Kimu 2B model