Sovereign stack responses

INSAIT BgGPT 3.0 (March 2026)

March 2026

Claim

INSAIT released BgGPT 3.0 in three sizes — 4 billion, 12 billion, and 27 billion parameters — built on Google’s Gemma 3 and further trained on more than 100 billion words of Bulgarian text. It can handle images as well as text, remembers up to about 131,000 tokens of context at once, was pre-trained on data through May 2025, and had its instruction tuning finished through October 2025. It comes in full precision, a compressed (GPTQ W4A16) version, and the GGUF format. The earlier BgGPT (2023) was based on Gemma 2 and used about 85 billion Bulgarian and 15 billion English words, trained with the “Branch-and-Merge” method that INSAIT researchers published at the EMNLP 2024 conference. INSAIT runs its own dedicated systems for projects with Bulgaria’s National Revenue Agency and National Audit Office.

Sources

Referenced in

← Back to the Evidence Base