May 28, 2025Published by Sean Kim on May 28, 2025Categories AI Tools & ServicesDatabricks DBRX: How 36B Active Parameters Beat 70B Dense Models — One Year LaterA 132B parameter model activates just 36B parameters at inference — and still outperforms models nearly twice its active size. That is not a theoretical claim. […]