AIssert: Testing LLM Integrations
Since LLMs exploded into public awareness, we have witnessed their integration into a vast array of applications, from customer support chatbots to tools that can…
Read MoreAIssert: Testing LLM Integrations
Introducing Any-Agent: An abstraction layer between your code and the many agentic frameworks
Ever since ChatGPT burst onto the scene in 2022, generative AI and Large Language Models (LLMs) have become a part of the cultural moment. The…
Evaluating Local LLMs on Translation Use Case with Lumigator
LLMs have revolutionized natural language processing, transforming a wide array of applications from intelligent chatbots to advanced text summarization. However, concerns about privacy, data security,…
📘+🐊 Blueprint Releases & Lumigator’s Latest Features
Hello Developers & AI Enthusiasts, Welcome to the first Mozilla.ai Update. We’re thrilled to share the latest developments with you, including updates on our Blueprints…
Open-source AI is hard. Blueprints can help!
“I spend 8 hours per week trying to keep up to date, it’s overwhelming!” “Integrating new libraries is difficult. They’re either poorly maintained or updated…
Build Your Own Timeline Algorithm: A Blueprint
Timeline algorithms should be useful for people, not for companies. Their quality should not be evaluated in terms of how much time people spend on…
Benchmarking DeepSeek R1 Models using Lumigator: A Practical Evaluation for Zero-Shot Clinical Summarization
Interested in listening to this as a presentation instead? See here. Interested in seeing a walkthrough of exactly how we did this with Lumigator? See…
Evaluating DeepSeek V3 with Lumigator
We previously saw how to deploy DeepSeek V3 on a Kubernetes cluster using Ray and vLLM. The outcome of this step is a scalable API…
Map Features in OpenStreetMap with Computer Vision
Motivation At Mozilla.ai, we believe that there are a lot of opportunities where artificial intelligence (AI) can empower communities driven by open collaboration. These opportunities…
Deploying DeepSeek V3 on Kubernetes
In our previous story, we explored the evolving landscape of Large Language Models (LLMs) and how releases like Meta’s Llama reshaped the AI landscape, offering…
Running an open-source LLM in 2025
The landscape of Large Language Models (LLMs) has evolved dramatically since ChatGPT burst onto the scene in late 2022. Soon to follow, the release of…
PPL Bench: Creating a standard for benchmarking probabilistic programming languages
PPL Bench is an open source benchmark framework for evaluating probabilistic programming languages (PPLs) used for statistical modeling. Researchers can use PPL Bench to build…