Secure Your Keys, Track Your Costs: any-llm Managed Platform Enters Open Beta

Over the last few weeks, we’ve been running a small, gated alpha of any-llm managed platform: our client-side encrypted API key vault and usage tracking service for LLM providers.

The goal was simple: learn fast, fix the rough edges, and validate the core experience with real usage.

Sign up at any-llm.ai 👈

Why any-llm Managed Platform Matters

Built on top of any-llm library, a Python library that provides a single interface to various LLM providers, this platform allows you to centralize key management and automatically capture usage analytics for both cloud-based and local LLM providers.

Stop juggling multiple API keys in your codebase. Use any-llm as your centralized encrypted key vault. A single “virtual key” works across all providers, keeping your secrets secure and off your codebase. We also handle the usage tracking and cost management so you can focus on building.

Your API keys are encrypted client-side. They are never stored in raw text on our servers. We only track metadata (token counts, model names, timestamps, performance metrics), never your prompts or responses. In addition, we also track performance data, which includes time to first token, total duration, number of chunks, and so on. 

All inference happens on the client side, so the platform works with both cloud providers and local models like llamafile.

Moving to Open Beta

We’re now moving from alpha to beta, and we’re making the beta ungated and free. If you want to try it, you can. No waitlist.

Here’s what that means:

• It’s free. Just sign in using your email address or your GitHub and Google accounts to get started.
• It’s open. We’re ready to let more people sign up and try it out.
• It’s still beta. While the core encryption, key management, and usage tracking are production-ready, we’re actively refining dashboard UX, filtering options, onboarding flow, and the budgeting system. Expect some rough edges, but we’re fixing issues as they come up.

What We’re Looking for Now

Thank you to the early community who tried this and shared feedback. We want to keep that loop going. If you try it, we want to hear from you:

• Does the setup make sense?
• Are you getting the visibility you need into your LLM costs?
• What’s missing that would make this more useful for your team?

Submit your feedback here.

Get Started

Create your account at any-llm.ai

The core features are available in beta today. Encrypted key management, usage tracking, and cost analytics will remain free.

In the future, we plan to introduce paid tiers with advanced capabilities, but you’ll always have visibility into what’s changing. No surprise paywalls.

Stay in the loop. Sign up for product updates and get notified when new features are available.

This article first appeared on Read More