Stack: Next.js 16, Supabase, Vercel, Paddle
The problem: I kept getting surprise OpenAI bills with no idea which prompt caused it.
The solution: A lightweight proxy that intercepts every LLM API request, logs cost/latency/tokens to Supabase, and sends email alerts when you hit 80% of your budget.
Technical challenges:
- Next.js route handler as a proxy (streaming support coming)
- Multi-provider detection from model name
- Per-project request counting for free tier limits
baseURL: "https://llmwatch-rho.vercel.app/api/proxy"
Would love technical feedback!
TopEar3305 introduces LLMWatch, a proxy tool built with Next.js and Supabase to track costs associated with LLM API requests. The tool logs cost, latency, and tokens to Supabase and sends alerts when 80% of the budget is reached. The user seeks technical feedback on the implementation, which includes features like multi-provider detection and per-project request counting.
Thanks! 馃槃
If you're building with LLM APIs, feel free to give it a spin. It takes about a minute to set up, and I'd love to hear any feedback.