AI tools
AI Gateway
Self-hosted, multi-provider LLM gateway.
A lightweight Go gateway that sits between your apps and any LLM provider. Each client gets its own API key with independent backend, model whitelist, rate limits and quotas — all OpenAI-compatible.
Background
Routing different teams or scripts at different LLM providers (and policing costs along the way) usually means juggling reverse proxies and bespoke quota services. AI Gateway collapses that into a single binary with a real-time WebSocket dashboard, per-client provider routing, and translation between native APIs (Gemini, Anthropic, Mistral, xAI, Cohere, Azure, Ollama, LM Studio) and the OpenAI Chat Completions schema your apps already speak.
Specifications
- Per-client backend, key, default model and model whitelist
- 10 native providers — anything else via generic OpenAI-compatible mode
- Streaming over SSE for every backend
- Token quotas, rate limits, real-time WebSocket dashboard
- First-launch admin bootstrap, SQLite-backed config
More from AI tools
-
sandkastenFast, kernel-enforced application sandbox for macOS and Linux
Fast, kernel-enforced application sandbox for macOS and Linux. Default-deny TOML profiles, Seatbelt + Landlock + seccomp + namespaces under the hood. Pasta/slirp4netns auto-plumbed network with per-IP nftables.
-
github magicianScheduled GitHub triage + maintenance automation driven by Claude Code — issue triage, backlog sweeps, conservative fix PRs, dependency updates, security scans with private disclosure, and release/artifact cleanup
Scheduled GitHub triage + maintenance automation driven by Claude Code — issue triage, backlog sweeps, conservative fix PRs, dependency updates, security scans with private disclosure, and release/artifact cleanup.
-
shannonZero-instrumentation L7 observability for Linux via eBPF
Zero-instrumentation L7 observability for Linux via eBPF. See plaintext HTTP/HTTPS, gRPC, Postgres, MySQL, MongoDB, Redis, Kafka, Cassandra from any process — including through TLS — without keys, sidecars, or code changes. Pure Rust (aya), kernel 5.8+.
-
smartmailA local/remote LLM powered smart E-Mail manager/sorter and smart Spam Filter
A local/remote LLM powered smart E-Mail manager/sorter and smart Spam Filter.
-
DSPLabAn AI-assisted lab for audio DSP.
A development environment and diagnostic laboratory for DSP engineering — Vult source on the left, an isolated AudioWorklet engine on the right, and an autonomous AI agent that can compile, probe, sweep and verify your DSP without leaving the browser.
-
Meeting AssistantPrivacy-first meeting transcription & analysis.
A C++17 tool that turns spoken meetings into structured, actionable knowledge — local Whisper transcription that never leaves your disk, deep AI analysis with role-specific personas, Obsidian + GitHub/GitLab integration and corporate-grade HTML reports with mind maps.