You’ve probably run our code. Come write it.
You’d build the open source AI gateway: one API for 140+ model providers, with cost tracking and access control, running in production at NVIDIA, Netflix and NASA. Small team, in person in San Francisco.
- GitHub stars
- 62K
- Contributors
- 1,900+
- Downloads a month
- 90M+
- Model providers
- 140+
The more AI gets built, the more it needs a gateway
Every model provider has its own API, pricing and failure modes. Every new model, agent and team adds more glue code to maintain.
LiteLLM is that glue, built once: one OpenAI compatible API for 140+ providers, with routing, fallbacks and spend tracking, running inside the company’s own infrastructure. Whichever model wins, companies need this layer.
from litellm import completion
completion(model="openai/gpt-4o", messages=messages)
Same call, any provider
Your work ships in public
The SDK and proxy are open source. Your pull request is reviewed in public and ships to 90M+ downloads a month.
The work: one spec for 140+ provider APIs, spend tracking down to the token, and a core moving to Rust.
Bugs come straight from teams running it in production, on GitHub, Discord and Slack.
0 commits to LiteLLM in the last year
Who runs it in production
Open roles
- Engineering
- AI EngineerSan Francisco · Onsite$200K to $250K
- Senior Security EngineerRemote$220K to $260K
- Senior Security Engineer, Product & PlatformSan Francisco · Onsite$220K to $280K
- Senior Security Operations / Detection EngineerSan Francisco · Onsite$220K to $280K
- Senior Support Engineer, EMEA and APACIndia · Remote$120K to $170K
- Staff Engineer, AISan Francisco · Onsite$250K to $350K
- Staff Engineer, Systems and ReliabilitySan Francisco · Onsite$250K to $350K
- Product
- Forward Deployed EngineerUnited States$150K to $250K
- Forward Deployed Engineer (New Grad)United States$150K to $210K
- Founding Developer RelationsSan Francisco · Onsite$150K to $220K
- Product EngineerSan Francisco · Onsite$200K to $260K
- Technical Account ManagerUnited States$150K to $220K
- Sales
- Account ExecutiveSan Francisco · Onsite$150K to $180K
Pay shown is base salary. Most roles include equity.
How we work
- KrrishCEO
- IshaanCTO
OliverSecurity- NateRust
- YujongRust
- RyanProvider layer
- KerryCost tracking
- MateoProvider layer
- SameerLLM translation
- AlexsanderPerformance
- YunengCI and releases
YuchengBackend- YassinSecurity
- MoeAI products
- TinAI products
- ShivamSupport
- JoshuaCost tracking
- MisbahDeveloper relations
- VaroonGo to market
Ownership
No PMs yet. You own an area, like cost tracking or the provider layer.
Small teams
One or two people per problem. You pick the approach.
Users
When someone opens an issue, we fix it, then ask them for a call.
Shipping
Small changes just ship. Bigger ones get a short design doc.
Office
333 Broadway, San Francisco. Krrish and Ishaan sit with the team.
Fridays
All hands starts with what shipped that week.
Pay
Base salary on every role. Most include equity.
Pace
Fast. Weekends aren’t expected.
Contributors
Already contributing? Link your merged pull requests when you apply.
Backed by Kleiner Perkins, Y Combinator, Shay Banon (Elastic) and Calvin French-Owen (Segment).
From the blog
Release cadence changes and an LTS version pilot
Introducing the unified cost accounting engine
Rust migration: /v1/messages end to end in Rust by Dec 1
October town hall: 426 bug fixes, 88.4% coverage and the Decisions API