S
santiago-pl
Guest
Hi, I’m Jakub, a solo founder based in Warsaw.
I’ve been building GoModel since December with a couple of contributors. It's an open-source AI gateway that sits between your app and model providers like OpenAI, Anthropic or others.
I built it for my startup to solve a few problems:
How is it different?
I'm posting now partly because of the recent LiteLLM supply-chain attack. Their team handled it impressively well, but some people are looking at alternatives anyway, and GoModel is one.
Website: https://gomodel.enterpilot.io
Any feedback is appreciated.
Comments URL: https://news.ycombinator.com/item?id=47849097
Points: 60
# Comments: 15
I’ve been building GoModel since December with a couple of contributors. It's an open-source AI gateway that sits between your app and model providers like OpenAI, Anthropic or others.
I built it for my startup to solve a few problems:
Code:
- track AI usage and cost per client or team
- switch models without changing app code
- debug request flows more easily
- reduce AI spendings with exact and semantic caching
Code:
- ~17MB docker image
- LiteLLM's image is more than 44x bigger ("docker.litellm.ai/berriai/litellm:latest" ~ 746 MB on amd64)
- request workflow is visible and easy to inspect
- config is environment-variable-first by defaultWebsite: https://gomodel.enterpilot.io
Any feedback is appreciated.
Comments URL: https://news.ycombinator.com/item?id=47849097
Points: 60
# Comments: 15