Conversation
Gondola is an OpenAI-compatible gateway that resells Venice AI inference at below-list prices, metered per request and settled in USDC on Base. Same model ids as the existing venice provider, since Venice is the supply. 30 models: frontier (Claude Opus 5 / Fable 5, GPT-5.6 Terra, Gemini 3.7 Flash, Grok 4.6), coding (Kimi K3, DeepSeek V4 Pro/Flash), cheap workhorses and an uncensored line. Prices, context windows and served completion caps are generated from the public catalog at https://api.gondola-ai.com/v1/models (no auth needed). Defaults are kimi-k3 large and deepseek-v4-flash small.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds Gondola as a provider.
Gondola is an OpenAI-compatible gateway that resells Venice AI inference below list price, metered per request and settled in USDC on Base. No subscription, no minimum. Venice is the supply, so the model ids are identical to the existing
veniceprovider and Crush users can switch between the two without touching model names.What is in here
internal/providers/configs/gondola.json, 30 models//go:embed+ accessor +providerRegistryentry ininternal/providers/providers.go(alphabetical section)InferenceProviderGondolain the const block andKnownProviders(), following provider: add atlas cloud聽#463Defaults are
kimi-k3(large) anddeepseek-v4-flash(small).Coverage is frontier (Claude Opus 5, Claude Fable 5, GPT-5.6 Terra, Gemini 3.7 Flash, Grok 4.6), coding (Kimi K3, DeepSeek V4 Pro and Flash), cheap workhorses, and an uncensored line.
Where the numbers come from
Everything is generated from the public catalog at
https://api.gondola-ai.com/v1/models, which needs no auth if you want to check it:Two things worth flagging because they are easy to get wrong:
default_max_tokensis the completion cap Gondola actually serves, not the base model's headline cap. Advertising a ceiling the gateway will not serve breaks harness compaction, so these are the real numbers.anthropic.json, whereclaude-opus-5isin: 5,in_cached: 6.25,out_cached: 0.5. Socost_per_1m_in_cachedis the cache write price andcost_per_1m_out_cachedis the cache read price. They are populated only where Venice prices that tier, and left at 0 otherwise.Auto-refresh
Gondola is a marketplace, so prices move with supply rather than being fixed by a vendor. I would rather this not go stale in your repo.
I am happy to follow the #463 shape and add
cmd/gondola/main.goplus theTaskfile.yamltask and theupdate.ymlstep, so the config regenerates every 6 hours like the other providers. I left it out of this PR to keep the first one reviewable. Say the word and I will push it here.