Skip to content

feat(providers): Support Google Gemini via Application Default Credentials (ADC) and Workload Identity #494

Description

@bytemare

SkillSpector supports hosted providers like OpenAI, Anthropic, Bedrock, and NVIDIA Build, but does not support Google Gemini out of the box.

Currently, Google's Gemini platform (or whatever the current naming is) is not supported without some cumbersome workarounds and static API keys outside IAM controls.

Proposed Solution:

Add a native SKILLSPECTOR_PROVIDER=gemini provider that:

  1. Authenticates using Google Cloud ADC (google-auth), supporting local development (gcloud auth application-default login) and GKE Workload Identity seamlessly
  2. Connects to Google Cloud's OpenAI-compatible Gemini endpoint (aiplatform.googleapis.com/v1/.../endpoints/openapi), reusing the existing chat-model plumbing
  3. Automatically applies the google/ wire prefix while keeping bare model names in registries and user config
  4. Correctly routes global, us, eu, and regional endpoints
  5. Fails closed with an actionable error when GOOGLE_CLOUD_PROJECT is missing (without silently falling back to OPENAI_API_KEY)
  6. Ships a bundled model_registry.yaml with current Gemini 3.x/2.5 token limits

(Note: PR #12 previously explored Vertex AI support, but has become stale and conflicting, uses their old naming, outdated models, and doesn't cover as many cases. I think that fresh implementation targeting Google's current v1 Gemini endpoint and modern conventions would resolve this cleanly.)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions