Skip to content

add gemini ALM support#106

Merged
tara-servicenow merged 5 commits intomainfrom
pr/gemini_services
May 2, 2026
Merged

add gemini ALM support#106
tara-servicenow merged 5 commits intomainfrom
pr/gemini_services

Conversation

@raghavm243512
Copy link
Copy Markdown
Collaborator

Gemini TTS service updated to match new pipecat expectation
2nd service for ALM refactored with parent ALM class
Small bug in run_text_only fixed

Run gemini ALM with:

EVA_MODEL__AUDIO_LLM=gemini
EVA_MODEL__AUDIO_LLM_PARAMS='{"api_key": "NOT NEEDED but here for pydantic validation", "project":"project_name","location":"global","model":"gemini-3-flash-preview"}'
GOOGLE_APPLICATION_CREDENTIALS=path

Comment thread src/eva/assistant/pipeline/services.py Outdated
Comment thread src/eva/assistant/pipeline/services.py Outdated
Comment on lines +609 to +610
temperature=params.get("temperature", 0.0),
max_tokens=params.get("max_tokens", 1024),
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is there a reason we are setting these defaults?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

they strongly recommend leaving the default of 1.0 for gemini 3 models

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

shouldn't we also allow reasoning effort to be set?

Copy link
Copy Markdown
Collaborator Author

@raghavm243512 raghavm243512 Apr 30, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added reasoning effort, I have defaults just because the other alm also has them

@tara-servicenow tara-servicenow added this pull request to the merge queue May 2, 2026
Merged via the queue into main with commit cf6b006 May 2, 2026
1 check passed
@tara-servicenow tara-servicenow deleted the pr/gemini_services branch May 2, 2026 21:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants