Skip to content

Python push parameters#198

Open
john (j13huang) wants to merge 3 commits into
mainfrom
python-push-parameters
Open

Python push parameters#198
john (j13huang) wants to merge 3 commits into
mainfrom
python-push-parameters

Conversation

@j13huang
Copy link
Copy Markdown

support pushing bt functions push for parameters in python files

I did bt functions push eval-config.py:

Details

import braintrust
from pydantic import BaseModel, Field

project = braintrust.projects.create(name="My Project")


class TemperatureParam(BaseModel):
    value: float = Field(default=0.2, description="Sampling temperature")


class SystemPromptParam(BaseModel):
    value: str = Field(
        default="You are a helpful assistant.",
        description="System prompt to use",
    )


project.parameters.create(
    name="Evaluation config-btpy2",
    slug="eval-config-btpy2",
    description="Configuration for model evaluation",
    schema={
        "model": {
            "type": "model",
            "default": "gpt-5-mini",
            "description": "Model to evaluate",
        },
        "temperature": TemperatureParam,
        "system_prompt": SystemPromptParam,
        "eval_prompt": {
            "type": "prompt",
            "description": "Prompt to use for the evaluation task",
            "default": {
                "prompt": {
                    "type": "chat",
                    "messages": [{"role": "user", "content": "{{input}}"}],
                },
                "options": {"model": "gpt-5-mini"},
            },
        },
    },
    metadata={"version": "1.0"},
)

@github-actions
Copy link
Copy Markdown

Latest downloadable build artifacts for this PR commit 1b40bc886ddd:

Available artifact names
  • ``artifacts-build-global
  • ``artifacts-build-local-x86_64-apple-darwin
  • ``artifacts-build-local-x86_64-pc-windows-msvc
  • ``artifacts-build-local-aarch64-pc-windows-msvc
  • ``artifacts-build-local-aarch64-apple-darwin
  • ``artifacts-build-local-x86_64-unknown-linux-musl
  • ``artifacts-build-local-x86_64-unknown-linux-gnu
  • ``artifacts-build-local-aarch64-unknown-linux-gnu
  • ``artifacts-plan-dist-manifest
  • ``cargo-dist-cache

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant