Skip to content

Add prompt caching and latest-model support to model latency benchmarking tool - #714

Open
evgenisokolov wants to merge 2 commits into
aws-samples:mainfrom
evgenisokolov:latency-benchmarking-prompt-caching
Open

evgenisokolov wants to merge 2 commits into
aws-samples:mainfrom
evgenisokolov:latency-benchmarking-prompt-caching

Commits

Commits on Jun 12, 2026