Heads up: we're (probably) not publishing a new release for Opus 5. Because Pi now has dynamic model catalogs. If you run "pi update --models" Opus 5 should show up for you automatically. Or you wait until the cache expires :)
This week our team tuned in to @syntaxfm where @SlexAxton and @amadeus talked about how they’re using Pi Auto Research🎧
We also learn about the challenges they’ve faced building @pierrecomputer.
If you’re looking for a Friday listen, we recommend! syntax.fm/show/1008
People of pi: lots of good things landed in 0.82.0. When Pi shells out to bash, commands can now see which model and provider was loaded. Constrained sampling landed for supported providers and models and plenty of fixes.
Prompt caching affects latency, cost, tool design and product feature decisions.
New blog post from @mitsuhiko on what prompt caching is and how we’ve implemented it in Pi.
Read the full post below
We've recently made Pi's cache behavior more visible. This site has been debating whether agent harnesses are helping or quietly torching their caches. That seemed like a good excuse to explain how KV caches actually work and how Pi helps (or doesn't). earendil.com/posts/prompt-c…
