What langwatch/langwatch shipped
Generated by FoxPlug from public activity — not affiliated with Langwatch.
Week of September 14, 2026
What shipped
- Instant Eval runs execute a LangWatchQL statement as a judgment job with progress tracking and persisted results, enabling bulk evaluation workflows beyond the exploratory inline query cap. Pull request #8208
- The Instant Eval CLI waits for answers, accepts target shorthand syntax, and estimates spend before running, making evaluation accessible without writing LangWatchQL by hand. Pull request #8216
- Instant Eval judgments meter on the gateway spend spine as Stripe charges with a 1 USD free budget, moving billing onto the standard cost tracking system. Pull request #8220
- LangWatchQL gains eval functions that call the classifier interface, letting judgment calls sit inline in analytics queries alongside metrics and dimensions. Pull request #8201
- Any LangWatch API key now has one query door into LangWatchQL via POST /api/v1/query, running read-only SELECT statements across all projects the key can read with ClickHouse row policies enforcing scope. Pull request #8113
- Custom dashboard charts now run in their own sandboxed frame on a separate route, allowing widgets to import any module under the production Content-Security-Policy. Pull request #8151
- Sign-in now offers one-click social authentication through Google, GitHub, and Microsoft buttons alongside Auth0, removing the double-SSO-click from production. Pull request #8143
- Trace reading logic (conversation threading, LLM span splitting, digest generation) moved from React components into reusable extraction modules for use across the platform. Pull request #8194
- Ingestion pull outcome writes now carry typed dispatches instead of casts, improving bookkeeping accuracy for customer assignment and timestamps. Pull request #8111
- Cost rollup checks moved from a nightly cron to an event-driven per-tenant process that triggers only when cost changes land, replacing batch checking with reactive updates. Pull request #8121
Why it matters
Instant Evals shipped as a complete feature this week: runs, CLI, judgment functions, billing, and metrics. LangWatchQL now has a unified query door that any API key can use. These changes let users evaluate bulk text through the platform and access analytics programmatically without building custom integration.
Changelog entry
- feat(instant-evals): the Instant Eval run, a judgment job over an LWQL statement with progress and persisted judgments Pull request #8208
- feat(instant-evals): the CLI that waits for the answer, the target shorthand and estimate before spend Pull request #8216
- feat(instant-evals): meter judgements on the gateway spend spine, a Stripe meter and a 1 USD free budget Pull request #8220
- feat(lwql): eval functions judged by the classifier interface (Instant Evals) Pull request #8201
- feat(query): self-describing LangWatchQL door + whoami --json Pull request #8113
- feat(analytics): serve chart sandbox frame on its own route so widgets can import any module Pull request #8151
- feat(identity): one-click social sign-in — the Auth0 connection bridge, native-provider groundwork, and AUTH_PROVIDER Pull request #8143
- refactor(traces): framework-free conversation, chat split, LLM span and bounded digest modules Pull request #8194
- feat(governance): replace the cost-rollup comparator cron with an event-driven per-tenant costRollupWatch process manager Pull request #8121
- fix(instant-evals): review sweep over the ten Instant Evals PRs Pull request #8230
- fix(instant-evals): end-to-end dogfood on main, five fixes in how numbers and words reach the caller Pull request #8233
- fix(clickhouse): renumber the coding-agent usage migration to 00099, 00097 was taken Pull request #8235
Instant Evals are live: run bulk judgments through LangWatchQL, use the CLI without writing queries, and only pay for what you evaluate. One query door for any API key. Dashboard charts now run in sandboxed frames.
Instant Evals shipped this week with three layers: LangWatchQL now has eval() functions for inline judgments, runs execute bulk evaluation jobs with progress tracking, and the CLI makes it accessible without SQL. Billing integrates with Stripe on the standard cost spine. Separately, any LangWatch API key now has one query door into LangWatchQL—POST /api/v1/query runs read-only SELECT across all readable projects. Custom dashboard charts moved to sandboxed frames. Sign-in gained one-click social auth.