What future-agi/future-agi shipped
Written by FoxPlug from the repository's own releases; not affiliated with Futureagi. Paste your own repository in the box below and FoxPlug writes the same weekly update for your product. This page is an automatic summary of the releases, pull requests and commits in github.com/future-agi/future-agi; Futureagi did not write it and does not use or endorse FoxPlug. Every line links to the change it describes.
Get a weekly update like this for your product, free
Week of November 2, 2026
What shipped
- Resuming an interrupted run now reruns only the calls that did not finish, on the same run ID and versions. Pull request #3738
- Fix my agent takes a failed simulation run, proposes a change in a sandbox, tests it as a new agent version through check runs, and opens a pull request for GitHub agents. Pull request #3685
- A fix can now be given cases that must still pass, stored as protected scenario keys and passed to the engine. Pull request #3686
- Safe host updates with a read-only status view were added as a first phase. Pull request #3623
- A run in a task's Usage tab now has an Open trace button that opens the same trace drawer as Tracing. Pull request #3678
- A continuous eval task that fails now posts a Slack alert to the critical channel explaining why it failed. Pull request #3688
- Search requests are now priced per query at the price table's per-query rate, and unpriced requests are flagged. Pull request #3694
- Model listing now hides global models from keys that cannot call them, instead of showing models that return 403. Pull request #3695
- Every backend release now flows into the SDK repository automatically. Pull request #3628
- The shared REST API now rejects malformed row and cell fields, duplicate cells and unknown fields, so dataset rows are not saved blank silently. Pull request #3638
Why it matters
This week added the last parts of the fix my agent flow: a fix that protects cases which must still pass, and resuming an interrupted run without repeating calls that already finished. Gateway fixes made search pricing honest and stopped keys from listing models they cannot call, and dataset writes now reject malformed rows instead of saving blanks. Two releases, 1.57.0 and 1.58.0, went out during the week.
Changelog entry
- Simulate: resume an interrupted run without repeating finished calls Pull request #3738
- Simulate: prove a fix for a failing run and open its pull request Pull request #3685
- Simulate: let a fix protect cases that must still pass Pull request #3686
- Simulate: move actors into their own tab Pull request #3743
- Update: add safe host updates and read-only status Pull request #3623
- Tasks: open a run's trace in a drawer from Task Usage Pull request #3678
- Eval-tasks: Slack alert when a continuous eval task fails or stalls Pull request #3688
- Gateway: price search requests per query and flag unpriced ones Pull request #3694
- Gateway: hide global models from keys that cannot call them Pull request #3695
- Ci: sync every backend release into the SDK Pull request #3628
- Datasets: prevent silent blank rows from malformed row and cell fields Pull request #3638
- Release: v1.58.0 Release
This week: resume an interrupted run without repeating finished calls, a fix that protects cases which must still pass, search priced per query, keys no longer listing models they cannot call, and dataset rows that can no longer save blank. v1.57.0 and v1.58.0 shipped.
This week's work on the project focused on the fix my agent flow and on the gateway. An interrupted run can now be resumed without repeating calls that already finished, on the same run ID and versions. A fix can be given cases that must still pass, and a fix for a failing run can end with a tested new agent version and a pull request for GitHub agents. On the gateway, search requests are priced per query, model listing hides global models from keys that cannot call them, and pricing covers models the existing catalogue missed. Elsewhere, dataset writes reject malformed rows instead of saving blank cells, continuous eval task failures post a Slack alert, and every backend release now flows into the SDK. Releases 1.57.0 and 1.58.0 went out.
Week of October 12, 2026
What shipped
- Error Feed grouping no longer fails on projects with many indexed findings, and new findings become Feed cards again. Pull request #3503
- SAML login now isolates tenants and tightens session boundaries, with new end-to-end login tests. Pull request #3286
- Version 1.51.0 shipped with database migrations and the error-feed grouping work. Release
- In-app tools now use the generated MCP catalog instead of the hand-written proxies, so chat and external clients share the same tool contracts. Pull request #2787
- The run calls API now reports whether scoring is pending, succeeded, failed, timed out or skipped, and stuck scoring is timed out. Pull request #3380
- Hosted LiveKit agents can now be connected to environments under the hosted platform option. Pull request #3402
- Experiment reads through the generated catalog now enforce workspace scope. Pull request #3463
- Main was merged back into dev after the grouping hotfix. Pull request #3519
- Dev was promoted to main for the 1.49.0 release. Pull request #3431
- The public OAuth token endpoint now throttles by IP, client and grant, and locks out repeated invalid attempts. Pull request #1281
Why it matters
This week fixed error-feed grouping on large projects and closed a tenant isolation gap in SAML login, both of which affected real usage. Releases 1.50.0 and 1.51.0 went out with database migrations, and the dev-to-main syncs kept the hotfix history intact.
Changelog entry
- Error feed grouping retrieval fixed for projects with over about 540 indexed findings. Pull request #3503
- SAML tenant isolation and session boundary fixes, with new end-to-end tests. Pull request #3286
- Release 1.51.0 with database migrations. Release
- Release 1.50.0 with additive database migrations. Release
- In-app tools now use the generated MCP catalog; native-only tools stay. Pull request #2787
- Run calls API exposes scoring status and times out scoring stuck in evaluating. Pull request #3380
- Connect already-deployed LiveKit agents under the hosted platform option. Pull request #3402
- Experiment reads enforce workspace scope in generated catalog paths. Pull request #3463
- OAuth token endpoint throttled by IP, client and grant, with invalid-attempt lockout. Pull request #1281
- Each agent gets a hidden simulation project, excluded from listings and APIs. Pull request #3525
- Saved views with preset dates load fresh dates when reopened. Pull request #3516
- Main merged back into dev after the grouping hotfix. Pull request #3519
This week: error-feed grouping works again on large projects, SAML login is tenant-isolated, and 1.51.0 shipped with migrations. In-app tools now share the generated catalog contracts.
This week the error feed started grouping findings again on projects with many indexed entries, so new findings become Feed cards instead of failing before they are claimed. SAML login gained tenant isolation and tighter session boundaries with new end-to-end tests. Version 1.51.0 shipped with database migrations, and main was merged back into dev after the grouping hotfix. In-app tools now consume the generated MCP catalog, so chat and external clients share the same tool contracts, and the run calls API reports scoring status per call and eval.
Week of October 5, 2026
What shipped
- Release v1.48.0 landed with four tracer migrations for Error Feed grouping, three adding columns and one moving data, applied with manage.py migrate when rolling out the backend image. Release
- The environments API gained two routes so a finished run's evals can be re-graded or a single eval edited without going through the legacy run-test routes. Pull request #3369
- On a finished environment run, evals added afterwards now appear as columns, and any eval can be graded again over the existing calls, with an All Evaluations drawer to run one or all evals and remove one. Pull request #3185
- Failed grouping work now recovers: failures are classified, transient ones retried with bounded backoff, exhausted or permanent ones parked, and dead attempts reconciled during claim polling. Pull request #3378
- Error Feed trace investigations that failed were retried instead of ending as final, the failure reason now reaches the report, and the evidence read is bounded. Pull request #3386
- Group IDs are preserved through merges, retired source IDs redirect to the survivor, splits retire the original group and redirect its old URL to the largest child, and a project-scoped redirect endpoint serves old issue URLs. Pull request #3383
- The Error Feed investigator now reads a compact conversation evidence record instead of every copy of the provider call payload, so long calls fit inside the model-call budget. Pull request #3391
- An investigation finding can now reach the Feed without a failed requirement and without the failure outcome, so an agent that meets every requirement can still surface a failure. Pull request #3409
- The gateway now rejects org configs its per-org contract cannot accept, instead of saving successfully, failing the push silently, and returning 400 for every org on the bulk endpoint. Pull request #3408
- The
run_new_evals_on_simulationtool was repaired by pointing two imports at the model modules that hold those models today, with a test that imports the tool and runs its main path. Pull request #3411
Why it matters
This week the Error Feed stopped losing work: failed investigations and grouping jobs are retried, retired issue URLs redirect, and findings can reach the Feed without a failed requirement. Release v1.48.0 carries the database migrations behind those grouping changes, so the backend image needs manage.py migrate during rollout. The environments API also picked up re-grade and eval-edit routes so finished runs can be acted on without the legacy routes.
Changelog entry
- Release v1.48.0 adds four tracer migrations for Error Feed grouping; apply them with manage.py migrate when rolling out the backend image. Release
- The environments API can re-grade chosen evals on a finished run and edit one eval. Pull request #3369
- Evals added after a finished environment run show as columns, and evals can be graded again over the existing calls. Pull request #3185
- Failed grouping work is classified, retried with bounded backoff, parked when exhausted, and dead leases are reconciled during claim polling. Pull request #3378
- Failed Error Feed trace investigations are retried, the failure reason reaches the report, and the evidence read is bounded. Pull request #3386
- Issue group IDs are preserved through merges and splits, and old issue URLs redirect. Pull request #3383
- The investigator reads a compact conversation evidence record rather than every copy of the provider call payload. Pull request #3391
- The provider log's warnings and errors are passed to the investigator. Pull request #3393
- A finding can reach the Feed without a failed requirement. Pull request #3409
- The gateway rejects org configs it cannot accept instead of saving them and failing the push silently. Pull request #3408
- The
run_new_evals_on_simulationtool imports the current model modules. Pull request #3411 - The README leads with the signup decision. Pull request #2984
V1.48.0 ships four tracer migrations for Error Feed grouping. Failed investigations and grouping jobs now retry with bounded backoff instead of ending as final. The environments API can re-grade evals on a finished run and edit one eval, and added evals show as columns.
This week's work centers on the Error Feed. Failed trace investigations and grouping jobs are no longer final: transient failures retry with bounded backoff, exhausted or permanent ones are parked, dead leases are reconciled during claim polling, and the failure reason now reaches the report. Group IDs survive merges, retired issue URLs redirect to the survivor or the largest split child, and a finding can reach the Feed without a failed requirement. Release v1.48.0 carries four tracer migrations for grouping, three adding columns and one moving data, applied with manage.py migrate when rolling out the backend image. The environments API also gained routes to re-grade evals on a finished run and edit a single eval, and evals added after a run now appear as columns.
Week of September 28, 2026
What shipped
- V1.46.0 shipped with run analytics prioritization, improved Runs tab badging from full environment count, and aggregated run summary queries. Release
- Run Analytics now separates evaluated agent quality from execution health and reports target-agent metrics without substituting simulator spend. Pull request #3121
- Call detail lookup resolved run jobs once instead of repeating six subqueries per call, reducing page load from 1.6–3.3s. Pull request #3258
- HARNESS_MAX_EXECUTIONS_PER_RUN is now configurable per environment instead of a deployment-wide fallback of 200. Pull request #3239
- Hosted artifact budget is now configurable via HARNESS_MAX_ARTIFACT_BYTES environment variable instead of hardcoded 1 GiB. Pull request #3240
- Simulation call lists now expose stop latency and interruption counts so users can compare calls without opening details. Pull request #3246
- Fixed suite provisioning when rows remain indexed for dropped scenarios during large hosted suite authoring. Pull request #3217
- PeerDB source contract now accepts Postgres smallint, restoring e2e stack boot after v1.42.0 breakage. Pull request #3201
Why it matters
This week shipped improvements to simulation analytics and performance alongside environment configuration flexibility. Several production hotfixes restored e2e testing and the Observe calls list after recent deployments, ensuring the project remains stable for users running large scenario suites.
Changelog entry
- V1.46.0: prioritize run analytics decisions, badge Runs tab from environment's full run count, aggregate run summary over nested subquery Release
- Run Analytics separates evaluated agent quality from execution health, applies configured evaluation verdicts consistently, reports target-agent metrics without substituting simulator spend Pull request #3121
- Resolve run jobs once for v3 calls scenario lookup, reducing call detail page load from 1.6–3.3s by eliminating repeated subqueries Pull request #3258
- Read HARNESS_MAX_EXECUTIONS_PER_RUN from environment settings instead of hardcoded deployment default Pull request #3239
- Configure hosted artifact budget via HARNESS_MAX_ARTIFACT_BYTES environment variable (bytes; default 1 GiB) Pull request #3240
- Add interruption metrics to simulation call lists: expose stop latency in milliseconds and interruption counts with group averages Pull request #3246
- Fix suite provisioning when rows indexed for dropped scenarios remain during hosted suite authoring Pull request #3217
- Accept Postgres smallint in PeerDB source contract for TestExecution.trials field Pull request #3201
- Install libgomp1 in serving runtime stage for arm64 torchaudio compatibility Pull request #3211
- Preserve.pyi stub files in serving image to resolve librosa import errors Pull request #3208
V1.46.0: analytics prioritization, smarter run queries, and environment-level configuration for execution limits and artifact budgets.
This week's v1.46.0 adds run analytics that separate agent quality from execution health, cuts call detail load time by optimizing run job lookups, and makes execution limits and artifact budgets configurable per environment. We also restored e2e testing and fixed production call lists after recent changes.
Week of September 21, 2026
What shipped
- Fixed self-hosted installs sending organization API keys to futureagi.com by correcting BASE_URL defaults. Pull request #3093
- Removed anonymous write, delete and list permissions on the bundled MinIO bucket, leaving only read access for browsers. Pull request #3094
- Tightened input validation in model hub evaluation usage sorting and choice statistics queries. Pull request #3099
- My Environments list now polls while a row is building or running instead of requiring a page reload. Pull request #3084
- Added ability to stop a live run from the runs table and run detail header in v3 Environments. Pull request #3049
- Restored Observe credentials passed into hosted sandbox on feat/environment-v3 branch. Pull request #3088
- Pinned a frozen MinIO build for self-hosted installs after Docker Hub deleted minio/minio images. Pull request #3056
- Made code executor's local fallback explicit by only falling back when the service is unreachable, not on any error. Pull request #3069
- Fixed backend CI failing on fork PRs by skipping telemetry schema contract when private EE code is absent. Pull request #3054
- Released v1.41.1 with frontend and OSS fixes. Release
Why it matters
Security fixes prevent leaking API keys from self-hosted installs and remove unintended anonymous bucket access. Environment polling and stop functionality improve the v3 Environments experience. Fixes to CI and build reproducibility help contributors and self-hosters.
Changelog entry
- Security: stop self-hosted installs sending the org API key to futureagi.com Pull request #3093
- Security: stop granting anonymous write, delete and list on the MinIO bucket Pull request #3094
- Fix(model-hub): validate the eval usage sort column and bind choice-stats choices Pull request #3099
- Fix(simulate): pass Observe credentials into the hosted sandbox again Pull request #3088
- Fix(evals): make the code executor's local fallback explicit Pull request #3069
- Fix(simulate): show a built environment as Ready, never Completed Pull request #3087
- Fix(simulate): keep column lines on the run table's last row Pull request #3086
- Fix(simulate): honour the sandbox provider's egress limit when starting a chat runtime Pull request #3085
- Feat(simulate): poll the My Environments list while a row is building or running Pull request #3084
- Fix(frontend): retire the prototype routes and repoint get-started links Pull request #3078
- Fix(simulate): explain why Build environment is disabled Pull request #3076
- Fix(oss): explain failed pre-flight checks and keep the launch moving Pull request #3068
- Feat(simulate): prev/next in the chat drawer; fix the crash on hosted chat transcripts Pull request #3071
- Feat(simulate): prev/next in the run call drawer, following the grouped rows Pull request #3066
- Fix(simulate): remove em dashes and label run analytics by modality Pull request #3070
- Fix(simulate): hide the eval cost chip in the evaluations UI Pull request #3073
- Feat(error-feed): include source names in worker claims Pull request #3043
- Fix(simulate): scenario editors follow the editing contract, with served choices and labels Pull request #3046
- Fix(simulate): show Finalizing and Cancelling states and gate Run on completed Pull request #3062
- Fix(simulate): show a stopped run as Cancelling until the backend confirms it Pull request #3060
V1.41.1 ships security fixes for self-hosted installs and improves v3 Environments with live run control and auto-polling.
V1.41.1 is out. We fixed critical security issues in self-hosted installs—API keys no longer leak to cloud, and anonymous MinIO access is removed. v3 Environments now let you stop live runs from the UI and the list auto-polls during builds. Better contributor experience with improved CI.
Week of September 14, 2026
What shipped
- V1.38.4 released with fixes for eval-tasks: gating errored/skipped requeue on terminal watermark, sniffing URL type across chunks, and stopping continuous tasks from re-running converged failures on every poll. Release
- Fixed continuous eval tasks re-running converged failures on every poll, which was causing ~700 GB/day of S3 egress in production. Pull request #2846
- Renamed the 'RL Environment' label to 'Environment' in the harness feature under Simulate. Pull request #2863
- V1.38.3 hotfix released with batching of changed span identities below query size limit and fixes for dense continuous and sparse historical selection. Release
- V1.38.2 released with fixes to apply Dataset and Eval Source filters to eval metric charts. Release
- Fixed system eval binding config to preserve dataset-bound evaluation configuration when reopening and saving existing evaluations. Pull request #2621
- Promoted dev to main for v1.38.4 release with 16 commits including eval alert threshold scaling fixes. Pull request #2866
- Reworked eval alert thresholds to label them as 0-1 fractions instead of 0-100 percent on the backend. Pull request #2497
Why it matters
This week shipped critical stability fixes for eval-tasks that were causing excessive cloud storage egress in production. Multiple releases addressed filtering issues on dashboards and preserved evaluation configuration across saves. The project continues to refine alert thresholds and evaluation handling.
Changelog entry
- V1.38.4: Gate errored/skipped requeue on terminal watermark, sniff URL type across chunks, stop continuous tasks re-running converged failures every poll Release
- V1.38.3: Batch changed span identities below query size limit, bound remaining continuous candidate queries, hotfix dense continuous and sparse historical selection Release
- V1.38.2: Apply Dataset and Eval Source filters to eval metric charts Release
- Fix(eval-tasks): Stop continuous tasks re-running converged failures every poll by gating requeue on terminal watermark Pull request #2846
- Chore(harness): Rename 'RL Environment' label to 'Environment' in Simulate feature Pull request #2863
- Fix(evals): Preserve system eval binding config when reopening and saving existing evaluations Pull request #2621
- Fix(alerts): Label eval alert thresholds as 0-1 fractions instead of 0-100 percent Pull request #2497
- Fix(dashboards): Apply Dataset and Eval Source filters to eval metric charts Pull request #2724
V1.38.4 is out with fixes for eval-task requeue storms that were costing ~700 GB/day in S3 egress. Also includes dashboard filter fixes and label improvements.
This week we shipped v1.38.4 with critical fixes for continuous eval-tasks that were re-running converged failures on every poll cycle, causing ~700 GB/day of unnecessary S3 egress in production. We also fixed dashboard filters not applying to eval metric charts and improved the harness UI labeling. Multiple hotfixes ensure stability across the evaluation pipeline.