What huggingface/transformers shipped
Written by FoxPlug from the repository's own releases; not affiliated with Hugging Face. Paste your own repository in the box below and FoxPlug writes the same weekly update for your product. This page is an automatic summary of the releases, pull requests and commits in github.com/huggingface/transformers; Hugging Face did not write it and does not use or endorse FoxPlug. Every line links to the change it describes.
Get a weekly update like this for your product, free
Week of October 5, 2026
What shipped
- Molmo2 architecture added to the repository. Pull request #43451
- PP-DocLayoutV4 model support added. Pull request #48387
- Image decoding moved to torchcodec for improved performance. Pull request #47963
- SubConfigSpec introduced for centralized initialization of subconfigs. Pull request #48282
- Generation cleanup refactored in pipelines. Pull request #49269
- Torch version bumped with guarded checks for
current_accelerator. Pull request #49395 - Hub rotary kernel now used for inference only on CUDA. Pull request #49439
- QuantizedCache residual flushing fixed for multi-token updates. Pull request #49418
- Phi3 LongRoPE cache rebuild fixed at context boundary. Pull request #49361
Why it matters
This week brought new model support with Molmo2 and PP-DocLayoutV4, performance improvements through torchcodec image decoding and optimized kernel selection, and infrastructure enhancements like SubConfigSpec for better configuration management. Numerous bug fixes address generation pipelines, cache handling, and model-specific issues, while CI improvements and torch version bumps maintain code quality and compatibility.
Changelog entry
- Added Molmo2 architecture support Pull request #43451
- Added PP-DocLayoutV4 model support Pull request #48387
- Moved image decoding to torchcodec Pull request #47963
- Introduced SubConfigSpec for centralized subconfig initialization Pull request #48282
- Bumped minimum Torch version with guarded accelerator checks Pull request #49395
- Use Hub rotary kernel for CUDA inference only Pull request #49439
- Fixed QuantizedCache residual flushing for multi-token updates Pull request #49418
- Refactored generation cleanup in pipelines Pull request #49269
- Fixed Phi3 LongRoPE cache rebuild at context boundary Pull request #49361
- Fixed Whisper batch timestamp decoding for tensors Pull request #49419
- Fixed data-dependent branch in causal mask SDPA under compile Pull request #49354
New week, new models: Molmo2 and PP-DocLayoutV4 joined the repo. We improved image decoding with torchcodec, optimized inference kernels, and fixed critical generation and cache bugs.
Transformers shipped big updates this week: Molmo2 and PP-DocLayoutV4 models are now available, image decoding improved through torchcodec integration, and we optimized inference kernels for CUDA. Infrastructure wise, SubConfigSpec centralizes subconfig initialization. Multiple fixes target generation pipelines, quantized caches, and model-specific issues. Torch version bumped for better hardware support.
Week of September 28, 2026
What shipped
- Released version 5.18.0 with new model additions including Nemotron 3 Diarization for speaker identification in audio. Release
- Added GTE model support to the library. Pull request #48416
- Added Trainer.loss_is_scaled_for_ga property to declare whether
compute_lossalready scales for gradient accumulation. Pull request #49240 - Implemented support for per-layer cache configuration. Pull request #48178
- Deprecated the 'paged|' prefix for SDPA and flash attention configurations. Pull request #49112
- Added support for continuous batching in regular attention implementations. Pull request #49101
- Made continuous batching more device-agnostic and added XPU device support. Pull request #49156
- Fixed missing
router_logitsoutput in Qwen3.5-MoE and other mixture-of-experts models. Pull request #49179 - Fixed JSON schema type mapping for bare list, tuple, and dict annotations in
get_json_schema. Pull request #49145
Why it matters
Version 5.18.0 brings new model support and infrastructure improvements for distributed training and attention mechanisms. The addition of per-layer cache configuration and continuous batching support improves inference flexibility and performance. Bug fixes in mixture-of-experts models and distributed training address issues for users deploying these configurations.
Changelog entry
- Release 5.18.0 with Nemotron 3 Diarization and GTE model additions Release
- Add GTE model to Transformers Pull request #48416
- Add Trainer.loss_is_scaled_for_ga to declare gradient accumulation scaling Pull request #49240
- Support per-layer cache configuration Pull request #48178
- Deprecate 'paged|' prefix for SDPA and flash attention Pull request #49112
- Make regular attention support continuous batching Pull request #49101
- Make continuous batching device-agnostic and add XPU support Pull request #49156
- Fix missing
router_logitsin Qwen3.5-MoE and other MoE models Pull request #49179 - Map bare list, tuple and dict annotations to correct JSON schema types Pull request #49145
- Fix
additional_special_tokensdata loss withextra_special_tokensPull request #47848
Transformers 5.18.0 is out! New Nemotron 3 Diarization model, GTE support, per-layer cache config, and improved continuous batching. Plus fixes for MoE and distributed training setups.
Week of September 21, 2026
What shipped
- Added support for Nemotron Omni architecture. Pull request #46509
- Added Nemotron3Diarization model support. Pull request #49056
- Added MLX recipe for Executorch. Pull request #48910
- Added Trainer.end method. Pull request #48875
- Integrated PEFT with Dtensor-based tensor parallelism. Pull request #48485
- Added image processing tester init. Pull request #48829
- Added support for loading GGUF models via Chat CLI. Pull request #49031
- Fixed legacy Gemma 1
hidden_actconfiguration remapping. Pull request #49084 - Fixed exporters import compatibility with torch versions below 2.9. Pull request #49124
- Enabled ROCm flash attention 3 routing and fixture generation for gpt-oss. Pull request #46837
Why it matters
This week includes two new model architectures (Nemotron Omni and Nemotron3Diarization), expanded deployment options through MLX recipes and GGUF support in Chat CLI, and fixes for critical issues across attention mechanisms, configuration handling, and compatibility layers. New trainer functionality and improved device handling strengthen the core training pipeline.
Changelog entry
- Support for Nemotron Omni architecture Pull request #46509
- Support for Nemotron3Diarization Pull request #49056
- MLX recipe for Executorch Pull request #48910
- Trainer.end method Pull request #48875
- PEFT integration with Dtensor-based tensor parallelism Pull request #48485
- GGUF model loading in Chat CLI Pull request #49031
- Image processing tester initialization Pull request #48829
- Fix legacy Gemma 1
hidden_actremapping in config post-init Pull request #49084 - Fix exporters import on torch < 2.9 (
is_contiguous_or_false) Pull request #49124 - ROCm flash attention 3 routing and fixture generation for gpt-oss Pull request #46837
- Use
grouped_mmon TPU devices under torch.compile Pull request #49097 - Preserve eos ids declared in config Pull request #49082
- Fix MaskFormerSwin attention mask dtype to follow hidden states Pull request #49032
- Use namespaced dataset ids in docs and PyTorch examples Pull request #49005
- Fix RGB early-return skipping PNG tRNS compositing Pull request #49092
- Fix NaN in Parakeet eager attention with padded batches Pull request #49070
- Fix mask creation not being skipped under torch.compile Pull request #48975
- Add
use_associative_scanconfig flag to Zamba to avoid torch.compile slowdown Pull request #48331
This week: Nemotron Omni & Nemotron3Diarization support, MLX & GGUF integration, Trainer.end method, PEFT tensor parallelism, plus fixes for attention, configs & compatibility [20,26,10,12,36,33]
Transformers now supports Nemotron Omni and Nemotron3Diarization architectures, expands deployment with MLX recipes and GGUF loading in Chat CLI, introduces Trainer.end for better training control, and ships PEFT integration with Dtensor-based tensor parallelism. This week also includes critical fixes for attention mechanisms, configuration handling, and cross-version compatibility to strengthen both inference and training workflows.