This release includes breaking changes for platform teams planning a safe upgrade.
Published 9d
Model Serving & MLOps
✓ No known CVEs patched
✓ No known CVEs patched in this version
Topics
data-science
machine-learning
deployment
distributed
hyperparameter-optimization
hyperparameter-search
+13 more
large-language-models
llm
llm-inference
llm-serving
optimization
parallel
python
pytorch
ray
reinforcement-learning
rllib
serving
tensorflow
Summary
AI summaryUpdates 🔨 Fixes, Highlights, and 📖 Documentation across a mixed release.
Full changelog
Highlights
- Ray Data: We added fixes for several
to_pandasregressions introduced in 2.56: an opt-out flag (RAY_DATA_ENABLE_ARROW_BACKED_PANDAS_CONVERSION) for Arrow-backed conversion, an int64/double[pyarrow]overflow crash on concatenation, and aTensorDtype.__from_arrow__crash on empty tensor columns (#64793, #64794). - Ray Core: We added early detection for system-slice memory pressure: the memory monitor now snapshots the user and system cgroup slices together and logs an error when the system slice exceeds reserved system memory, warning users to raise
--system-reserved-memorybefore it causes node deaths (#64492). - Ray Serve: We added protobuf 7 compatibility and a routing fix for LLM direct streaming, so body-aware routers like
PrefixCacheAffinityRouterno longer hang whenRAY_SERVE_LLM_ENABLE_DIRECT_STREAMING=1(#64592, #64488).
Ray Data
🔨 Fixes
- Fixed two Arrow-backed
to_pandasregressions: addedDataContext.enable_arrow_backed_pandas_conversionas an opt-out, and reconciled divergent numeric column types before concatenation to avoid int64/double[pyarrow]overflow crashes (#64793, #64768). - Fixed a
TensorDtype.__from_arrow__crash on zero-size tensor elements by using an explicit row count instead of numpy's-1dimension inference (#64794, #64767). - Fixed a crash in hash partition caused by read-only hash arrays (#64584, #64552, #64559).
- Nullified
_input_dependenciesin_get_argsso exporting operator args no longer triggers an exponentialsanitize_for_structcall chain over fused operators (#64412, #64316).
Ray Serve
🔨 Fixes
- Added protobuf
>=7compatibility to_proto_to_dictby binding toFieldDescriptor.is_repeatedwhen the deprecatedlabelattribute is absent (#64592, #64362).
Ray LLM
🔨 Fixes
- Fixed direct-streaming routing for body-aware routers: the ingress now parses the raw request body into a
SimpleNamespaceover routing-key fields (messages,prompt) sochoose_replicareceives the message body instead of raw bytes (#64488, #64328, #64326).
Ray RLlib
🔨 Fixes
- Upgraded the ONNX example from the retired MobileNet v1 to MobileNet v3 via
torchvisionand pinnedonnxscriptin the GPU/ml-build CI dep locks, fixing ONNX export failures (#64591, #64028, #64031, #64590, #64033).
Ray Core
💫 Enhancements
- The threshold memory monitor now snapshots both the user and system cgroup slices and logs an error when system-slice usage exceeds the reserved system memory, prompting users to raise
--system-reserved-memory(#64492).
🔨 Fixes
- Disabled NCCL
cuMemhost buffer registration in CI pytests to stabilize GPU test runs (#64580, #64146).
Documentation
📖 Documentation
- Repointed the ASHA Tune example links to the renamed
READMEdocument, fixing thefail_on_warningReadTheDocs build on the release line (#64761, #64630). - Updated the Python 3.10 CPU
pip freezedependency list for the Ray 2.56.0 release (#64447, #64357).
Weekly OSS security release digest.
The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.
No spam, unsubscribe anytime.
Share this release
About ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Beta — feedback welcome: [email protected]