zenml

Dynamic pipelines with step operators

Dynamic pipeline execution is more reliable when steps use step operators.

• Fixed an issue where running a step with a step operator in a dynamic pipeline could fail unless that step was explicitly listed in pipeline.depends_on.
• ZenML now falls back to the orchestrator image in this case, matching the behavior already used for isolated steps without step operators. PR #4960

Faster pipeline and step run queries

Common pipeline run and step run views should now load more efficiently, especially on larger deployments.

• Improved database query performance by adjusting how related data is loaded for common pipeline run and step run queries.
• This helps avoid expensive query plans in MySQL for paginated run listings, making these queries more scalable. PR #4965

Logging stability

Logging shutdown is now safer when using artifact-backed log stores.

• Fixed a deadlock that could happen during logging context shutdown when using fsspec-based artifact log stores with debug logs enabled.
• ZenML now avoids writing back into the log store during shutdown, improving reliability for pipeline and step log collection. PR #4964

What's Changed

• Add version 0.94.6 to legacy docs by @github-actions[bot] in https://github.com/zenml-io/zenml/pull/4957
• Add 0.95.0 to the migration tests by @github-actions[bot] in https://github.com/zenml-io/zenml/pull/4959
• Exclude zenml from its own dependency audit by @strickvl in https://github.com/zenml-io/zenml/pull/4961
• Fallback to orchestrator image by @schustmi in https://github.com/zenml-io/zenml/pull/4960
• Fix logging shutdown deadlock by @schustmi in https://github.com/zenml-io/zenml/pull/4964
• Improve DB query plans by using selectinload by @schustmi in https://github.com/zenml-io/zenml/pull/4965
• Prepare release 0.95.1 by @github-actions[bot] in https://github.com/zenml-io/zenml/pull/4966

Full Changelog: https://github.com/zenml-io/zenml/compare/0.95.0...0.95.1