Skip to content

Release history

metaflow releases

Build, Manage and Deploy AI/ML Systems

All releases

68 shown

No immediate action
2.19.32 Bug fix

Cronjob schedule + timeout fixes

Review required
2.19.31 Mixed
Dependencies

Security hardening, bugfixes, dependency bumps

No immediate action
2.19.30 Bug fix

S3 empty-input fix

No immediate action
2.19.29 Breaking risk

Typo fixes

2.19.28 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • fix: use sys.version_info instead of platform.python_version() in conda decorator by @npow in https://github.com/Netflix/metaflow/pull/3177
  • fix(ci): increase devstack wait timeout and add failure diagnostics by @npow in https://github.com/Netflix/metaflow/pull/3156
  • Fix invalid self.input access in spin complex DAG test by @talsperre in https://github.com/Netflix/metaflow/pull/3180
  • Preserve KeyError for missing artifacts by @talsperre in https://github.com/Netflix/metaflow/pull/3181
  • Bump version to 2.19.28 by @talsperre in https://github.com/Netflix/metaflow/pull/3182

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.27...2.19.28

2.19.27 Bug fix

Fixed pip config parsing when using multiple extra-index-url entries.

Full changelog

What's Changed

  • Fix pip config parsing for multiple extra-index-urls by @harkrish-1 in https://github.com/Netflix/metaflow/pull/3125
  • Update version by @talsperre in https://github.com/Netflix/metaflow/pull/3178

New Contributors

  • @harkrish-1 made their first contribution in https://github.com/Netflix/metaflow/pull/3125

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.26...2.19.27

2.19.26 New feature
Notable features
  • Added pluggable artifact serializer framework
Full changelog

What's Changed

  • Add pluggable artifact serializer framework by @saeidbarati157 in https://github.com/Netflix/metaflow/pull/3117

New Contributors

  • @saeidbarati157 made their first contribution in https://github.com/Netflix/metaflow/pull/3117

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.25...2.19.26

2.19.25 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • Remove unused audit() callbacks from test_config flow files by @talsperre in https://github.com/Netflix/metaflow/pull/3171
  • env_escape: round-trip MF_ORIG_PYTHONPATH and MF_ORIG_PYTHONHOME by @talsperre in https://github.com/Netflix/metaflow/pull/3173
  • Bump version to 2.19.25 by @talsperre in https://github.com/Netflix/metaflow/pull/3176

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.24...2.19.25

2.19.24 Breaking risk
Notable features
  • FlowDecorators, FlowMutators, and StepMutators now support the `add_to_package` method to add artifacts
Full changelog

What's Changed

  • fix(ci): replace minikube devstack with standalone MinIO container by @npow in https://github.com/Netflix/metaflow/pull/3157
  • fix: Added missing targets to .PHONY and removed duplicates by @agsaru in https://github.com/Netflix/metaflow/pull/3168
  • Allow FlowDecorators, FlowMutators and StepMutators to add_to_package by @romain-intel in https://github.com/Netflix/metaflow/pull/3082

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.23...2.19.24

2.19.23 Breaking risk
Notable features
  • @step(start=True)/@step(end=True) annotations, single-step flows, and node_info metadata
Full changelog

What's Changed

  • Testing Infra Enhancements by @npow in https://github.com/Netflix/metaflow/pull/3040
  • Fix an issue with properly resetting LD_LIBRARY_PATH for escape hatch by @romain-intel in https://github.com/Netflix/metaflow/pull/2926
  • New decorator hooks by @romain-intel in https://github.com/Netflix/metaflow/pull/2969
  • fix remove_decorator return value when removing all matches by @npow in https://github.com/Netflix/metaflow/pull/3041
  • Fix foreach join inputs out-of-order for >4 branches by @npow in https://github.com/Netflix/metaflow/pull/2974
  • Fix stubs tests failing on Python 3.10+ by @npow in https://github.com/Netflix/metaflow/pull/3116
  • Fix get_pinned_conda_libs extension merge to skip empty-string versions by @npow in https://github.com/Netflix/metaflow/pull/3127
  • Remove R tests job from CI workflow by @talsperre in https://github.com/Netflix/metaflow/pull/3126
  • Refactor ux/core compilation tests to function-style pytest by @talsperre in https://github.com/Netflix/metaflow/pull/3131
  • Preserve dashed tags in metaflow version parsing and public-version stripping by @talsperre in https://github.com/Netflix/metaflow/pull/3132
  • Removed the duplicate and unused pretty_print function by @agsaru in https://github.com/Netflix/metaflow/pull/3133
  • Allow UserStepDecorators to also be StepMutators by @romain-intel in https://github.com/Netflix/metaflow/pull/3079
  • Improve --compress-state-machine help text by @dpoznik in https://github.com/Netflix/metaflow/pull/3146
  • fix: skip CronWorkflow creation when @schedule resolves to no schedule by @KnutZuidema in https://github.com/Netflix/metaflow/pull/3122
  • Remove dead test_runner and unnecessary numpy CI dep by @npow in https://github.com/Netflix/metaflow/pull/3149
  • Codify pytest test conventions and align legacy tests by @talsperre in https://github.com/Netflix/metaflow/pull/3150
  • Show link to argo workflows when triggering a run by @amerberg in https://github.com/Netflix/metaflow/pull/1934
  • fix: use path_key instead of stale path in load_blobs error messages by @codeMaestro78 in https://github.com/Netflix/metaflow/pull/2943
  • pre-commit: Fix-end-of-files by @cclauss in https://github.com/Netflix/metaflow/pull/2733
  • pre-commit: Trim trailing whitespace by @cclauss in https://github.com/Netflix/metaflow/pull/2732
  • feat: @step(start=True)/@step(end=True) annotations, single-step flows, and node_info metadata by @romain-intel in https://github.com/Netflix/metaflow/pull/3120
  • release: 2.19.23 by @talsperre in https://github.com/Netflix/metaflow/pull/3158

New Contributors

  • @agsaru made their first contribution in https://github.com/Netflix/metaflow/pull/3133
  • @KnutZuidema made their first contribution in https://github.com/Netflix/metaflow/pull/3122
  • @codeMaestro78 made their first contribution in https://github.com/Netflix/metaflow/pull/2943

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.22...2.19.23

2.19.22 Bug fix
Notable features
  • Extensions can register custom Click parameter types for the Runner API
Full changelog

What's Changed

  • fix: correct filename typo in timeout_decorator stack-frame filter by @Vansh0204 in https://github.com/Netflix/metaflow/pull/3030
  • Allow extensions to register custom Click parameter types for Runner API by @talsperre in https://github.com/Netflix/metaflow/pull/3005
  • release: 2.19.22 by @talsperre in https://github.com/Netflix/metaflow/pull/3036
  • fix: install remotes package for R CI test by @talsperre in https://github.com/Netflix/metaflow/pull/3037

New Contributors

  • @Vansh0204 made their first contribution in https://github.com/Netflix/metaflow/pull/3030

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.21...2.19.22

2.19.21 Bug fix

Fixed Tuple[()] stub generation for empty tuple types.

Full changelog

What's Changed

  • Fix #2923: Changed CSV Parsing to DictReader in tutorial 01 and 02 by @antidude900 in https://github.com/Netflix/metaflow/pull/2933
  • Fix Tuple[()] stub generation for empty tuple types by @npow in https://github.com/Netflix/metaflow/pull/2945
  • Indicate that batch (list|kill) applies to the latest run by default by @dpoznik in https://github.com/Netflix/metaflow/pull/2964
  • Add AGENTS.md to guide AI coding assistants for contributors by @npow in https://github.com/Netflix/metaflow/pull/2989
  • fix: argo workflows conditional nested static split joins by @saikonen in https://github.com/Netflix/metaflow/pull/3002
  • release: 2.19.21 by @saikonen in https://github.com/Netflix/metaflow/pull/3008

New Contributors

  • @antidude900 made their first contribution in https://github.com/Netflix/metaflow/pull/2933

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.20...2.19.21

2.19.20 Bug fix

Fixed save_bytes put_many tuple mapping in S3Storage.

Full changelog

What's Changed

  • fix: Missing values from reserved-params by @saikonen in https://github.com/Netflix/metaflow/pull/2787
  • Fix: resources deco shared_memory doesn't set kubernetes deco shared_memory by @theOGognf in https://github.com/Netflix/metaflow/pull/2760
  • build(deps-dev): bump qs from 6.14.1 to 6.14.2 in /metaflow/plugins/cards/ui by @dependabot[bot] in https://github.com/Netflix/metaflow/pull/2793
  • fix: correct typo 'occurence' to 'occurrence' by @thecaptain789 in https://github.com/Netflix/metaflow/pull/2785
  • Fix #524: Ignore --max-value-size when using dump --file by @dheerenmohta in https://github.com/Netflix/metaflow/pull/2774
  • force color support for vendored click by @vivekkhimani in https://github.com/Netflix/metaflow/pull/2798
  • Fix flaky test: use atomic writes in local storage by @npow in https://github.com/Netflix/metaflow/pull/2796
  • Add contribution quality gates and PR template by @npow in https://github.com/Netflix/metaflow/pull/2826
  • Fix package walk hidden-dir check for ancestor paths by @NirZabari in https://github.com/Netflix/metaflow/pull/2790
  • exclude skypilot for packaging envs by @mt-ob in https://github.com/Netflix/metaflow/pull/2872
  • Fix bare except clauses in compute backend decorators by @shreed27 in https://github.com/Netflix/metaflow/pull/2850
  • Revert "force color support for vendored click (#2798)" by @npow in https://github.com/Netflix/metaflow/pull/2910
  • S3: tolerate missing content_type in R2 info responses by @npow in https://github.com/Netflix/metaflow/pull/2920
  • Fix save_bytes put_many tuple mapping in S3Storage by @npow in https://github.com/Netflix/metaflow/pull/2932
  • rename to skypilot_step by @mt-ob in https://github.com/Netflix/metaflow/pull/2935
  • release: 2.19.20 by @saikonen in https://github.com/Netflix/metaflow/pull/2936

New Contributors

  • @theOGognf made their first contribution in https://github.com/Netflix/metaflow/pull/2760
  • @thecaptain789 made their first contribution in https://github.com/Netflix/metaflow/pull/2785
  • @dheerenmohta made their first contribution in https://github.com/Netflix/metaflow/pull/2774
  • @NirZabari made their first contribution in https://github.com/Netflix/metaflow/pull/2790
  • @shreed27 made their first contribution in https://github.com/Netflix/metaflow/pull/2850

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.19...2.19.20

2.19.19 New feature
Notable features
  • Configurable auto emission of events from Argo UI
Full changelog

What's Changed

  • feature: AWS Batch privileged option by @saikonen in https://github.com/Netflix/metaflow/pull/2767
  • fix: add S3_ENDPOINT_URL to the required env list in argo templates by @saikonen in https://github.com/Netflix/metaflow/pull/2769
  • Add init.py to pip_patcher for PyPI packaging by @naveenkasturi in https://github.com/Netflix/metaflow/pull/2776
  • Feat - Make auto emission of events configurable from argo UI by @tfurmston in https://github.com/Netflix/metaflow/pull/2770
  • Revert "Feat - Make auto emission of events configurable from argo UI" by @saikonen in https://github.com/Netflix/metaflow/pull/2778
  • GSOC 26 Proposals by @talsperre in https://github.com/Netflix/metaflow/pull/2779
  • Simplify Docker check in devtools Makefile by @rooday-doordash in https://github.com/Netflix/metaflow/pull/2773
  • build(deps): bump vega-functions, vega, vega-embed and vega-lite in /metaflow/plugins/cards/ui by @dependabot[bot] in https://github.com/Netflix/metaflow/pull/2736
  • build(deps-dev): bump lodash from 4.17.21 to 4.17.23 in /metaflow/plugins/cards/ui by @dependabot[bot] in https://github.com/Netflix/metaflow/pull/2758
  • build(deps): bump qs and @cypress/request in /metaflow/plugins/cards/ui by @dependabot[bot] in https://github.com/Netflix/metaflow/pull/2764
  • Add support for class attributes and bound methods to escape hatch by @malder08 in https://github.com/Netflix/metaflow/pull/2775
  • Update contributing.md by @npow in https://github.com/Netflix/metaflow/pull/2766
  • Update GSOC contributor guide and projects list by @talsperre in https://github.com/Netflix/metaflow/pull/2784
  • release: 2.19.19 by @saikonen in https://github.com/Netflix/metaflow/pull/2786

New Contributors

  • @naveenkasturi made their first contribution in https://github.com/Netflix/metaflow/pull/2776
  • @rooday-doordash made their first contribution in https://github.com/Netflix/metaflow/pull/2773

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.18...2.19.19

2.19.18 Bug fix

Fixed S3 list_paths regression.

Full changelog

What's Changed

  • Upgrade GitHub Actions for Node 24 compatibility by @salmanmkc in https://github.com/Netflix/metaflow/pull/2763
  • fix: S3 list_paths regression by @saikonen in https://github.com/Netflix/metaflow/pull/2765
  • [namespaced events] by @valayDave in https://github.com/Netflix/metaflow/pull/2742
  • release: 2.19.18 by @saikonen in https://github.com/Netflix/metaflow/pull/2771

New Contributors

  • @salmanmkc made their first contribution in https://github.com/Netflix/metaflow/pull/2763

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.17...2.19.18

2.19.17 Bug fix

Fixed file handling edge cases and improved command processing.

Full changelog

What's Changed

  • fix: edge case with symlink traversal in packaging by @saikonen in https://github.com/Netflix/metaflow/pull/2751
  • More detailed message for ctrl+c interruptions by @oavdeev in https://github.com/Netflix/metaflow/pull/2752
  • fix: better command processing for compress state machine by @nlwstein in https://github.com/Netflix/metaflow/pull/2744
  • Skip Kubernetes cluster access when using --only-json flag in Argo Workflows CLI by @vivekkhimani in https://github.com/Netflix/metaflow/pull/2743
  • fix: support token CLI options with --only-json by @saikonen in https://github.com/Netflix/metaflow/pull/2761
  • release: 2.19.17 by @saikonen in https://github.com/Netflix/metaflow/pull/2762

New Contributors

  • @vivekkhimani made their first contribution in https://github.com/Netflix/metaflow/pull/2743

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.16...2.19.17

2.19.16 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • pre-commit autoupdate 2025-12-21 by @cclauss in https://github.com/Netflix/metaflow/pull/2731
  • Fix metaflow-dev up shell compatibility and AWS credential isolation by @ShreehariVaasishta in https://github.com/Netflix/metaflow/pull/2730
  • handle 410 expired continue token for listing argo workflow templates by @mt-ob in https://github.com/Netflix/metaflow/pull/2745
  • Bump metaflow version to 2.19.16 by @savingoyal in https://github.com/Netflix/metaflow/pull/2746

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.15...2.19.16

2.19.15 New feature
Notable features
  • Enabling freethreaded Python support for PyPI/conda
Full changelog

What's Changed

  • fix: force-rebuild-environments edge case with conda by @saikonen in https://github.com/Netflix/metaflow/pull/2721
  • Replace discontinued links to admin-docs with links to Outerbounds do… by @obgibson in https://github.com/Netflix/metaflow/pull/2724
  • feature: enabling freethreaded python support for pypi/conda by @saikonen in https://github.com/Netflix/metaflow/pull/2723
  • kill job based on terminate mode configuration by @iamsgarg-ob in https://github.com/Netflix/metaflow/pull/2726
  • fix: add freethreaded python abis to pypi resolve download as well by @saikonen in https://github.com/Netflix/metaflow/pull/2727
  • Bump metaflow version to 2.19.15 by @savingoyal in https://github.com/Netflix/metaflow/pull/2728

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.14...2.19.15

2.19.14 Bug fix

Fixed a bug where a default `none` config was misinterpreted as a placeholder value.

Full changelog

What's Changed

  • Remove a case where duplicate init functions were called (when deploy… by @romain-intel in https://github.com/Netflix/metaflow/pull/2719
  • Fix a case where a default none config would get confused with the pl… by @romain-intel in https://github.com/Netflix/metaflow/pull/2720

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.13...2.19.14

2.19.13 Bug fix

Raises an error when S3 retries exhaust.

Full changelog

What's Changed

  • [S3] raise error on s3 retry exhaustion by @npow in https://github.com/Netflix/metaflow/pull/2703
  • fix: Argo input-paths with multiple conditionals by @saikonen in https://github.com/Netflix/metaflow/pull/2714
  • Bump metaflow version to 2.19.13 by @malder08 in https://github.com/Netflix/metaflow/pull/2715
  • fix: increase supported glibc versions in pip tags by @saikonen in https://github.com/Netflix/metaflow/pull/2716

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.12...2.19.13

2.19.12 Bug fix

Fixed compatibility allowing FlowMutator and FlowDecorator to coexist.

Full changelog

What's Changed

  • Fix: allow FlowMutator and FlowDecorator to co-exist by @aquarin in https://github.com/Netflix/metaflow/pull/2709
  • Revert "fix: argo events add_to_payload value casting (#2702)" by @oavdeev in https://github.com/Netflix/metaflow/pull/2710

New Contributors

  • @aquarin made their first contribution in https://github.com/Netflix/metaflow/pull/2709

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.11...2.19.12

2.19.11 Maintenance
Notable features
  • Add default IAM role setting for AWS Secrets Manager plugin
Full changelog

What's Changed

  • Add default IAM role setting for AWS Secrets Manager plugin by @oavdeev in https://github.com/Netflix/metaflow/pull/2707
  • Bump metaflow version to 2.19.11 by @savingoyal in https://github.com/Netflix/metaflow/pull/2708

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.10...2.19.11

2.19.10 Bug fix
Notable features
  • Added --no-dev option to uv sync
Full changelog

What's Changed

  • fix: argo foreach join incorrect task-id's with conditional branching by @saikonen in https://github.com/Netflix/metaflow/pull/2699
  • added --no-dev to uv sync by @lpoug in https://github.com/Netflix/metaflow/pull/2700
  • build(deps-dev): bump js-yaml from 4.1.0 to 4.1.1 in /metaflow/plugins/cards/ui by @dependabot[bot] in https://github.com/Netflix/metaflow/pull/2691
  • fix: argo events add_to_payload value casting by @saikonen in https://github.com/Netflix/metaflow/pull/2702
  • Fix: JobSet with @retry(times=0) validation error by @Dhanush010 in https://github.com/Netflix/metaflow/pull/2672
  • Fix/multi inheritance by @romain-intel in https://github.com/Netflix/metaflow/pull/2639

New Contributors

  • @lpoug made their first contribution in https://github.com/Netflix/metaflow/pull/2700
  • @Dhanush010 made their first contribution in https://github.com/Netflix/metaflow/pull/2672

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.9...2.19.10

2.19.9 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • Revert "fix: pypi with site pip config" by @savingoyal in https://github.com/Netflix/metaflow/pull/2696
  • Bump metaflow version to 2.19.9 by @savingoyal in https://github.com/Netflix/metaflow/pull/2697

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.8...2.19.9

2.19.8 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • fix: pypi with site pip config by @saikonen in https://github.com/Netflix/metaflow/pull/2688
  • release: 2.19.8 by @saikonen in https://github.com/Netflix/metaflow/pull/2689

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.7...2.19.8

2.19.7 Bug fix

Fixed a crash when mixing UserStepDecorators with regular decorators.

Full changelog

What's Changed

  • Fix a crash when mixing UserStepDecorators and regular decorators by @romain-intel in https://github.com/Netflix/metaflow/pull/2680
  • Fix json decode error by @npow in https://github.com/Netflix/metaflow/pull/2653
  • set CLICK_API_PROCESS_CONFIG to True by @mt-ob in https://github.com/Netflix/metaflow/pull/2572
  • fix: argo conditionals issue with foreach join by @saikonen in https://github.com/Netflix/metaflow/pull/2683
  • release: 2.19.7 by @saikonen in https://github.com/Netflix/metaflow/pull/2684

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.6...2.19.7

2.19.6 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • Update S3 docs and constructor by @talsperre in https://github.com/Netflix/metaflow/pull/2677
  • Update documentation on what a function yielded in a user level decor… by @romain-intel in https://github.com/Netflix/metaflow/pull/2669
  • Fix s3 slash shenanigans by @npow in https://github.com/Netflix/metaflow/pull/2673
  • Bump metaflow version to 2.19.6 by @npow in https://github.com/Netflix/metaflow/pull/2679

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.5...2.19.6

2.19.5 Bug fix
Notable features
  • Better pip cross‑platform package resolution (e.g., torch on macOS with kubernetes)
  • Allow secrets decorator to override existing environment variables
Full changelog

Improvements

Better PyPi cross-platform resolves

This release resolves issues with certain packages that have platform-specific dependencies that would not otherwise get bundled, resulting in a broken execution environment.

The most common issue that this solves is with the torch package. For example in the past running on a mac with --with kubernetes would result in errors regarding missing CUDA libraries, due to these not getting bundled up as part of the resolved environment.

What's Changed

  • fix: argo event publishing retries by @saikonen in https://github.com/Netflix/metaflow/pull/2671
  • feature: better pip crossplatform resolves by @saikonen in https://github.com/Netflix/metaflow/pull/2322
  • feature: allow secrets decorator to override existing env vars by @saikonen in https://github.com/Netflix/metaflow/pull/2674
  • fix: more cross platform resolve fixes by @saikonen in https://github.com/Netflix/metaflow/pull/2675
  • release: 2.19.5 by @saikonen in https://github.com/Netflix/metaflow/pull/2676

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.4...2.19.5

2.19.4 Bug fix

Fixed a regression that prevented resuming flows.

Full changelog

What's Changed

  • update module importer by @malder08 in https://github.com/Netflix/metaflow/pull/2636
  • Fix bug when removing multiple params in mutable flow by @talsperre in https://github.com/Netflix/metaflow/pull/2665
  • chore: update image in metaflow-dev to support spin steps by @saikonen in https://github.com/Netflix/metaflow/pull/2667
  • fix: regression with resume by @saikonen in https://github.com/Netflix/metaflow/pull/2666
  • release: 2.19.4 by @saikonen in https://github.com/Netflix/metaflow/pull/2668

New Contributors

  • @malder08 made their first contribution in https://github.com/Netflix/metaflow/pull/2636

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.3...2.19.4

2.19.3 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • use packaging 24.0 instead for python 3.7 by @mt-ob in https://github.com/Netflix/metaflow/pull/2663

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.2...2.19.3

2.19.2 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • add packaging as a dependency for gcp by @mt-ob in https://github.com/Netflix/metaflow/pull/2661
  • Update version.py by @mt-ob in https://github.com/Netflix/metaflow/pull/2662

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.1...2.19.2

2.19.1 Bug fix
Notable features
  • Added startingDeadlineSeconds configuration set to 59 minutes
Full changelog

What's Changed

  • adding startingDeadlineSeconds to 59 mins by @iamsgarg-ob in https://github.com/Netflix/metaflow/pull/2657
  • fix: extremely wide foreach on argo breaking by @saikonen in https://github.com/Netflix/metaflow/pull/2659
  • release: 2.19.1 by @saikonen in https://github.com/Netflix/metaflow/pull/2660

Full Changelog: https://github.com/Netflix/metaflow/compare/2.19.0...2.19.1

2.19.0 Maintenance
Notable features
  • Support spinning a single metaflow step
Full changelog

What's Changed

  • build(deps-dev): bump vite from 5.4.19 to 5.4.21 in /metaflow/plugins/cards/ui by @dependabot[bot] in https://github.com/Netflix/metaflow/pull/2649
  • Fix extensions and packaging for some types of editable package installs by @romain-intel in https://github.com/Netflix/metaflow/pull/2612
  • Allow overriding of _transition in user step-decorators by @romain-intel in https://github.com/Netflix/metaflow/pull/2651
  • [S3] Log original error code for transient errors by @npow in https://github.com/Netflix/metaflow/pull/2616
  • fix: fullstack test timeouts by @saikonen in https://github.com/Netflix/metaflow/pull/2650
  • Fix bad use of ConfigValue for None values by @romain-intel in https://github.com/Netflix/metaflow/pull/2652
  • Feature: Support spinning a single metaflow step (Rebased) by @talsperre in https://github.com/Netflix/metaflow/pull/2506
  • Bump metaflow version to 2.19.0 by @savingoyal in https://github.com/Netflix/metaflow/pull/2654

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.13...2.19.0

2.18.13 Bug fix
⚠ Upgrade required
  • Compatibility with Python 3.14
Full changelog

What's Changed

  • Fix issue with cards when .metaflow exists in a parent directory by @romain-intel in https://github.com/Netflix/metaflow/pull/2641
  • compatibility with python 3.14 by @mt-ob in https://github.com/Netflix/metaflow/pull/2647
  • fix: argo params issue with char encodings by @saikonen in https://github.com/Netflix/metaflow/pull/2635
  • release: 2.18.13 by @saikonen in https://github.com/Netflix/metaflow/pull/2648

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.12...2.18.13

2.18.12 Bug fix
Notable features
  • Argo workflow title & description support
Full changelog

What's Changed

  • fix for error capture script by @iamsgarg-ob in https://github.com/Netflix/metaflow/pull/2633
  • fix: Enhance Markdown component to support indented multi-line strings by @ShreehariVaasishta in https://github.com/Netflix/metaflow/pull/2634
  • fix for bad json file written out. by @romain-intel in https://github.com/Netflix/metaflow/pull/2637
  • Add Argo workflow title & description support by @ShreehariVaasishta in https://github.com/Netflix/metaflow/pull/2628
  • release: 2.18.12 by @saikonen in https://github.com/Netflix/metaflow/pull/2638

New Contributors

  • @ShreehariVaasishta made their first contribution in https://github.com/Netflix/metaflow/pull/2634

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.11...2.18.12

2.18.11 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • [cards] max artifact size checks by @valayDave in https://github.com/Netflix/metaflow/pull/2630
  • Bump metaflow version to 2.18.11 by @savingoyal in https://github.com/Netflix/metaflow/pull/2631

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.10...2.18.11

2.18.10 Bug fix
Notable features
  • [cards] components to support agentic Metaflow
Full changelog

What's Changed

  • fix params leakage in click api by @mt-ob in https://github.com/Netflix/metaflow/pull/2621
  • [cards] components to support agentic Metaflow by @valayDave in https://github.com/Netflix/metaflow/pull/2622
  • Use legacy bitnami repo by @npow in https://github.com/Netflix/metaflow/pull/2623
  • fix s3 list_recursive to exclude sibling directories with shared prefixes by @mt-ob in https://github.com/Netflix/metaflow/pull/2441
  • fix: argo conditional steps graph parsing issue by @saikonen in https://github.com/Netflix/metaflow/pull/2624
  • release: 2.18.10 by @saikonen in https://github.com/Netflix/metaflow/pull/2625

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.9...2.18.10

2.18.9 Maintenance
Notable features
  • Jobsets + Locking Versions introduced via metaflow dev
  • YAML file support added
Full changelog

What's Changed

  • [metaflow dev] Jobsets + Locking Versions by @valayDave in https://github.com/Netflix/metaflow/pull/2528
  • [include file] yaml file support. by @valayDave in https://github.com/Netflix/metaflow/pull/2600
  • Bump version to 2.18.9 by @savingoyal in https://github.com/Netflix/metaflow/pull/2617

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.8...2.18.9

2.18.8 Bug fix
Notable features
  • Added valuebox component in cards
Full changelog

What's Changed

  • [cards] valuebox component by @valayDave in https://github.com/Netflix/metaflow/pull/2614
  • [S3] Properly handle TimeoutException by @npow in https://github.com/Netflix/metaflow/pull/2613

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.7...2.18.8

2.18.7 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • fix pip tags to use resolved python from environment by @mt-ob in https://github.com/Netflix/metaflow/pull/2608
  • Bump metaflow version to 2.18.7 by @savingoyal in https://github.com/Netflix/metaflow/pull/2611

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.6...2.18.7

2.18.6 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • Refactor trigger decorator and deploy time evaluation logic by @talsperre in https://github.com/Netflix/metaflow/pull/2290
  • Release 2.18.6 by @talsperre in https://github.com/Netflix/metaflow/pull/2610

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.5...2.18.6

2.18.5 Bug fix

Fixed resuming flows executed with Metaflow versions earlier than 2.17.4.

Full changelog

Improvements

Fixes an issue with resuming flows executed with older versions

This release fixes an issue where flows that ran with Metaflow versions <2.17.4 could not be resumed by later versions.

What's Changed

  • fix: resume backward compatibility by @saikonen in https://github.com/Netflix/metaflow/pull/2601
  • Fix an issue where MetaflowCode.tarball would return a corrupted TarFile by @romain-intel in https://github.com/Netflix/metaflow/pull/2603
  • release: 2.18.5 by @saikonen in https://github.com/Netflix/metaflow/pull/2604

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.4...2.18.5

2.18.4 Bug fix

Fixed error when deleting an Argo deployment with a missing template.

Full changelog

What's Changed

  • fix: error on delete argo deployment when template missing by @saikonen in https://github.com/Netflix/metaflow/pull/2593
  • Bump metaflow version to 2.18.4 by @savingoyal in https://github.com/Netflix/metaflow/pull/2599

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.3...2.18.4

2.18.3 New feature
Notable features
  • Argo Events sensor namespace configurable via METAFLOW_ARGO_EVENTS_SENSOR_NAMESPACE env var or Metaflow config
  • Compress large AWS Step Functions commands by uploading them to S3 when METAFLOW_SFN_COMPRESS_STATE_MACHINE is true
Full changelog

Features

Argo Events sensor namespace configuration

This release enables deploying the Argo sensor in its own namespace. The sensors are required when using Metaflow triggers when deploying to Argo Workflows.

The sensor namespace can be configured by either by the Metaflow config, or through an environment variable

export METAFLOW_ARGO_EVENTS_SENSOR_NAMESPACE=example

Compressing of large commands on AWS Step Functions

AWS Step Functions has a maximum size for the step command that can become a problem with complex flows. To get around this limitation, this release introduces a way to compress the command being executed by offloading it to S3 instead.

Setting the following environment variable or Metaflow config value to true will enable the feature.

export METAFLOW_SFN_COMPRESS_STATE_MACHINE=True

Improvements

Improve support for conditional steps with Argo Workflows

This release fixes an issue with conditional steps on Argo Workflows, where deployment would fail with a flow that had a conditional step where a case would not introduce its own steps, but instead skip ahead in the graph.

What's Changed

  • Make argo events sensor namespace configurable by @dhpollack in https://github.com/Netflix/metaflow/pull/1463
  • feat: add S3 command upload support for AWS Step Functions to handle large commands by @nlwstein in https://github.com/Netflix/metaflow/pull/2534
  • Patch 2025-09-08-01 fix minor typos by @myatt83 in https://github.com/Netflix/metaflow/pull/2591
  • Update metaflow client to accept both pathspec and _object together by @talsperre in https://github.com/Netflix/metaflow/pull/2590
  • fix: argo conditional skip step parsing by @saikonen in https://github.com/Netflix/metaflow/pull/2587
  • release: 2.18.3 by @saikonen in https://github.com/Netflix/metaflow/pull/2592

New Contributors

  • @nlwstein made their first contribution in https://github.com/Netflix/metaflow/pull/2534
  • @myatt83 made their first contribution in https://github.com/Netflix/metaflow/pull/2591

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.2...2.18.3

2.18.2 New feature
Notable features
  • Provides `git-info` metadata for deployed flows at deployment time
Full changelog

Improvements

Provide git-info metadata for deployed flows

Git repository information is not available during execution of a scheduled flow, such as with Argo Workflows or AWS Step Functions due to Metaflow only packaging files necessary for flow execution.

This release introduces a change where the git info is read during deployment time and retained as part of the deployment.

What's Changed

  • fix: missing git info on remote flows by @saikonen in https://github.com/Netflix/metaflow/pull/2583
  • fix: R test dependencies by @saikonen in https://github.com/Netflix/metaflow/pull/2586
  • release: 2.18.2 by @saikonen in https://github.com/Netflix/metaflow/pull/2585

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.1...2.18.2

2.18.1 New feature
Notable features
  • Custom AWS Batch tag support through METAFLOW_BATCH_EMIT_TAGS flag, @batch decorator (aws_batch_tags), CLI --aws-batch-tag option, and METAFLOW_BATCH_DEFAULT_TAGS environment/config setting
Full changelog

Features

Support custom AWS Batch tags

This release adds support for adding custom tags to AWS Batch.
In order to enable Batch tagging, a config flag needs to be set either in the environment, or in Metaflow config

export METAFLOW_BATCH_EMIT_TAGS=True

The supported ways for adding custom tags are

  1. Through the @batch decorator
@batch(aws_batch_tags={"my tag": "my custom value"})
  1. Through the CLI when deploying to AWS Step Functions
python BatchTags.py step-functions create \
--aws-batch-tag "tagging from"="CLI with value" \
--aws-batch-tag another=value2
  1. Specifying default through an environment variable
export METAFLOW_BATCH_DEFAULT_TAGS='{"envtag": "value123", "another":"from env"}'

or in Metaflow config:

{
    "METAFLOW_BATCH_DEFAULT_TAGS": {"envtag": "value123", "another":"from env"}
}

What's Changed

  • fix: Card dag breaking up in loops by @rsanteri in https://github.com/Netflix/metaflow/pull/2581
  • feature: Batch tags [updated] by @RikishK, @Limess, @saikonen in https://github.com/Netflix/metaflow/pull/2578
  • fix: shortened argo workflow name sanitising by @saikonen in https://github.com/Netflix/metaflow/pull/2580
  • release: 2.18.1 by @saikonen in https://github.com/Netflix/metaflow/pull/2582

Full Changelog: https://github.com/Netflix/metaflow/compare/2.18.0...2.18.1

2.18.0 Bug fix

Fixed a typo in exception handling and corrected the save function to properly write package blobs.

Full changelog

What's Changed

  • chore: clarify argo conditionals exception by @saikonen in https://github.com/Netflix/metaflow/pull/2569
  • Fix idiotic typo in exception handling by @romain-intel in https://github.com/Netflix/metaflow/pull/2567
  • Fix an issue with storing sub-configs. by @romain-intel in https://github.com/Netflix/metaflow/pull/2566
  • Fix save function to write package blob correctly by @savingoyal in https://github.com/Netflix/metaflow/pull/2575
  • disallow conditional to join directly by @mt-ob in https://github.com/Netflix/metaflow/pull/2571
  • Bump metaflow version to 2.18.0 by @savingoyal in https://github.com/Netflix/metaflow/pull/2577

Full Changelog: https://github.com/Netflix/metaflow/compare/2.17.5...2.18.0

2.17.5 New feature
Notable features
  • Support for recursive conditionals on Argo Workflows
Full changelog

What's Changed

  • feature: support recursive conditionals on Argo Workflows by @saikonen in https://github.com/Netflix/metaflow/pull/2562
  • Bump version to 2.17.5 by @savingoyal in https://github.com/Netflix/metaflow/pull/2565

Full Changelog: https://github.com/Netflix/metaflow/compare/2.17.4...2.17.5

2.17.4 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • fix: DAG for default card with conditionals by @rsanteri in https://github.com/Netflix/metaflow/pull/2561
  • Fix/allow raise in user decos by @romain-intel in https://github.com/Netflix/metaflow/pull/2555
  • recursive conditionals with resume by @mt-ob in https://github.com/Netflix/metaflow/pull/2549
  • Bump metaflow version to 2.17.4 by @savingoyal in https://github.com/Netflix/metaflow/pull/2563

New Contributors

  • @rsanteri made their first contribution in https://github.com/Netflix/metaflow/pull/2561

Full Changelog: https://github.com/Netflix/metaflow/compare/2.17.3...2.17.4

2.17.3 Bug fix
Notable features
  • Conditionals for Argo Workflows
Full changelog

What's Changed

  • feature: conditionals for Argo Workflows by @saikonen in https://github.com/Netflix/metaflow/pull/2550
  • fix: disallow unsupported conditional DAG structures by @saikonen in https://github.com/Netflix/metaflow/pull/2556
  • fix: disable conditionals inside foreach on argo by @saikonen in https://github.com/Netflix/metaflow/pull/2559
  • chore: re-enable conditionals in foreach on argo workflows by @saikonen in https://github.com/Netflix/metaflow/pull/2560
  • patch release by @savingoyal in https://github.com/Netflix/metaflow/pull/2554

Full Changelog: https://github.com/Netflix/metaflow/compare/2.17.2...2.17.3

2.17.2 Bug fix

Fixed exception handling so user code errors are no longer silently dropped.

Full changelog

What's Changed

  • Feat/conditionals by @romain-intel in https://github.com/Netflix/metaflow/pull/2545
  • Fix an issue where user code exceptions were gobbled. by @romain-intel in https://github.com/Netflix/metaflow/pull/2548
  • patch release by @savingoyal in https://github.com/Netflix/metaflow/pull/2553

Full Changelog: https://github.com/Netflix/metaflow/compare/2.17.1...2.17.2

2.17.1 Bug fix

Fixed a subtle bug affecting Metaflow version output when public is True.

Full changelog

What's Changed

  • Bump tmp from 0.2.3 to 0.2.4 in /metaflow/plugins/cards/ui by @dependabot[bot] in https://github.com/Netflix/metaflow/pull/2536
  • fix: metaflow-dev improvements by @saikonen in https://github.com/Netflix/metaflow/pull/2527
  • [bug fix] fix subtle bug from #2463 by @valayDave in https://github.com/Netflix/metaflow/pull/2540
  • Fix bug in deployer reload logic by @talsperre in https://github.com/Netflix/metaflow/pull/2533
  • patch release by @savingoyal in https://github.com/Netflix/metaflow/pull/2541
  • [bug fix] fix subtle bug from netflix/metaflow#2463 by @valayDave in https://github.com/Netflix/metaflow/pull/2542
  • Fix bug in metaflow version when public=True by @talsperre in https://github.com/Netflix/metaflow/pull/2539

Full Changelog: https://github.com/Netflix/metaflow/compare/2.17.0...2.17.1

2.17.0 Breaking risk
⚠ Upgrade required
  • Existing flows continue to operate unchanged, but deploying with versions <2.17 alongside >=2.17 may create duplicate deployments if names exceeded the length limit.
  • Use `--name` CLI option or ensure flow class names are ≤63 characters when not using @project.
Breaking changes
  • Deployed workflow names longer than 63 characters are truncated when using @project; deployment fails without @project requiring a shorter name via --name flag.
Full changelog

Improvements

Argo Workflows name length restriction

This release introduces a limit to the workflow name lengths that are deployed to Argo Workflows.

Why was this necessary?

Argo Workflows attaches the workflow template name (the deployed flow name) as a label to the Kubernetes resources it creates when argo itself launches a flow (events, schedule, Argo UI). The problem is that Kubernetes labels have a maximum length of 63 characters, and if a workflow name is longer than that, it will fail to launch due to not fitting in the label.

Launching flows on Argo Workflows through the Metaflow CLI has always been exempt of this issue, as this has not tried to attach such a label to the resources.

What about existing flows?

Existing flows continue to operate as previously, and these can still be operated on with the Metaflow CLI commands, e.g. argo-workflows trigger/argo-workflows delete.

An existing flow will always be replaced when running argo-workflows create. With the new version this might also result in a differently named deployment, in case the old one had a name that was too long.

What happens with long names now?

When using the @project decorator, Metaflow will automatically truncate the deployed name if it is too long. A part of each name partial (project / branch / flow_name) is kept to help with finding the deployments in Argo UI.

If the name of the deployment is too long when deploying without @project, then this is treated as an error and it is up to the user to provide a shorter name. This can be done by either renaming the flow class, or by supplying a custom name with --name

⚠️ NOTE
Deploying the same flow with an older version of Metaflow will lead to two separate deployments existing at once if the length of the name exceeded the limit.
For such flows be sure to only deploy them with Metaflow versions >=2.17 or use the --name CLI option to specify a custom deploy name.

What's Changed

  • [cards] add attempt to default card. by @valayDave in https://github.com/Netflix/metaflow/pull/2532
  • address name contraction issues in argo-workflows create by @savingoyal in https://github.com/Netflix/metaflow/pull/2082
  • release: 2.17.0 by @saikonen in https://github.com/Netflix/metaflow/pull/2535

Full Changelog: https://github.com/Netflix/metaflow/compare/2.16.8...2.17.0

2.16.8 Bug fix

Fixed eventing issues in @parallel workflows.

Full changelog

What's Changed

  • [argo] Fix eventing for @parallel based workflow by @valayDave in https://github.com/Netflix/metaflow/pull/2516
  • patch release by @savingoyal in https://github.com/Netflix/metaflow/pull/2529

Full Changelog: https://github.com/Netflix/metaflow/compare/2.16.7...2.16.8

2.16.7 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • get_triggered_run for argo by @mt-ob in https://github.com/Netflix/metaflow/pull/2522
  • fix up imghdr import by @savingoyal in https://github.com/Netflix/metaflow/pull/2524
  • add wrapping to echo by @savingoyal in https://github.com/Netflix/metaflow/pull/2523
  • Fix/runner packaging by @romain-intel in https://github.com/Netflix/metaflow/pull/2507
  • vendor pure pythonic pyyaml by @savingoyal in https://github.com/Netflix/metaflow/pull/2525
  • patch release by @savingoyal in https://github.com/Netflix/metaflow/pull/2526

Full Changelog: https://github.com/Netflix/metaflow/compare/2.16.6...2.16.7

2.16.6 Bug fix

Fixed a subtle bug reported in netflix/metaflow#2463.

Full changelog

What's Changed

  • backward compatibility for generate_fake_flow_file_contents by @mt-ob in https://github.com/Netflix/metaflow/pull/2511
  • [bug fix] fix subtle bug from netflix/metaflow#2463 by @valayDave in https://github.com/Netflix/metaflow/pull/2513
  • Bump form-data from 4.0.2 to 4.0.4 in /metaflow/plugins/cards/ui by @dependabot[bot] in https://github.com/Netflix/metaflow/pull/2514
  • patch release by @savingoyal in https://github.com/Netflix/metaflow/pull/2517

Full Changelog: https://github.com/Netflix/metaflow/compare/2.16.5...2.16.6

2.16.5 Maintenance
Notable features
  • Added `list_deployed_flows` for Argo
Full changelog

What's Changed

  • Fixes tolerations typehint by @Winterflower in https://github.com/Netflix/metaflow/pull/2502
  • add list_deployed_flows for argo by @mt-ob in https://github.com/Netflix/metaflow/pull/2508
  • [cards] remove imghdr warnings by @valayDave in https://github.com/Netflix/metaflow/pull/2509
  • patch release by @savingoyal in https://github.com/Netflix/metaflow/pull/2510

New Contributors

  • @Winterflower made their first contribution in https://github.com/Netflix/metaflow/pull/2502

Full Changelog: https://github.com/Netflix/metaflow/compare/2.16.4...2.16.5

2.16.4 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • [bug fix] fix subtle bug from netflix/metaflow#2463 by @valayDave in https://github.com/Netflix/metaflow/pull/2498
  • patch release by @savingoyal in https://github.com/Netflix/metaflow/pull/2500

Full Changelog: https://github.com/Netflix/metaflow/compare/2.16.3...2.16.4

2.16.3 Bug fix

Fixed regression with default notifications on Argo Workflows.

Full changelog

What's Changed

  • fix: regression with default notifications on argo workflows by @saikonen in https://github.com/Netflix/metaflow/pull/2496
  • release: 2.16.3 by @saikonen in https://github.com/Netflix/metaflow/pull/2497

Full Changelog: https://github.com/Netflix/metaflow/compare/2.16.2...2.16.3

2.16.2 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • retry 500s too for service by @savingoyal in https://github.com/Netflix/metaflow/pull/2493
  • fix: kubernetes imagePullSecrets support for argo workflows by @saikonen in https://github.com/Netflix/metaflow/pull/2494
  • patch release by @savingoyal in https://github.com/Netflix/metaflow/pull/2495

Full Changelog: https://github.com/Netflix/metaflow/compare/2.16.1...2.16.2

2.16.1 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • fix: uv bootstrapping by @saikonen in https://github.com/Netflix/metaflow/pull/2491
  • Fix/packaging mopup by @romain-intel in https://github.com/Netflix/metaflow/pull/2490
  • release: 2.16.1 by @saikonen in https://github.com/Netflix/metaflow/pull/2492

Full Changelog: https://github.com/Netflix/metaflow/compare/2.16.0...2.16.1

2.16.0 Maintenance
Notable features
  • New packaging support
Full changelog

What's Changed

  • New packaging support by @saikonen in https://github.com/Netflix/metaflow/pull/2487
  • [WIP] Feat/user decorators v2 by @romain-intel in https://github.com/Netflix/metaflow/pull/2463
  • Minor release by @savingoyal in https://github.com/Netflix/metaflow/pull/2488

Full Changelog: https://github.com/Netflix/metaflow/compare/2.15.21...2.16.0

2.15.21 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • feature: increase argo exit hook resources by @saikonen in https://github.com/Netflix/metaflow/pull/2484
  • release: 2.15.21 by @saikonen in https://github.com/Netflix/metaflow/pull/2486

Full Changelog: https://github.com/Netflix/metaflow/compare/2.15.20...2.15.21

2.15.20 Breaking risk
Breaking changes
  • Renamed function `get_secrets` to `get_secret`
Full changelog

What's Changed

  • fix: change get_secrets to get_secret by @saikonen in https://github.com/Netflix/metaflow/pull/2482
  • prep patch release by @savingoyal in https://github.com/Netflix/metaflow/pull/2483

Full Changelog: https://github.com/Netflix/metaflow/compare/2.15.19...2.15.20

2.15.19 New feature
Notable features
  • Support custom exit hooks
  • Introduce secrets function
Full changelog

What's Changed

  • vendor imghdr into metaflow by @valayDave in https://github.com/Netflix/metaflow/pull/2467
  • Fixup how commands show up as part of the Runner API by @romain-intel in https://github.com/Netflix/metaflow/pull/2468
  • [cards] support writing metadata by @valayDave in https://github.com/Netflix/metaflow/pull/2452
  • Fix IMDSv2 Error by @tlee14-upstart in https://github.com/Netflix/metaflow/pull/2470
  • [stubs] support for TypedDicts by @valayDave in https://github.com/Netflix/metaflow/pull/2478
  • Revert "[stubs] support for TypedDicts" by @savingoyal in https://github.com/Netflix/metaflow/pull/2479
  • [stubs] support for TypedDicts by @savingoyal in https://github.com/Netflix/metaflow/pull/2480
  • feature: support custom exit hooks by @saikonen in https://github.com/Netflix/metaflow/pull/2446
  • feature: Introduce secrets function by @saikonen in https://github.com/Netflix/metaflow/pull/2122
  • prep patch release by @savingoyal in https://github.com/Netflix/metaflow/pull/2481

Full Changelog: https://github.com/Netflix/metaflow/compare/2.15.18...2.15.19

2.15.18 New feature
Notable features
  • Ability to force rebuild @conda/@pypi environments via --force-rebuild-environments flag
Full changelog

Features

Ability to force rebuild @conda/@pypi environments

This release adds the ability to force rebuild environments, which can be used to try solve environment resolution related issues

Simply apply the new flag to trigger a rebuild

python HelloConda.py --environment conda --force-rebuild-environments run

What's Changed

  • [cards] remove dual write by @valayDave in https://github.com/Netflix/metaflow/pull/2453
  • remove references to dual writes in card datastore by @savingoyal in https://github.com/Netflix/metaflow/pull/2458
  • remove card dual writes by @savingoyal in https://github.com/Netflix/metaflow/pull/2457
  • feature: alternate approach to environment force-rebuild by @saikonen in https://github.com/Netflix/metaflow/pull/2443
  • release: 2.15.18 by @saikonen in https://github.com/Netflix/metaflow/pull/2465

Full Changelog: https://github.com/Netflix/metaflow/compare/2.15.17...2.15.18

2.15.17 Bug fix
Notable features
  • Added support for Kubernetes image pull secrets
Full changelog

What's Changed

  • Two fixes: runner/deployer with configs and None config by @romain-intel in https://github.com/Netflix/metaflow/pull/2454
  • feat: kubernetes image pull secrets by @nschmeller in https://github.com/Netflix/metaflow/pull/2400
  • bump version by @savingoyal in https://github.com/Netflix/metaflow/pull/2455

New Contributors

  • @nschmeller made their first contribution in https://github.com/Netflix/metaflow/pull/2400

Full Changelog: https://github.com/Netflix/metaflow/compare/2.15.16...2.15.17

2.15.16 Maintenance

Minor fixes and improvements.

Full changelog

What's Changed

  • fix: boto3 client configuration handling in client_params by @yg7445 in https://github.com/Netflix/metaflow/pull/2412
  • Add retry to compute_info in Metadata service by @tlee14-upstart in https://github.com/Netflix/metaflow/pull/2433
  • move the generate_fake content_to deployer.py by @Qianh1225 in https://github.com/Netflix/metaflow/pull/2430
  • S3 tests dev stack using minio by @madhur-ob in https://github.com/Netflix/metaflow/pull/2445
  • Fix stub generator by @npow in https://github.com/Netflix/metaflow/pull/2447
  • bump version to 2.15.16 by @talsperre in https://github.com/Netflix/metaflow/pull/2450

New Contributors

  • @yg7445 made their first contribution in https://github.com/Netflix/metaflow/pull/2412
  • @tlee14-upstart made their first contribution in https://github.com/Netflix/metaflow/pull/2433
  • @Qianh1225 made their first contribution in https://github.com/Netflix/metaflow/pull/2430

Full Changelog: https://github.com/Netflix/metaflow/compare/2.15.15...2.15.16

Beta — feedback welcome: [email protected]