2.5.3 (Mar 7, 2022)

Metaflow 2.5.3 Release Notes

The Metaflow 2.5.3 release is a minor release.

Fixes

• Fix "Too many symbolic links" error when using Conda + Batch on MacOS by @bishax in #972
• Emit app tag for AWS Batch jobs ( #970 )

Full Changelog: 2.5.2...2.5.3

2.5.2 (Feb 16, 2022)

Metaflow 2.5.2 Release Notes

The Metaflow 2.5.2 release is a minor release.

Improvements

• follow symlinks when creating code packages #958

Full Changelog: 2.5.1...2.5.2

2.5.1 (Feb 15, 2022)

Metaflow 2.5.1 Release Notes

The Metaflow 2.5.1 release is a minor release.

New Features

• Introduce Mamba as a dependency solver for @conda in #918 . Mamba promises faster package dependency resolution times, which should result in an appreciable speedup in flow environment initialization. It is not yet enabled by default; to use it you need to set METAFLOW_CONDA_DEPENDENCY_RESOLVER to mamba in Metaflow config.

Improvements

• Vendor in click to reduce chances of dependency conflicts with user code in #929

Full Changelog: 2.5.0...2.5.1

2.5.0 (Jan 25, 2022)

Metaflow 2.5.0 Release Notes

The Metaflow 2.5.0 release is a minor release.

New Features

✨ Metaflow cards are now publicly available! For details, see a new section in the documentation, Visualizing Results, and a release blog post.

Bug Fixes

• Fix issue in Step Functions integration with CLI defined decorators ( #920 )
• Fix compute_resources to take into account string values ( #919 )

Full Changelog: 2.4.9...2.5.0

2.4.9 (Jan 18, 2022)

Metaflow 2.4.9 Release Notes

The Metaflow 2.4.9 release is a patch release.

Improvements

• Store information about the DAG being executed in an artifact. This will allow to render execution DAG in a @card ( #822 )

Bug Fixes

• Fixed cli command when task_id provided ( by @zhugejun in #890 )
• Fix with metadata syncing on AWS Batch when running without remote metadata service ( #902 )
• Fix default resource math. Previously we sometimes computed vCPU and memory settings incorrectly, in cases when they were set to something less than the default value ( #810 , fixes #467 )

Full Changelog: 2.4.8...2.4.9

2.4.8 (Jan 10, 2022)

Metaflow 2.4.8 Release Notes

The Metaflow 2.4.8 release is a patch release.

Bug fixes

• aws_retry's S3_RETRY_COUNT now has to be >=1 ( #876 )
• fix argument type handling for host_volumes when used with --with and Step Functions ( #884 )

Improvements

• Improved validation logic to capture reserved keywords ( #830 fixes #589 )
• Remove default use of repo.anaconda.com (#832 )

Full Changelog: 2.4.7...2.4.8

2.4.7 (Dec 16, 2021)

Metaflow 2.4.7 Release Notes

The Metaflow 2.4.7 release is a patch release. We skipped 2.4.6 for technical reasons.

Improvements

• added plumbing for @card decorator
• added plumbing to support distributed training on GPUs

Full Changelog: 2.4.5...2.4.7

2.4.6 (Dec 16, 2021)

Metaflow 2.4.6 Release Notes

The Metaflow 2.4.6 release is a patch release.

Improvements

• added plumbing for @card decorator
• added plumbing to support distributed training on GPUs

Full Changelog: 2.4.5...2.4.6

2.4.5 (Dec 8 2021)

Metaflow 2.4.5 Release Notes

The Metaflow 2.4.5 release is a patch release.

Bug fixes

• Address an issue with load_artifacts ( #833 , fixes #819 )
• Fixed mflog stream redirection in Step Functions ( #851 )

Full Changelog: 2.4.4...2.4.5

2.4.4 (Nov 29 2021)

Metaflow 2.4.4 Release Notes

The Metaflow 2.4.4 release is a patch release.

• Improvements
  • Add default image config option as described in #489 (#813)
  • Read default k8s namespace from config (#823)
• Bug Fixes
  • Fixed a couple of issues in S3 error handling (#821)
  • Fixed an issue with load_artifacts when several artifacts have the same name (
    #817)
• Misc internal improvements
  • Pipe logs to $cwd/.logs instead of /logs for @batch & @kubernetes (#807)
  • mflog changes for supporting AWS Lambda (#801)
  • Add 'last modified' to S3 object (#778)

Improvements

Add default image config option as described in #489 (#813)

We're moving to a more consistent scheme for naming options related to docker images. You can read the details in #489, but this release introduces new config options DEFAULT_CONTAINER_IMAGE and DEFAULT_CONTAINER_REGISTRY that can be used to specify docker image in addition to plugin-specific options like KUBERNETES_CONTAINER_IMAGE

Read default k8s namespace from config (#823)

This adds a new configuration option to set the default namespace for the Kubernetes plugin