Last updated: October 17, 2022.
It’s been a couple of weeks, so it’s time for a new release! 0.9.0 brings two whole new orchestrators, one of which was contributed by a community member just one day after we unveiled new documentation for orchestrator extensibility! The release also includes a new secrets manager, a Slack integration and a bunch of other smaller changes across the codebase. (Our new orchestrators are exciting enough that they’ll get their own blog posts to showcase their strengths in due course.)
Beyond this, as usual we included a number of smaller bugfixes and documentation changes to cumulatively improve experience of using ZenML as a user. For a detailed look at what’s changed, give our full release notes a glance.
Who says you need complicated infrastructure setup to run your pipeline? Just use GitHub Actions. With this new addition to ZenML’s ever-growing list of built-in orchestrators, you can run your pipelines using GitHub Actions to manage the dependencies between steps.
You wouldn’t want your secrets floating around openly in your code commits, so we made sure to integrate with the way GitHub stores secrets as encrypted environment variables.
Needless to say, the GitHub Actions orchestrator is an exciting new addition to ZenML that will help you get going with your deployed pipelines even faster. Let us know if you are excited by this new integration!
We previously added a way to run individual steps on Vertex AI as step operators. One of our amazing community members, Gabriel Martín Blázquez, has added a way to orchestrate your entire pipelines using Vertex AI Pipelines.
The most exciting thing about this new orchestrator is that it came as a direct result of our documentation and extensibility improvements in our last release. We look forward to seeing what other integrations users add to their stacks…
Our community-focused ZenHack day included a number of features that were implemented alongside one another. Among those was a ChatOps-inspired Alerter component, with Slack as its first inbuilt implementation.
You can now define interfaces where you can interact with and make decisions around how your steps get executed through Slack commands. Because seriously, who’d rather do this in the terminal when you can get a friendly Slack ping instead?
We also implemented an Azure Secrets Manager integration, completing our cloud secrets manager coverage. We’ve got a cloud-agnostic implementation of this in the works, but more about that next release!
Barely a release passes without some user-facing CLI improvements, and this one is no exception. We added two small changes that just might bring a bit of UI 🌞 to your day:
zenml stack copycommand.
User-facing documentation is really important for us at ZenML, and we keep our main documentation page up-to-date. With the latest release, we’ve made sure we’re just as consistent with the internal code documentation in the form of docstrings. We’ve added CI checks using
darglint that ensure that all our functions and modules include correct and consistently presented docstrings.
We switched out how we check for spelling errors, too, and we’re now using
pyspelling everywhere to make sure we stay typo-free!
This release includes a number of other smaller documentation fixes and additions.
The latest release include several smaller features and updates to existing functionality:
pip install zenml[server].
src/zenmldirectory, notably for the
utilsmodule and for all the cloud integrations.
We received several new community contributions during this release cycle. We mentioned Gabriel’s Vertex AI orchestrator above already, but we also saw the following contributions:
Join our Slack to let us know if you have an idea for a feature or something you’d like to contribute to the framework.
We have a new home for our roadmap where you can vote on your favorite upcoming feature or propose new ideas for what the core team should work on. You can vote without needing to log in, so please do let us know what you want us to build!