Overview¶
Elyra is a set of AI-centric extensions to JupyterLab Notebooks.
Elyra currently includes:
- AI Pipelines visual editor
- Ability to run a notebook as a batch job
- Reusable Code Snippets
- Hybrid runtime support
- Python script execution support
- Notebook versioning based on git integration
- Notebook navigation using auto-generated Table of Contents
- Reusable configuration for runtimes
AI Pipelines visual editor¶
Building an AI pipeline for a model is hard, breaking down and modularizing a pipeline is harder. A typical machine/deep learning pipeline begins as a series of preprocessing steps followed by experimentation/optimization and finally deployment. Each of these steps represent a challenge in the model development lifecycle.
Elyra provides a Pipeline Visual Editor for building AI pipelines from notebooks and Python scripts, simplifying the conversion of multiple notebooks or Python scripts into batch jobs or workflow.
Currently, pipelines can be executed locally or on Kubeflow Pipelines.
Learn more about the Pipeline Visual Editor in the user guide or explore the tutorials.
Ability to run a notebook as a batch job¶
Elyra also extends the notebook UI to simplify the submission of a single notebook as a batch job
Reusable Code Snippets¶
Elyra supports the Code Snippet feature. This allows users to manipulate reusable pieces of code, making programming in JupyterLab more efficient by reducing repetitive work.
For more information on how to configure code snippets metadata see Elyra Code Snippets
Hybrid runtime support¶
Elyra leverages Jupyter Enterprise Gateway to enable Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes, OpenShift, and the like.
It simplifies the task of running notebooks interactively on cloud machines, seamlessly leveraging the power of cloud-based resources such as GPUs and TPUs.
Python script execution support¶
Elyra exposes Python Scripts as first-class citizens, introducing the ability to create python scripts directly from the workspace launcher, and leveraging the Hybrid Runtime Support to allow users to locally edit their scripts and execute them against local or cloud-based resources seamlessly.
Notebook versioning based on git integration¶
The integrated support for git repositories simplify tracking changes, allowing rollback to working versions of the code, backups and, most importantly, sharing among team members - fostering productivity by enabling a collaborative working environment.
Reusable configuration for runtimes¶
Elyra introduces a ‘shared configuration service’ that simplifies workspace configuration management, enabling things like external runtime access details to be configured once and shared across multiple components.