Airflow is a tool used for workflow orchestration by creating Directed Acyclic Graph (DAG). The platform also features a scheduler which runs tasks across a series of workers. Using the UI you are able to monitor tasks and dependencies. RO Labs makes it fast and easy to get started with Apache Airflow
RO Labs provides two offerings for Apache Airflow: Standalone and Performance
- Standalone: Standalone should be use for development purposes only. This can be used to get a feel for Airflow and if it meets the needs for your organization.
- Performance: Allows for multithreaded jobs, includes and embedded PostgreSQL database, and Redis cache to fully get the most out of Apache Airflow. This can be viewed as a more production ready instance of Apache Airflow.