It is used for the scheduling and orchestration... - Deepstash
Machine Learning With Google

Learn more about computerscience with this collection

Understanding machine learning models

Improving data analysis and decision-making

How Google uses logic in machine learning

Machine Learning With Google

Discover 95 similar ideas in

It takes just

14 mins to read

It is used for the scheduling and orchestration of data pipelines or workflows as directed acyclic graphs (DAGs) of tasks.

6

45 reads

MORE IDEAS ON THIS

"Airflow is a platform to programmatically author, schedule and monitor workflows"

6

51 reads

 The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies.

6

35 reads

The rich user interface makes it easy to visualize pipelines running in production, monitor progress, and troubleshoot issues when needed.

6

40 reads

What are the principles of Airflow?

  • Dynamic : pipelines are configuration as code, allowing for dynamic pipeline generation. This allows for writing code that instantiates pipelines dynamically.
  • Extensible : Easily define your operators, executors and extend the library so that it fits...

8

48 reads

Related collections

More like this

Identifying and collecting data

Ask questions, such as.

  • What data is needed to solve the business problem?
  • What quantity of data is required?
  • Do you have enough data to build a model?
  • Do you need more data to extend the existing data?
  • Ho...

Laying the groundwork for digital dexterity

  • Leaders need to communicate the organisations need for digital dexterity.
  • They should ensure that workflows, incentives, budgets, and policies promote digital dexterity.
  • Organisations should build digital capabilities such as collabor...

Improving sticky workflows

Once you've implemented your workflow, continue to analyze your process to see how effective it is. Metics to look at:

  • How often the workflow is initiated
  • How often it's completed
  • How long it takes to perform tasks in the workflow
  • Ho...

Read & Learn

20x Faster

without
deepstash

with
deepstash

with

deepstash

Access to 200,000+ ideas

Access to the mobile app

Unlimited idea saving & library

Unlimited history

Unlimited listening to ideas

Downloading & offline access

Personalized recommendations

Supercharge your mind with one idea per day

Enter your email and spend 1 minute every day to learn something new.

Email

I agree to receive email updates