How to call webhooks upon task success or failure

Although Airflow can send an email upon task failure, sometime it's not good enough for you. You may have other kind of communication channels like Slack, or you may just want to post it to the SNS like Twitter. In this case, on_success_callback and on_failure_callback could be a good choice. These callback functions are called… Continue reading How to call webhooks upon task success or failure

Understanding Apache Airflow Job Scheduling

Apache Airflow is a platform to programmatically author, schedule and monitor workflows. For whom has lots of scheduled jobs to run, Airflow is quite a mind-blowing platform. Although it also has some weird points, I think the good overcomes the bad. Among the many characteristics of Airflow, let's focus on job scheduling here. Actually, setting… Continue reading Understanding Apache Airflow Job Scheduling