New ask Hacker News story: Ask HN: Favorite examples of publicly available Airflow repos?
Ask HN: Favorite examples of publicly available Airflow repos?
3 by debo_ | 0 comments on Hacker News.
Hi folks, I'm just starting on an Airflow-powered project for what I imagine is a pretty standard ETL setup. The "L" is to an 3rd party service for analytics, rather than just to another database table. Regardless of how you may feel about that, I'd like to end up with something sane a year from now. Do you have any good public examples of good Airflow practices? I've read a lot of the docs and watched some more "advanced" Udemy coursework, but I'm particularly looking to get a feel for stuff like: Where do you put large intermediate results between tasks? How do you organize your DAGs? How much of your work is just blitting CSVs around? :) Any pointers would be welcomed, thanks.
3 by debo_ | 0 comments on Hacker News.
Hi folks, I'm just starting on an Airflow-powered project for what I imagine is a pretty standard ETL setup. The "L" is to an 3rd party service for analytics, rather than just to another database table. Regardless of how you may feel about that, I'd like to end up with something sane a year from now. Do you have any good public examples of good Airflow practices? I've read a lot of the docs and watched some more "advanced" Udemy coursework, but I'm particularly looking to get a feel for stuff like: Where do you put large intermediate results between tasks? How do you organize your DAGs? How much of your work is just blitting CSVs around? :) Any pointers would be welcomed, thanks.
Comments
Post a Comment