- Published on
All Posts
I write mostly about development, data engineering, tech related, and sometime about my personal life. Use the search below to filter by title.
- Published on
Async - Millions of API extract using Python - ETL (Local to Bigquery)- Published on
Scala, Python, and Java are all popular programming languages, each with its own strengths and weaknesses. The choice between them depends on factors such as project requirements, ecosystem, performance needs, and personal preference.- Published on
Apache Airflow instructions for setting up Apache Airflow with Postgresql, Celery and Rabbitmq on macOS- Published on
Apache Airflow instructions for setting up Apache Airflow on macOS- Published on
Kafka Concepts and other related entities- Published on
Easy way to setup spark and jupyter in the local- Published on
Docker Concepts - What is docker? and other related entities.- Published on
Mkdocs for quick static website generator- Published on
Docker Cheatsheet - Commands- Published on
Docker Concepts - What is docker? and other related entities.- Published on
PoC for sending alerts and notifications to slack channel using python- Published on
Interesting scenario while working on the UPSERT Logic and Star Schema - ETL Batch Load?- Published on
- Published on
The email template gives us an idea about the error before moving to the cloud watch logs and reduces our time in searching error log stream.