Published onMarch 25, 2025Experimenting with Node.js - Part 01#node.js#javascriptExperimenting with Node.js - Part 01
Published onMarch 25, 2025Experimenting with Node.js - Part 02#node.js#javascriptExperimenting with Node.js - Part 02
Published onMarch 25, 2025Experimenting with Node.js - Sending Email using the html template#node.js#gmail#api#javascriptExperimenting with Node.js - Sending Email using the html template
Published onNovember 21, 2024Syncing Between GCS Buckets in Google Cloud using Composer (Airflow)#data-engineering#apache-airflow#google-cloud#composer#etl#slack#validationETL from Google Cloud Storage (Avro - daily, hourly) files to Bigquery using Airflow (Google Cloud Composer)
Published onAugust 17, 2024Demo: ETL from GCS to BigQuery using Composer(Airflow)#data-engineering#apache-airflow#google-cloud#composer#etl#slack#validationETL from Google Cloud Storage (Avro - daily, hourly) files to Bigquery using Airflow (Google Cloud Composer)
Published onApril 23, 2024BigQuery - Creating Primary Key/Foreign Key in Terraform#terraform#google-cloud#bigqueryExample
Published onApril 22, 2024Async - Millions of API extract using Python - ETL (Local to Bigquery) #python#async#api#scrappingAsync - Millions of API extract using Python - ETL (Local to Bigquery)
Published onMarch 28, 2024Which is Best Programming Language? Java vs Scala vs Python#data-engineering#languages#python#scala#javaScala, Python, and Java are all popular programming languages, each with its own strengths and weaknesses. The choice between them depends on factors such as project requirements, ecosystem, performance needs, and personal preference.
Published onMarch 21, 2024Part 2: Apache Aiflow setup with Postgresql, Celery and Rabbitmq (MacOs, Apple)#data-engineering#apache-airflow#macosApache Airflow instructions for setting up Apache Airflow with Postgresql, Celery and Rabbitmq on macOS
Published onMarch 14, 2024Part 1: Apache Aiflow setup (MacOs, Apple)#data-engineering#apache-airflow#macosApache Airflow instructions for setting up Apache Airflow on macOS
Published onDecember 28, 2022Kafka Concepts and other related entities#data-engineering#apache-kafka#concepts#architecture#takeawaysKafka Concepts and other related entities
Published onDecember 27, 2022Docker - Setup Spark, Jupyter binding local folder in hostmachine#docker#container#spark#jupyter#exampleEasy way to setup spark and jupyter in the local
Published onDecember 25, 2022Docker Practical Example#docker#container#practice#exampleDocker Concepts - What is docker? and other related entities.
Published onDecember 23, 2022Mkdocs for quick static website generator#mkdocs#python#template#toolsMkdocs for quick static website generator
Published onDecember 22, 2022Docker Commands - Cheatsheet#docker#container#practice#example#cheatsheetDocker Cheatsheet - Commands