I will build data pipelines and platforms on gcp, AWS, and azure

I'm a data engineer with 10+ years of experience specializing in Apache Airflow, Apache Spark, BigQuery, and Snowflake. I have expertise in building ETL pipelines using Python and can work with APIs, databases, and flat files as data sources. I have deployed pipelines on major cloud platforms including AWS, Google Cloud, and Azure. I have also worked on CDC pipelines using Kafka and Spark Streaming/Meltano.

With strong analytical skills and a background in data analytics and machine learning, I have worked in various industries including contact center software development, cybersecurity, fintech, and ride-hail.

I can help you with data platform architecture, building data platforms, building data marts at scale using Spark and Hive, orchestration of pipelines using Airflow/Dagster/Mage, and deployments of data platforms on AWS and GCP. Additionally, I have experience with version control and CICD tools like GitHub, GitLab, and Jenkins. Slack/Twillio/Google Chat Integration for monitoring.

Set up Stitch, Talend, Ascend, Fivetran for managed platforms and build custom connectors.

Let's collaborate to solve your data engineering needs.

Please don't put an order without a discussion.