I will build your etl data pipeline using python, sql and apache airflow

Sommige informatie wordt in het Engels weergegeven.

India

Ik spreek Engels

Data Engineer for ETL Pipelines, Python and SQL Automation

Data Engineer at Ksolves India Ltd., securing large-scale Big Data infrastructure powering production Hadoop clusters. I've architected a Redis high-availability layer supporting 5M+ concurrent users ...
Over deze dienst

I build reliable, production-grade ETL/ELT pipelines that move and transform your data without errors or downtime. In my current role as a Data Engineer, I've engineered pipelines syncing billions of records between systems with real-time deduplication, full and delta sync, and zero data loss in production, and built Apache NiFi clusters handling continuous enterprise data integration.


Whether you need a simple script to move data from a CSV into a database, or a scheduled pipeline that pulls from an API and loads it into your warehouse, I will design it to be clean, documented, and easy to hand off to your team.


What I can help with: data extraction from APIs, databases, or files; transformation and cleaning; deduplication and upsert logic; scheduled and automated syncs; and migration between databases such as MySQL, SQL Server, and PostgreSQL.


I bring the same reliability I use in production systems supporting millions of users to every project here. Clear communication and clean, well-documented code are always part of the delivery.

Bestemmingsplatform:

PostgreSQL

•

MySQL

•

Microsoft SQL Server

Tools & platforms:

Kafka Connect

•

Apache NiFi

Gerelateerde tags