I will build azure data factory and databricks etl pipelines

Sommige informatie wordt in het Engels weergegeven.

India

Ik spreek Engels

Azure Databricks and Microsoft Fabric Data Engineer

Technical Lead Data Engineer with 4+ years building production data platforms on Azure, Databricks and Microsoft Fabric. I build lakehouses (bronze/silver/gold) with PySpark, Delta Lake, Azure Data Fa...
Over deze dienst

Need data moved, cleaned and ready for reporting? I build reliable ETL pipelines on Azure Data Factory and Databricks (PySpark, Delta Lake).


I'm a Technical Lead Data Engineer with 4+ years of production experience. Recent work: Spark jobs processing 5TB+ daily (30% faster), 15+ ADF pipelines moving 1.2M+ records a day, and a metadata-driven framework that cut new-source onboarding by 70%.


What I can build:

  • Ingestion from SQL Server, APIs, files (CSV, Excel, JSON), SharePoint or cloud storage
  • Bronze/silver/gold (medallion) lakehouse layers with Delta tables
  • Incremental loads, SCD Type 2, logging and retry handling
  • Data quality checks and failure alerts
  • Loads into Databricks, Snowflake, Azure SQL, Synapse or Microsoft Fabric

What you get: working pipeline code in your environment, a short run guide, and a walkthrough call if needed.


Please message me before ordering with your sources, destination and data size, so I can confirm the right package.

Bestemmingsplatform:

Snowflake

•

Azure Synapse Analytics

Tools & platforms:

Microsoft SSIS

•

Azure Data Factory

•

Overige

Andere Data engineering diensten die ik aanbied