I will build data pipelines using databricks, pyspark, azure and sql

Sommige informatie wordt in het Engels weergegeven.

India

Ik spreek Hindi, Engels

Senior Data Engineer

I am a dependable and creative Senior Data Engineer with over 5 years of enterprise-scale experience. I specialize in building reliable, cost-effective ETL solutions using PySpark, Azure Data Factory,...

Over deze dienst

I will build, optimize, or troubleshoot data pipelines using Databricks, PySpark, Azure Data Factory, Azure Data Lake, Delta Lake, and SQL.

With 5+ years of enterprise data engineering experience, I can help you turn raw data into reliable, scalable, and maintainable data pipelines.

My services include:

ETL/ELT pipeline development

Databricks & PySpark development

Azure Data Factory orchestration

Data ingestion and transformation

SQL development and optimization

Delta Lake solutions

Batch and incremental processing

Data quality checks and validation

Pipeline troubleshooting and optimization

Data migration to Databricks

Unit testing and technical documentation

Whether you need a new pipeline, want to fix an existing workflow, or need help modernizing a data platform, I can work with your existing architecture and requirements.

I focus on clean implementation, scalable Spark processing, reliable data workflows, and clear documentation.

Please message me before placing an order with your requirements, source/target details, and expected deliverables so I can confirm the scope and recommend the appropriate package.

build data pipelines using databricks, pyspark, azure and sql

Volledig scherm

build data pipelines using databricks, pyspark, azure and sql

Bestemmingsplatform:

Azure Synapse Analytics

Tools & platforms:

Azure Data Factory

•

Overige

Veelgestelde vragen

1. What technologies do you work with?

Databricks, PySpark, Azure Data Factory, Azure Data Lake, Delta Lake, SQL, and related Azure data services.

2. Can you build a complete ETL pipeline?

Yes. Depending on the package, I can handle ingestion, transformation, orchestration, data quality checks, testing, and documentation.

3. Can you fix an existing Databricks or PySpark pipeline?

Yes. I can troubleshoot errors, review existing code, identify bottlenecks, and implement improvements.

4. Can you migrate existing pipelines to Databricks?

Yes. I can help migrate and modernize existing data workloads using Databricks, PySpark, and Delta Lake.

5. What information do you need to start?

Please provide your requirements, source and target systems, sample data/schema where applicable, existing code or pipelines, and expected output.

6. Can you handle custom requirements?

Yes. If your requirement doesn't fit the listed packages, please contact me first so we can define the scope and create a custom offer.

Gerelateerde tags