I will fix and optimize etl data pipelines with airflow or nifi

Sommige informatie wordt in het Engels weergegeven.

Pakistan

Ik spreek Engels, Urdu, Punjabi, Duits

Big Data Engineer

Senior Data Engineer with 7+ years building production-grade data pipelines and lakehouses for enterprise clients. I specialize in Apache NiFi, Airflow, Spark ETL, and data warehouse design using Hive...
Over deze dienst

Is your data pipeline unreliable, slow, or just not built yet? I'll design and deliver a production-ready pipeline tailored to your architecture.

What I offer:

  • Apache NiFi pipeline design and deployment (Docker or Kubernetes)
  • Airflow DAG development scheduling, retries, alerting, dependencies
  • PySpark and Spark SQL ETL jobs for large-scale data transformation
  • Ingestion from REST APIs, SAP OData, S3/MinIO, databases and flat files
  • Custom NiFi processors in Java for complex business logic

Why work with me:

  • 7+ years of real enterprise experience building pipelines for German corporate clients
  • I've built pipelines handling millions of records across complex multi-source architectures
  • Every delivery includes error handling, logging and documentation not just working code

I do NOT do:

  • Quick copy-paste solutions
  • Tutorials repackaged as deliverables

Not sure what you need? Message me for a free 15-minute architecture consultation.

Bestemmingsplatform:

PostgreSQL

•

Oracle Database / Exadata

Tools & platforms:

Kafka Connect

•

Oracle GoldenGate

Mijn portfolio