I will build a databricks pyspark etl pipeline

Sommige informatie wordt in het Engels weergegeven.

Pakistan

Ik spreek Engels, Urdu

Python and Data Engineer Web Scraping ETL Pipelines SQL AI Video Genrator

CS student at FUUAST Karachi, specializing in Python, SQL & Data Engineering I help businesses with: ✅ Web Scraping & Data Extraction ✅ ETL Pipelines (Extract, Transform, Load) ✅ Data Cleaning & Anal...
Over deze dienst

Have raw data stuck in CSV files, APIs or messy tables? I'll turn it into clean, analytics-ready tables using Databricks, PySpark and Delta Lake with the Medallion (Bronze, Silver, Gold) architecture.


What you get:

Bronze layer: raw data ingested safely, nothing lost

Silver layer: cleaned, deduplicated and standardized data

Gold layer: business-ready tables for reports and dashboards

Well-commented PySpark and SQL notebooks

Data quality checks (nulls, duplicates, wrong formats)

Simple documentation so your team can maintain it


My proof: I built an end-to-end Databricks project that processed over 51,000 records through all three Medallion layers. I'm a micro1 Certified Data Engineer with Cloud Data Engineer training (Python, SQL, AWS, Snowflake, Spark).


Note: the pipeline runs in YOUR Databricks workspace so you own your data. A free Databricks account is enough for small projects.


Message me before ordering with your data source and goal, and I'll recommend the right package.

Taal:

Engels

Technische expertise:

dbt (Data Build Tool)

•

Apache Airflow

Expertise:

Datapijplijnen

•

ETL-ontwikkeling

•

Datawarehousing

Branche:

Crypto en blockchain

•

Gegevensanalyse

Mijn portfolio

Andere Data engineering diensten die ik aanbied