s
satish_sp

Satish P

@satish_sp

Data Engineer

India
Engels
Sommige informatie wordt in het Engels weergegeven.
Over mij
I am a Data Engineer with 5+ years of experience designing and developing scalable data pipelines, ETL frameworks, and data lake architectures across AWS and Azure cloud platforms. I have strong expertise in Python, PySpark, SQL, Apache Spark, Databricks, Snowflake, and Apache Airflow.... Lees meer

Skills

s
satish_sp
Satish P
offline • 

Bekijk mijn diensten

Programmering en technologie
I will build and automate etl pipelines using airflow pyspark and AWS

Portfolio

Werkervaring

Qualcomm

Data Engineer

Qualcomm • Fulltime

Aug 2025 - Present9 mos

Designed scalable data pipelines ingesting semiconductor wafer probe test data from Automated Test Equipment (ATE) into AWS S3 data lake. Built PySpark and Databricks based ETL pipelines processing millions of wafer test records daily. Implemented S3 data lake architecture managing raw, processed, and curated manufacturing datasets. Developed ingestion frameworks for high volume CSV and Parquet wafer test files from manufacturing systems. Built and managed Apache Airflow DAGs orchestrating ingestion, transformation, and loading workflows. Implemented PySpark transformations generating wafer level and die level yield analytics datasets.

United_Airlines

Data Engineer

United Airlines • Fulltime

Oct 2023 - Jul 20251 yr 9 mos

Designed ETL pipelines migrating pilot records from SQL Server to AWS Redshift for FAA PRD compliance. Automated ingestion and transformation using Python, AWS Glue, Lambda, and PySpark. Developed Apache Airflow DAGs with proactive monitoring using AWS SNS. Deployed data pipelines across development, staging, and production environments. Implemented data validation frameworks ensuring regulatory data accuracy and collaborating with DevOps teams to automate infrastructure.