d
dinesh_kaushal_

Dinesh Kaushal

@dinesh_kaushal_

Azure Data Engineer , Pyspark , Databricks , ADF Pipelines Expert

India
Engels, Hindi, Punjabi
Sommige informatie wordt in het Engels weergegeven.
Over mij
Azure Data Engineer with expertise in PySpark, Azure Data Factory, and Databricks. I build, optimize, and fix scalable data pipelines for efficient data processing. Skilled in ETL/ELT, SQL, and big data workflows. I help improve performance, reduce costs, and ensure reliable data systems. Focused on clean code, quick delivery, and clear communication. Let’s build efficient data solutions together.... Lees meer

Skills

d
dinesh_kaushal_
Dinesh Kaushal
offline • 

Bekijk mijn diensten

Data engineering advies
I will build scalable etl pipelines using azure data factory and databricks

Portfolio

Werkervaring

IBM

Senior Data Engineer

IBM

Oct 2020 - Present5 yrs 7 mos

Data Engineer with 5+ years of experience working in a multinational company, specializing in building scalable and efficient data solutions on Microsoft Azure. Extensive hands-on experience with Azure Data Factory (ADF), Azure Databricks, PySpark, and SQL for designing, developing, and optimizing end-to-end data pipelines. Worked on ingesting data from multiple sources, transforming large datasets, and delivering clean, reliable data for analytics and reporting. Strong expertise in: - Building ETL/ELT pipelines using Azure Data Factory - Developing and optimizing PySpark jobs in Databricks - Writing efficient SQL queries and data models - Handling large-scale data processing and performance tuning - Debugging and fixing pipeline failures and bottlenecks Experienced in working with Azure Data Lake (ADLS) and implementing best practices for scalable and cost-efficient data architectures. Focused on delivering production-ready solutions with high reliability, optimized performance, and clear documentation. Comfortable working in fast-paced environments and collaborating with cross-functional teams to solve complex data challenges.