Door categorieën bladeren
Ontdekken
Fiverr Pro
Nederlands
$
USD
Sultan
@sultan_bgs
Certified Data Engineer
India
Engels
Over mij
Results-driven Data Engineer with 4.5 years of experience in designing, developing, testing, supporting and optimizing scalable ETL/ELT pipelines using PySpark, Databricks, SQL, Python, Apache Spark and cloud-based data platforms. Skilled in Databricks Data Engineering, workflow automation, data integration, and performance optimization across Retail and Pharma domains. Experienced in collaborating with cross-functional teams, gathering business requirements, performing root cause analysis, and ensuring reliable data delivery through Agile development practices.
Skills
Sultan
offline •
Bekijk mijn diensten
Data ETL's
I will build robust and scalable data pipelines using pyspark, databricks, and airflow
Werkervaring
Data Engineer
Infosys • Fulltime
Feb 2022 - Mar 2025 • 3 yrs 1 mo
Developed and optimized ETL/ELT pipelines using Databricks, Python (PySpark), AWS S3, Apache Airflow, and Snowflake for enterprise-scale data processing. Converted complex Teradata SQL procedures into optimized PySpark workflows to improve automation, scalability, and performance. Designed and implemented scalable Databricks workflows for data ingestion, transformation, and reporting solutions. Integrated multiple enterprise data sources and ensured reliable data delivery across downstream systems. Performed testing, validation, troubleshooting of data pipelines to ensure high data quality and system stability. Collaborated with business stakeholders, analysts, and cross-functional teams to gather requirements and deliver data-driven solutions. Enhanced workflow efficiency by modifying Informatica workflows and BTEQ scripts for region-specific business use cases. Managed role-based access controls (RBAC) and implemented secure data access mechanisms using Unity Catalog. Supported CI/CD deployment activities and participated in Agile-based software development practices.
