Mohamed

Data Engineer

Atos

Aug 2023 - Present • 3 yrs

• Contributed across the full project lifecycle, from gathering requirements to designing and optimizing scalable ETL and data pipeline workflows processing 800M+ records using SQL Server and SSIS, achieving a 50% reduction in data processing time through optimized ETL workflows while ensuring reliable, high-quality data delivery. • Participated in Proof of Concepts (POCs) leveraging Cloudera ecosystem technologies including Apache Spark, Kafka, and Hadoop to evaluate scalable batch and streaming data processing solutions in collaboration with Data Science teams. • Developed and maintained Python and Bash scripting solutions for data quality validation, workflow automation, and data integration processes, improving operational efficiency and reducing manual effort by 70%. •Created technical documentation, workflow diagrams, and data flow mappings to improve system understanding, maintainability, and knowledge transfer across teams. •Developed data engineering projects using Airflow, DBT, and Tableau, implementing workflow orchestration, transformation pipelines, and reporting solutions