Door categorieën bladeren
Ontdekken
Fiverr Pro
Nederlands
$
USD

Data Engineer
Skills

Bekijk mijn diensten

Data Engineer
Infosys • Fulltime
Sep 2025 - Present • 9 mos
Deployed on Databricks platform; helped build production pipelines processing daily 2–9 GB datasets (7-12 million rows): designed schema transformations for medallion architecture, engineered PySpark optimizations (partition pruning, shuffle hash, broadcast joins), implemented data serialization tuning; optimizations reduced job execution time by upto 20% in some pipelines. Led data quality validation, schema design improvements, and schema evolution to accommodate upstream data changes; worked cross-functionally with team lead and senior engineers on parallelism optimization strategies