Atta Ur Rehman

Data Engineer

Fiverr • Freelance

Dec 2017 - Present • 8 yrs 9 mos

• Designed scalable data pipelines using Azure Databricks, Microsoft Fabric, and Azure Data Factory to unify CRM, eCommerce, and analytics data via API-based and ETL/ELT integrations, defining real-time vs. batch data flows. • Built and optimized Delta Lakehouse architecture using medallion design principles, improving data processing efficiency by 60% and data quality, governance, and accessibility. • Built scalable customer-level and funnel-level data models and established a Single Source of Truth (SSOT), standardizing data structures and naming conventions across systems. • Owned end-to-end development of Power BI dashboards, including datasets, DAX measures, and drill-down logic across channel, customer, and funnel segments. • Defined and implemented data validation rules and monitoring, troubleshooting data quality issues with IT teams to ensure accuracy and consistency. • Enhanced data governance and security via Unity Catalog and role-based access, ensuring secure handling of customer-level data in compliance with enterprise standards. • Established CI/CD practices for Databricks notebooks and SQL transformations using Azure DevOps, and maintained documentation to support scalability. • Architected multi-cloud data platforms (Azure, AWS, Microsoft Fabric) using Databricks, ADF, Synapse, Snowflake, MS SQL, PySpark, and SSIS for enterprise-wide ETL/ELT integrations. • Designed modern analytics architectures (OneLake, Lakehouse, Data Marts) with standardized, policy-level and customer-level data models and naming conventions across reporting systems. • Led performance optimization of large-scale financial data pipelines, reducing runtimes by 50%+ and driving significant annual infrastructure cost savings. • Delivered hands-on Snowflake expertise across warehousing, ELT pipeline design, and performance tuning for enterprise reporting.