
Arun M
Data Engineer and AI Systems Builder, 10 Years Experience
Skills

Bekijk mijn diensten

Werkervaring
Consultant - Data Engineer
Patreon • Freelance
Dec 2025 - Present • 6 mos
Salesforce + Braze to Databricks — Medallion Architecture Pipeline Built and maintained production data pipelines for a subscription platform, integrating two key customer-facing systems — Salesforce (sales/CRM data) and Braze (marketing/messaging data) — into a unified Databricks lakehouse. What I built: Ingestion pipelines pulling data from Salesforce and Braze APIs into Databricks, handling schema differences and API rate limits across both sources Medallion architecture (Bronze → Silver → Gold) to structure the lakehouse: Bronze: raw data landed as-is from both source systems Silver: cleaned, deduplicated, and standardized into a unified schema Gold: business-ready tables joining Salesforce and Braze data for downstream reporting and analysis Multiple transformation jobs to reconcile data models between the two systems — Salesforce and Braze structure customer and engagement data very differently, so this required careful mapping logic rather than a simple merge Worked independently to ramp up on Salesforce data concepts I hadn't used before, then built the engineering work around that understanding