r
rickyno93

Tuan Le

@rickyno93

Senior Data Engineer, Data Science, AI ML Engineer

Verenigde Staten
Engels, Vietnamees
Sommige informatie wordt in het Engels weergegeven.
Over mij
As a creative, flexible, and highly adaptable Senior Data Engineer, I thrive in fast-paced environments and maintain a positive attitude in the face of ever-changing priorities. My passion for technology and strong belief in the bright future of machine learning and artificial intelligence drive me to continually push the boundaries of what is possible in the data engineering field. Currently working with the Digital, Technology & Innovation Organization as a Senior Data Engineer, I am dedicated to leveraging my data engineering skills to improve corporate performance and drive growth.... Lees meer

Skills

r
rickyno93
Tuan Le
offline • 

Bekijk mijn diensten

Data engineering
I will be your expert senior data engineer for etl data pipelines and big data works

Portfolio

Werkervaring

Verizon

Senior Data Engineer

Verizon

Jan 2018 - Dec 2022 • 4 yrs 11 mos

Built and maintain a Databricks lakehouse platform (Bronze/Silver/Gold on Unity Catalog) that brings 6 source systems into one governed data layer Moved SQL Server sources to change data capture (CDC) with Lakeflow, so tables update incrementally instead of through full reloads Built SCD Type 2 history tracking in the Silver layer and fixed a validity bug in it across several pipelines Built NetSuite REST API ingestion, including deletion tracking so removed records are flagged in Silver instead of left behind Added data quality guards: Silver loads stop when the source arrives empty or with changed columns, instead of loading bad data Set up CI/CD in Azure DevOps with Databricks Asset Bundles, deploying the same code to dev, QA and production Wrote contract tests that run in CI and catch broken configuration before a release, such as a deploy that would silently ship no resources Automated release steps in Bash: catalog and schema setup, permissions, job triggers and safe teardown