t
tomxiaoyz

Tom X

@tomxiaoyz

Data Warehousing, Data Modeling and ETL Engineer

Hong Kong
Engels, Chinees
Sommige informatie wordt in het Engels weergegeven.
Over mij
I help teams design data warehouses and dimensional models, build reliable ETL/API pipelines, and fix Python or SQL data workflows. I have 7+ years of data engineering and analytics experience across travel and financial services. My tools include BigQuery, Trino/Hive, Airflow and AWS/GCP. Past work includes models across 10+ business domains and reducing a daily ETL window from about eight hours to five. I offer focused reviews, scoped implementations and smaller repair tasks, with clear acceptance checks, documentation and handover.... Lees meer

Skills

t
tomxiaoyz
Tom X
offline • 
Gemiddelde reactietijd: 1 uur

Bekijk mijn diensten

Automatiseringen
I will fix and optimize your python and sql data workflows
Datawarehouse
I will design a data warehouse and models for reliable reporting

Portfolio

Werkervaring

Amber_Group

Data Engineer

Amber Group

Nov 2021 - Present • 5 yrs

Built shared data platforms and warehouses for analytics, finance and risk using Python, SQL, Airflow, Trino and Hive. Reconciled transaction and balance data, with checks for duplicates, missing records and differences between sources. Optimized SQL and resource usage to reduce a daily ETL window from about eight hours to five in July 2023. Integrated market-data APIs and built AI-assisted SQL workflows, a shared semantic layer and MCP tools for data discovery and querying.

Klook

Data Engineer / Data Analyst

Klook

Nov 2018 - Oct 2021 • 2 yrs 11 mos

Moved from Data Analyst to Data Engineer in March 2020. Built and operated cloud data warehouses and batch/streaming pipelines on GCP and AWS. Modeled reporting data across more than 10 business domains and maintained warehouse tables for analytics. Orchestrated 2,000+ SQL jobs and 30+ Dataflow jobs with Cloud Composer, with dependency handling, shared alerts and data dictionaries. Built CDC pipelines with Debezium, Kafka and Hudi to move RDS data into BigQuery, and automated infrastructure setup with Terraform.