a
anujsharma65

Anuj S

@anujsharma65

Senior Data Engineer

Nieuw-Zeeland
Engels, Hindi
Sommige informatie wordt in het Engels weergegeven.
Over mij
Based in Auckland, I specialise in building high-performance data infrastructure that cuts costs and scales. With experience at Microsoft, ONE NZ(ex. Vodafone NZ), Southern Cross Healthcare and IAG, I’ve delivered massive efficiencies, including: Cost Savings: Reduced Snowflake compute by 60% and cloud storage by 95%. Performance: Cut operational overhead by 80% and compute time by 40%. Tech Stack: Azure, Snowflake, dbt, BigQuery, Airflow, and Python. I bridge the gap between complex engineering and business value. Let’s build your modern data stack or optimize your existing cloud footprint.... Lees meer

Skills

a
anujsharma65
Anuj S
offline • 
Gemiddelde reactietijd: 1 uur

Bekijk mijn diensten

Data engineering advies
I will build ai integrated data pipelines using azure, snowflake, and dbt

Werkervaring

IAG

Senior Data Engineer

IAG

May 2023 - Present3 yrs

• Implemented the seamless integration of the Guidewire Cloud Claims system into foundational and derived data products, ensuring zero downtime and uninterrupted business reporting, supported by a comprehensive end-to-end testing framework addressing schema evolution, data completeness, and validation of critical data flows. • Migrated GitHub repositories from Enterprise to GitHub Cloud, mitigating security and workflow risks while enabling teammates to adopt the migration approach for additional repositories. • Employed prompt engineering best practices to deliver high-quality AI-assisted code, tests, and documentation, while contributing to the uplift of team capability in generative AI workflows. • Re-engineered a complex, BAU-intensive PySpark pipeline during its migration to Google Cloud, simplifying Airflow orchestration and ETL design to reduce operational overhead by over 80% and cut compute time and costs by 40%, while delivering a scalable API-based data product to the Natural Hazards Commission (NZ Government). • Owned stakeholder-facing UAT and release readiness, collaborating with external partners to validate data accuracy, performance, and production readiness prior to formal sign-off.

Vodafone

Data Engineer Consultant

Vodafone

Feb 2022 - May 20231 yr 3 mos

• Cloud Data Infrastructure Engineering: Collaborated as a lead consultant to architect and deploy a modern data stack for Network Performance Management. Engineered end-to-end infrastructure utilizing Azure Data Factory (ADF), Snowflake, dbt, and Azure DevOps for robust version control and deployment. • Infrastructure Cost Optimization: Performance-tuned Azure Data Factory pipelines and optimized Snowflake warehouse configurations, resulting in a 60% reduction in compute expenditure. • Stakeholder Analytics & BI: Translated complex business requirements into technical specifications, delivering actionable insights through high-performance Tableau dashboards and automated reporting.

Microsoft

Data Analyst

Microsoft • Fulltime

Oct 2020 - Mar 20221 yr 5 mos

• Contributed to large-scale Azure fraud protection initiatives within Microsoft’s Cloud + AI Commerce Protection organisation, helping safeguard the Azure business from cyber and financial fraud. • Developed Python-based machine learning models and enriched fraud signals using external data sources, while analysing legacy fraud cases with SQL Server to improve detection coverage and reduce time to detect fraud for global teams. • Built real-time analytics tools and performance dashboards using Azure Analysis Services, enabling investigative teams worldwide to track emerging fraud trends and measure agent effectiveness against global and on-site KPIs.