Door categorieën bladeren
Ontdekken
Fiverr Pro
Nederlands
$
USD
I will build AWS glue etl pipelines from s3 apis and databases to redshift
Python Data Automation and Computer Vision Engineer
Most businesses do not need another script that works once. They need data that moves reliably, models that perform on real inputs, and systems their team can operate after handover. I build Python an...
Niveau 1
Voldoet aan bepaalde prestatiecriteria en toont een sterke potentie op de marktplaats.
Over deze dienst
Manual uploads, broken jobs, and messy reporting waste time fast. I build AWS ETL pipelines that move your data automatically, clean it properly, and load it where your team actually needs it.
I can help you build AWS Glue pipelines from S3, APIs, CSV/JSON files, or databases into Redshift, Athena, or other reporting-ready destinations. Whether you need a simple ingestion flow or a more complete automated pipeline with transformation, scheduling, validation, and monitoring, I build it around your actual process.
What I can deliver:
- AWS Glue ETL pipelines
- S3 staging and data lake setup
- API and database ingestion
- Redshift and Athena loading
- Python / PySpark transformation logic
- scheduling and automation
- validation checks and duplicate prevention
- CloudWatch logging and monitoring
- clean source code and documentation
The goal is simple: less manual work, fewer broken refreshes, and data that arrives clean and ready for reporting.
Please message me before ordering with your source systems, target destination, refresh frequency, and current challenge so I can guide you to the right package.
Tools & platforms:
AWS Glue DataBrew
•
Overige
Mijn portfolio
Veelgestelde vragen
1. What data sources can you work with?
I can work with S3 files, CSV, JSON, APIs, and many database-based sources depending on access and structure.
2. Can you load data into Redshift or Athena?
Yes. I can build pipelines that transform and load data into Redshift or prepare it for querying in Athena.
3. Do you also fix existing broken ETL pipelines?
Yes. If your current Glue job, transformation logic, or scheduled pipeline is failing, I can troubleshoot and improve it.
4. Will I receive the source code?
Yes. You will receive the relevant code, ETL logic, and documentation included in your package.
5. Can you add monitoring and alerts?
Yes. I can set up CloudWatch logging and alerting so pipeline failures are easier to detect and manage.
6. Do you help with architecture decisions?
Yes. If you are unsure whether to use Glue, Lambda, Athena, or Redshift, I can recommend the most practical approach based on your use case.
