I will build real time streaming pipelines with apache kafka
Senior Data Engineer, AWS Certified, Cloudera Spark Developer
Over deze dienst
Need a real time data pipeline that moves events reliably from your applications databases or APIs into your analytics platform?
I build production ready streaming pipelines using Apache Kafka Kafka Connect Spark Structured Streaming AWS Kinesis Glue Databricks and cloud data warehouses.
What I can deliver:
- Kafka topic and producer consumer architecture
- Streaming ETL with Spark Structured Streaming or Python
- Kafka Connect or Debezium source connectors
- Data quality checks and schema validation
- Delivery into Snowflake BigQuery Redshift S3 or Databricks
- Monitoring documentation and deployment guidance
Why work with me:
- 9 years as a Senior Data Engineer
- Strong batch and streaming architecture experience
- Experience with AWS Databricks Snowflake and enterprise data platforms
- Clean handoff with code documentation and architecture notes
Please message me before ordering so I can confirm the event source target platform and expected throughput.
Andere Data engineering diensten die ik aanbied
Veelgestelde vragen
What information do you need to start?
Please share your source system target platform expected event volume sample payloads and any existing Kafka Kinesis or cloud account details.
