AWS Kafka Data Engineer

Job Title: AWS Kafka Data Engineer

Location: Pune, Chennai, Bangalore, Hyderabad, Cochin, Trivandrum

Experience:5-12 yrs

Job Title: Senior Data Engineer (Kafka & AWS)

Notice--Only Immediate Joiners

We are hiring for a well-established technology partner known for delivering scalable cloud and real-time data solutions for enterprise clients. The role offers an opportunity to work on high-volume streaming platforms, leveraging AWS and Kafka ecosystems in a fast-paced, engineering-driven environment.

Key Responsibilities

1. Develop and maintain real-time data pipelines using Apache Kafka (MSK/Confluent) and AWS services
2. Configure and manage Kafka connectors, ensuring seamless data integration across systems
3. Work extensively with Kafka components (producers, consumers, brokers, topics, schema registry)
4. Design and implement scalable ETL/ELT workflows for large-scale data processing
5. Optimize data lake and warehouse solutions using AWS services (S3, Glue, Lambda, etc.)
6. Implement monitoring, observability, and testing frameworks for data reliability
7. Ensure data security, governance, and compliance standards
8. Collaborate with cross-functional teams for solution design and delivery

Must-Have Skills

1. 5+ years of experience in Data Engineering
2. Strong hands-on expertise in:
3. Apache Kafka (MSK / Confluent)
4. AWS data stack (S3, Glue, Lambda, etc.)
5. Strong programming skills in Python and SQL
6. Good working knowledge of Java (preferred for Kafka ecosystem)
7. Experience in building real-time/streaming data pipelines
8. Experience with ETL/ELT frameworks and large-scale data processing
9. Strong problem-solving and analytical skills

Good to Have

1. Experience with Infrastructure-as-Code (CloudFormation, Terraform)
2. Exposure to CI/CD pipelines
3. Knowledge of data lake architecture and modern data platforms
4. Experience in high-throughput, low-latency systems