Lead II - Software Testing

Job description

Job Summary

We are looking for a highly skilled SDET (Software Development Engineer in Test) with strong expertise in automation testing for data integration and transformation systems. The role involves close collaboration with data engineers, developers, and DevOps teams to ensure data quality, accuracy, and integrity across complex ETL pipelines and microservices-based integrations. The ideal candidate will be hands-on in automation, with a strong focus on non-UI testing and data validation frameworks such as Great Expectations.

Key Responsibilities

1. Design, develop, and maintain automated test frameworks for data integration and transformation workflows
2. Collaborate with data engineers to understand data flows, business rules, and transformation logic
3. Create and execute test cases for ETL/ELT processes, data pipelines, and API-based microservices (without UI)
4. Validate data quality, schema, completeness, accuracy, and consistency across multiple source and target systems
5. Automate regression, integration, and end-to-end testing for data-driven applications
6. Implement validations for data accuracy, duplication, data loss, and format transformations (JSON, XML → XML)
7. Leverage Great Expectations for automated data quality checks and validation rules
8. Integrate automated tests into CI/CD pipelines in collaboration with DevOps teams
9. Participate in requirements analysis, risk assessment, and test planning
10. Log defects clearly and support root cause analysis and resolution

Mandatory Skills & Experience

1. Strong experience in automation testing for data integration and transformation environments
2. Hands-on expertise in Java-based test automation
3. Proven experience in ETL testing and API / Microservices testing (non-UI)
4. Strong understanding of data format transformations (JSON, XML, XML-to-XML)
5. Proficiency in writing SQL queries for data validation and profiling
6. Experience using Great Expectations for data quality validation and automation
7. Familiarity with test frameworks such as JUnit, TestNG, PyTest, or similar
8. Working knowledge of CI/CD tools like Jenkins, GitLab CI, or CircleCI

Good to Have

1. Exposure to data integration tools such as Apache NiFi, Talend, Informatica, etc.
2. Experience with Kafka, Spark, Hadoop, or distributed data platforms
3. Understanding of additional data formats such as Avro and Parquet
4. Exposure to cloud data platforms (AWS Glue, S3, Redshift, EMR, GCP BigQuery)

Preferred Qualifications

1. Experience with cloud-based data ecosystems
2. Familiarity with data cataloging, data lineage, governance, and security compliance
3. Strong communication and collaboration skills with cross-functional stakeholders

Skills

etl testing,java,api testing,database testing,