Test Engineer – Data Migration & Transformation Validation - Java / Python automation along with CI/CD integration
Luxoft · Remote
Collected role description
Project description We are looking for an experienced Database Testing Lead with strong expertise in SQL-based backend validation. The candidate will be responsible for validating large data sets, performing file-to-file reconciliation, volume testing, and ensuring accurate data validation from AWS sources to downstream systems (including PNR creation on PID data). API testing experience is required as a secondary skill. Responsibilities Data Migration & Transformation Validation Lead testing efforts for large-scale data transformation and migration initiatives involving millions of records across enterprise Network Operation platforms. Design and execute comprehensive data validation strategies to ensure data accuracy, completeness, consistency, and integrity during migrations. Develop complex SQL queries and automated validation scripts to reconcile source and target systems at scale. Validate ETL/ELT processes, transformation rules, data mappings, and business logic across multiple data domains. Perform end-to-end testing of batch, real-time, and incremental data migration workflows. Identify, analyze, and troubleshoot data quality issues, migration defects, duplicates, missing records, and transformation anomalies. Collaborate closely with data engineers, architects, business analysts, and application teams to define test strategies and acceptance criteria. Generate detailed data quality metrics, reconciliation reports, and migration readiness assessments for stakeholders. Drive best practices in database testing, automation, and data quality engineering to ensure successful delivery of enterprise migration programs. AI Agent Onboarding & Test Automation Partner with AI agent onboarding partners to define and execute the onboarding approach for all three UA agents. Establish an automation-first testing strategy for the product and agent-based workflows. Review the product architecture diagrams, and overall solution objectives to understand the end-to-end agent workflow and testing requirements. Identify opportunities to use AI-driven test automation to improve test coverage, execution efficiency, and agent workflow validation. Collaborate with development, architecture, AI partners, and QA teams to embed DB automation & AI agent into the product development lifecycle. Define test scenarios and validation strategies for AI-agent-based workflows, covering functional, integration, data, and end-to-end validation. Skills Must have Primary Skills Strong experience in Database Testing using SQL Expertise in writing complex SQL queries (joins, aggregations, subqueries) and PLSQL Able to build Automation either Using Java / Python along with CI/CD integration Experience in API Testing Experience in File-to-File Data Validation Hands-on experience with Volume Testing / Large Data Set Validation Experience in data reconciliation and backend testing Ability to validate data pipelines and data transformations Experience validating data flow between systems and databases Strong understanding of data integrity, accuracy, and consistency checks Technical Skills SQL (Mandatory) Database platforms such as Oracle, SQL Server, PostgreSQL, or MySQL AWS data validation Experience working with large data volumes Knowledge of data migration and ETL validation Nice to have Secondary Skills API Testing using tools such as Postman, Swagger, or similar tools Experience in AI-driven test automation Understanding of REST APIs and HTTP methods (GET, POST, PUT, DELETE) Ability to validate API responses with database data Knowledge of JSON/XML validation Other Languages English: C1 Advanced Seniority Senior