Browse current jobs

Lead Data Quality Engineer

Intellipaat · Hyderabad

Apply on employer website

Collected role description

<div class="gflanj gflg8a gflh8y gflgxu gflha6 gflhbm gflgm7 gfllgi"> <h2 class="gflkzy gflkxx gfljx0 gflkxc gflkyo gflkyu gflkyx gflkzf gflfc9 gflkzw gflk7l"><strong>About the job</strong></h2> </div> <p><strong>Location:</strong> Hyderabad / Kolkata</p> <p><strong>Experience:</strong> 7–11 Years</p> <p><strong>Employment Type:</strong> Full-Time</p> <p><strong>Company:</strong> Finarb Analytics Consulting Pvt. Ltd.</p> <p class="gflkzy gflkxo gflkxc gflkyo gflkyr gflky0 gflkzf gflfc9 gflkzw gflk7l gflk7p"><strong><span class="gfllfj gflam3 gfliiy gfllgi" data-testid="expandable-text-box">About Finarb</span></strong></p> <p>Finarb Analytics Consulting is a data, analytics, and AI consulting firm delivering enterprise solutions across data engineering, business intelligence, cloud modernization, and advanced analytics.</p> <p class="gflkzy gflkxo gflkxc gflkyo gflkyr gflky0 gflkzf gflfc9 gflkzw gflk7l gflk7p"><strong><span class="gfllfj gflam3 gfliiy gfllgi" data-testid="expandable-text-box">About the Role</span></strong></p> <p>We are looking for an experienced, hands-on <strong>Lead Data Quality Engineer</strong> to drive data validation, reconciliation, and quality automation across enterprise data platforms.</p> <p>The ideal candidate will have strong expertise in <strong>SQL, ETL/ELT testing, data quality automation, and data warehousing</strong>, with experience in Azure-based environments and preferably Microsoft Fabric.</p> <p>The role involves leading data quality initiatives, developing automated validation frameworks, ensuring data integrity during platform migrations, and mentoring junior engineers.</p> <p class="gflkzy gflkxo gflkxc gflkyo gflkyr gflky0 gflkzf gflfc9 gflkzw gflk7l gflk7p"><strong><span class="gfllfj gflam3 gfliiy gfllgi" data-testid="expandable-text-box">Key Responsibilities</span></strong></p> <ul class="gflkrc gflkz5 gfllgi"> <li>Lead data quality engineering, validation, and reconciliation activities across enterprise data platforms.</li> <li>Design and implement automated data quality testing frameworks using SQL and Python.</li> <li>Develop complex SQL queries for source-to-target reconciliation, transformation validation, and data integrity checks.</li> <li>Validate ETL/ELT pipelines, including full loads, incremental loads, CDC, and complex transformations.</li> <li>Lead data validation and reconciliation during migration from SQL Server and Azure Data Factory to Microsoft Fabric.</li> <li>Establish data quality standards, testing strategies, and automated monitoring processes.</li> <li>Investigate production data discrepancies, perform root cause analysis, and implement preventive controls.</li> <li>Collaborate with data engineers, architects, and BI developers to ensure data accuracy and reliability.</li> <li>Mentor data quality engineers, conduct technical reviews, and drive engineering best practices.</li> </ul> <p class="gflkzy gflkxo gflkxc gflkyo gflkyr gflky0 gflkzf gflfc9 gflkzw gflk7l gflk7p"><strong><span class="gfllfj gflam3 gfliiy gfllgi" data-testid="expandable-text-box">Required Skills & Qualifications</span></strong></p> <ul class="gflkrc gflkz5 gfllgi"> <li><strong>7–11 years</strong> of experience in data quality engineering, ETL testing, or data warehouse testing.</li> <li>Advanced <strong>SQL/T-SQL</strong> skills, including complex joins, CTEs, window functions, and query optimization.</li> <li>Strong experience in <strong>ETL/ELT testing, source-to-target validation, and data reconciliation</strong>.</li> <li>Hands-on experience developing <strong>automated data quality frameworks using SQL and Python</strong>.</li> <li>Strong understanding of data warehousing, dimensional modeling, and transformation logic.</li> <li>Experience with <strong>SQL Server, Azure Data Factory, and Azure data environments</strong>.</li> <li>Proven ability to troubleshoot complex data discrepancies and production issues.</li> <li>Experience leading technical teams, reviewing code, and establishing testing standards.</li> <li>Bachelor’s degree in Computer Science, Engineering, or a related field.</li> </ul> <p class="gflkzy gflkxo gflkxc gflkyo gflkyr gflky0 gflkzf gflfc9 gflkzw gflk7l gflk7p"><strong><span class="gfllfj gflam3 gfliiy gfllgi" data-testid="expandable-text-box">Good-to-Have Skills</span></strong></p> <ul class="gflkrc gflkz5 gfllgi"> <li>Microsoft Fabric (Lakehouse, Warehouse, OneLake, Fabric Data Factory).</li> <li>PySpark and Spark SQL.</li> <li>Data quality tools such as Great Expectations, Soda, or dbt tests.</li> <li>Delta Lake and medallion architecture.</li> <li>Azure DevOps, Git, and CI/CD.</li> <li>Experience with cloud data migration and modernization projects.</li> <li>Power BI data validation and Microsoft Purview.</li> </ul> <p class="gflkzy gflkxo gflkxc gflkyo gflkyr gflky0 gflkzf gflfc9 gflkzw gflk7l gflk7p"><strong><span class="gfllfj gflam3 gfliiy gfllgi" data-testid="expandable-text-box">What We’re Looking For</span></strong></p> <p>A technically strong, hands-on engineering lead who can independently design scalable data quality solutions, automate complex reconciliation processes, and ensure data accuracy across enterprise systems.</p> <p><strong>Candidates with experience in large-scale data migrations, automated testing frameworks, and Microsoft Fabric will be preferred.</strong></p> <p class="gflkzy gflkxo gflkxc gflkyo gflkyr gflky0 gflkzf gflfc9 gflkzw gflk7l gflk7p"><strong><span class="gfllfj gflam3 gfliiy gfllgi" data-testid="expandable-text-box">Why Join Finarb?</span></strong></p> <ul class="gflkrc gflkz5 gfllgi"> <li>Work on enterprise-scale data engineering and cloud modernization projects.</li> <li>Gain exposure to Microsoft Fabric and modern data platforms.</li> <li>Lead data quality engineering initiatives and influence technical standards.</li> <li>Collaborate with experienced data architects and engineering teams.</li> </ul> <p><strong>Company Website:</strong> https://www.finarb.ai</p>

Collected experience requirement

7 years