Data Engineer - Hadoop

Role overview

Data Engineer - Hadoop at Luxoft

Responsibilities

• Design, monitor, and troubleshoot batch jobs and data processing workflows using job scheduling and monitoring tools, preferably Control-M.
• Work with Hadoop ecosystem technologies to process, analyze, and troubleshoot large volumes of structured and unstructured data.
• Analyze data and operational issues, identify root causes, and implement appropriate solutions to improve reliability and performance.

Required qualifications

• Skills Must have 4 to 6 years of relevant experience in Data & Analytics.

Preferred qualifications and skills

• Nice to have Experience of Agile/Scrum development methodologies is a plus Be nice, respectful, able to work in a team Willingness to learn Other Languages English: C2 Proficient Seniority Regular

Employment details

• Location: Chennai [India]

Additional role details

• Project description We've been engaged by an Investment Banking client to work on Regulatory Reporting initiative in the Capital Risk portfolio.
• Responsibilities Develop, maintain, and optimize SQL queries for data extraction, transformation, validation, and analysis across large datasets.
• Manage daily production job schedules, monitor job execution, investigate failures, and ensure timely resolution to minimize operational impact.
• Perform data validation, reconciliation, and quality checks to ensure data accuracy, completeness, and consistency.
• Hands-on experience in SQL, Job Scheduling and Monitoring Tool preferably Control M Good understanding and working experience in Hadoop.
• Strong analytical and problem-solving skills.
• Ability to work independently and collaborate effectively with cross-functional teams.