Specialist - Data Engineering
LTIMindtree · Kolkata
Collected role description
Job Summary Seeking an experienced Azure Specialist with expertise in Azure Data Lake Azure Data Factory and Azure Synapse Analytics to design and implement scalable data solutions Job Description Design and develop scalable data integration and orchestration pipelines using Azure Data Factory Build batch and incremental data ingestion frameworks from diverse source systems to cloud data platforms Develop and optimize ETLELT workflows ensuring high performance reliability and scalability Implement parameterized and metadatadriven pipelines triggers and monitoring solutions Collaborate with business and technical teams to translate data requirements into robust cloud solutions Perform data validation reconciliation and troubleshoot production data issues Support CICD implementation and deployment of Azure Data Factory artifacts across multiple environments Create and maintain technical documentation data flow diagrams and operational runbooks Adhere to data governance security standards and best practices Leverage knowledge of Azure Synapse Analytics for cloudbased data warehousing and analytics Utilize Azure Data Lake Storage Gen2 for efficient data storage and management Roles and Responsibilities Lead the design development and maintenance of Azurebased data solutions within the Azure Databricks skill cluster family Ensure seamless integration of data pipelines with Azure Data Lake Azure Data Factory and Azure Synapse Analytics Optimize data workflows and pipelines for performance tuning debugging and monitoring Implement incremental load strategies and change data capture CDC methodologies Collaborate with crossfunctional teams to ensure alignment of data solutions with business objectives Drive automation and CICD processes using Gitbased version control and Azure DevOps Mentor junior team members and contribute to continuous improvement initiatives Maintain strong documentation and knowledge sharing to support operational excellence Stay updated with emerging Azure technologies and best practices to enhance solution delivery
Collected experience requirement
5 - 7 Years