Specialist - Data Engineering

Job Summary Seeking a Specialist with 5 to 7 years of experience in Azure Cloud Architecture and Azure Databricks to design and implement scalable data solutions within the Azure ecosystem Job Description Design develop and optimize endtoend data pipelines using Azure Databricks to support complex data processing and analytics scenarios Architect and maintain secure scalable data storage and processing solutions leveraging Azure Cloud services Collaborate with crossfunctional teams to align data solutions with business objectives and technical requirements Implement best practices for data governance security and compliance within Azure environments Ensure high availability performance and reliability of data platforms through continuous monitoring and tuning Utilize strong expertise in Azure Cloud Architecture to provision and manage Azure resources effectively Apply advanced Databricks concepts including security production architecture and pipeline development Leverage Python and Spark SQL skills for efficient data ingestion and transformation workflows Roles and Responsibilities Lead design and implementation of Azurebased data integration and processing platforms focusing on Azure Databricks Mentor and guide data engineers on best practices and technical solutions within Azure Databricks and Azure Cloud Collaborate with stakeholders to gather requirements and translate them into scalable technical architectures Oversee data migration transformation and integration activities ensuring seamless data flow Establish and enforce data architecture standards policies and procedures to maintain data quality and security Conduct performance tuning troubleshooting and optimization of data pipelines Manage Azure resource provisioning and configuration aligned with security and compliance standards Keep abreast of emerging Azure data technologies and tools to drive innovation and improve platform capabilities