Senior Specialist - Data Engineering

We are looking for a Senior Data Engineer to join the SML Warehouse Management Team. In this role you will work in a global team alongside experienced colleagues building and improving modern data solutions using Databricks PySpark SQL batch and streaming technologies workflows and Unity Catalog. You will contribute to strategic warehouse and supply chain priorities in a fast growing area using the latest data engineering technologies in an international and collaborative environment. This role can be offered as an employee or consultant assignment with potential for a longer term opportunity for the right candidate We are looking for Azure Data Engineers Are you interested in being involved in the biggest data driven transformation of transport solutions in history. We are in the middle of our digitalization journey and you are welcome to join and help us drive analytics and artificial intelligence initiatives which enable new business models We are looking for Data Engineers 8 years of relevant experience with possible DevOps skills to develop and optimize data pipelines and work together with Data Scientists and other experts who focus on generating business value out of data. You will work with the latest technology in agile product teams which discover data to create innovative services latest technology in agile product teams which discover data to create innovative services These are challenges waiting for you You ingest and process data coming from our business application factory equipment Industrial Internet of Things products Vehicle Logged Data as well as external sources. You will organize both structured and unstructured data to enable development of new services such as preventive maintenance of vehicle fuel consumption and battery lifetime optimization and many more innovative services which are changing our business models Your typical day at work will be filled with the following activities 
 Build complex data pipelines in Microsoft Azure 
 Optimize existing data pipelines 
 Support in building the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources to Azure 
 Work closely with data analysts and data scientists to provide required data structures and enable new insights 
 Able to provision resources on Azure 
 Keep the data secure across the end to end solutions 
 Evaluate and improve existing data analytics solutions 
 Develop your competences learn new tools and ways of working 
 This is you 
 We are looking for experienced data engineer with 8 years of experience and relevant education background 
 You have good handson skills on Azure Data Analytics Spark Databricks Cost Optimization Techniques Cluster Optimization Performance Tuning 
 You have strong hands on ETL skills and experience in building data pipelines using Databricks with good knowledge of spark and orchestrating Data workloads on Azure Data Factory Experience in handling realtime streamingtransactional data preferably SparkStreaming Kafka Event Hubs Event Grid Stream Analytics Service Bus etc You have significant experience in processing data in scripting languages Python Pyspark Scala Working with Git and following Git workflow Branching Managing conflicts etc Databases like SQL server or Netezza dont have any secret for you You are comfortable with DevOps or DevSecOps and are able to provision resources in Azure You are comfortable working in a diverse complex and fastchanging landscape of data sources You communicate fluently in English You are proactive problem solver with innovative thinking and a strong team player Extras good to have Experience in AGILE project methodology and practice with ARM Templates Bicep on the DevOps front Understanding the DevOps Architecture Agent Pools Accounts Var Groups Templating etc Azure Networking model public and private connectivity VNET injection etc Familiarity with Microsoft Power BI or other data visualization tools such as Qlik SAP Business Objects Knowledge of other services and tools used to ETL workflows like Informatica IICS Experience with business intelligence platforms such as Microsoft SSISSSASSSRS Teradata IBM Netezza Familiarity with database management systems online analytical processing OLAP This is what we can offer you Being a part of a product team focusing both on maintenance and innovations A steep learning curve with a state of the art and individualized training program Collaborative environment Worklife balance we make sure you enjoy quality time away from work Candidate needs to travel to client office C V Raman Nagar Bagmane for 2 to 3 days or all days wherever applicable