Browse current jobs

Specialist - Data Engineering

LTIMindtree · Hyderabad

Apply on employer website

Collected role description

Role :Databricks Python Developer Experience :5-8 Years Location :Hyderabad Primary Skills :Databricks Python PySpark Data Engineering Databricks with Python more of a reports Specialist or Data Engineer ReportingAnalytics focusing on building automating and maintaining data pipelines to transform raw data into optimized reporting assets Secondary Skills :Cloud Data Platforms, SQL Data Warehousing ETL,ELT Development MustHave Skills: Strong handson experience in Databricks platform development and administration Expertise in Python programming for data processing automation and application development Strong experience with PySpark for largescale distributed data processing Excellent SQL skills for data extraction transformation and optimization Experience building and maintaining ETLELT pipelines in Databricks Strong understanding of Delta Lake Lakehouse architecture and data lifecycle management Experience working with structured semistructured and unstructured data sources Expertise in data modeling performance tuning and query optimization Experience integrating Databricks with cloud platforms such as Azure AWS or GCP Proficiency in developing scalable and reusable data engineering frameworks Strong understanding of data quality governance security and monitoring practices Experience with version control tools such as Git and CICD implementation Strong analytical and problemsolving skills with the ability to troubleshoot complex data issues Experience collaborating with business stakeholders to translate requirements into technical solutions Excellent communication and stakeholder management skills GoodtoHave Skills Experience with Azure Databricks and Azure Data Services ADF ADLS Synapse Handson experience with Apache Kafka or streaming data solutions Knowledge of orchestration tools such as Airflow Azure Data Factory or similar platforms 
 Experience working with Unity Catalog metadata management and data governance frameworks 
 Understanding of Data Warehousing concepts and modern Lakehouse implementations 
 Experience with BI and reporting tools such as Power BI Tableau or Looker 
 Exposure to machine learning workflows and MLOps on Databricks 
 Knowledge of cloudnative architecture security and cost optimization practices 
 Experience building reusable data products and enterprise data assets 
 Familiarity with DevOps practices automated testing and deployment pipelines 
 Experience in AgileScrum delivery environments 
 Databricks Cloud or Data Engineering certifications preferred 
 Experience supporting enterprisescale analytics and digital transformation programs

Collected experience requirement

5 - 8 Years