Senior Analyst - Data Engineering

LatentView Analytics · Bangalore

Source and collection record

Last observed by our collector: 8 October 2026 at 11:39 pm IST. This is not a manual review or a confirmation from the employer.

Job type and experience labels are automated discovery categories. The employer determines eligibility. Original experience wording was not retained separately; check the current employer page.

How sourcing and classification work · Report a discrepancy

Your application evidence checklist

Mark the statements you can support after reading the employer source. This checklist stays on this page; it does not score your eligibility or submit an application.

Attendance and availability: I checked the employer page for work location, office attendance, start date and duration.Current requisition: I checked the current employer requisition and its application requirements.

0 of 2 checks marked. Keep unresolved requirements as questions for the employer.

Collected role description

Job Summary Design, develop, and deploy enterprise-scale data engineering solutions using Databricks and Azure. The role focuses on building robust and scalable data pipelines, metadata-driven ingestion frameworks, data quality solutions, and Lakehouse architectures. The ideal candidate will collaborate with global cross-functional teams, provide technical leadership, mentor junior engineers, and drive high-quality delivery across the full project lifecycle. Roles and Responsibilities<ul><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Data Engineering & Architecture: Design and develop scalable data solutions aligned with technical architecture, integration standards, and established engineering practices.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Pipeline Development: Build and optimize enterprise-grade data pipelines using Databricks, PySpark, Delta Lake, Delta Live Tables, Auto Loader, Databricks Workflows, and/or Apache Airflow.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Metadata & Data Quality: Develop metadata-driven ingestion frameworks and robust data quality (DQ) frameworks using PySpark to ensure reliable and governed data processing.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Lakehouse & Data Platforms: Design and implement modern Lakehouse architectures using Apache Spark, Delta Lake, Azure Data Lake Storage, and related big data technologies.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Technical Leadership: Lead technical discussions, clarify requirements, resolve ambiguities, conduct design and code reviews, and provide technical guidance and mentorship to junior team members.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Performance & Optimization: Perform performance tuning and optimization across Databricks and Apache Spark workloads, pipelines, queries, and data processing jobs.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Security & Governance: Implement Databricks Unity Catalog and fine-grained access controls to support enterprise data governance and security requirements.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Client & Cross-Functional Collaboration: Work closely with business analysts, functional teams, onsite clients, architects, and global delivery teams to translate requirements into effective technical solutions.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Automation & Delivery: Develop reusable templates, frameworks, and scripts to automate development and operational activities. Support project estimation, planning, execution, tracking, and continuous improvement.</li></ul>Required Skills <ul><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Databricks, Azure, Python, SQL, PySpark, Apache Spark, Delta Lake, Lakehouse Architecture, Azure Data Lake Storage Gen2 (ADLS Gen2), Azure Data Factory, Azure Synapse, Azure Key Vault, Cosmos DB, Unity Catalog, Delta Live Tables, Auto Loader, Databricks Workflows, and Apache Airflow.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">5–7 years of experience in Data Engineering with significant hands-on expertise in Databricks on Azure.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Strong experience building metadata-driven ingestion and data quality frameworks using PySpark.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Strong understanding of Lakehouse architecture, data lakes, data warehouses, data marts, 3NF, dimensional modeling, and modern data platforms.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Hands-on experience with Databricks/Spark performance tuning, data pipeline optimization, and scalable data processing.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Experience implementing Unity Catalog and fine-grained data access controls.</li><li style="line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt;">Strong problem-solving, analytical, communication, stakeholder management, and team collaboration skills.</li></ul>We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.

Collected experience requirement

5 - 6 Years