Assistant Manager - Data Engineering
LatentView Analytics · Bangalore
Source and collection record
Last observed by our collector: . This is not a manual review or a confirmation from the employer.
Job type and experience labels are automated discovery categories. The employer determines eligibility. Original experience wording was not retained separately; check the current employer page.
Your application evidence checklist
Mark the statements you can support after reading the employer source. This checklist stays on this page; it does not score your eligibility or submit an application.
0 of 2 checks marked. Keep unresolved requirements as questions for the employer.
Collected role description
<p><b><span style="font-family:Georgia;font-size:14px;">Designation : </span></b><span style="font-size:14px;font-family:Georgia;"><b>Assistant Manager - Data Engineering</b></span></p><p><b><span style="font-family:Georgia;font-size:14px;">Level : L3</span></b></p><p><b><span style="font-family:Georgia;font-size:14px;">Location : </span></b><span style="font-size:14px;font-family:Georgia;"><b>Bengaluru, Karnataka , India (BLR)</b></span></p><p><b><span style="font-family:Georgia;font-size:14px;">Experience : 5 to 8 Years</span></b></p><p><br /></p><p><b><span style="font-family:Georgia;font-size:14px;">Job Role </span></b><span style="font-family:Georgia;font-size:14px;">:</span></p><p><span style="font-size:14px;font-family:Georgia;">We're looking for a Senior Data Engineer with strong data architecture and system design</span></p><p><span style="font-size:14px;font-family:Georgia;">skills to design, build, and own end-to-end production pipelines powering analytics and</span></p><p><span style="font-size:14px;font-family:Georgia;">decision-making across the org. The role centers on deep Python + SQL expertise, robust</span></p><p><span style="font-size:14px;font-family:Georgia;">transaction-level fact tables, and rigorous data quality and auditability, ideally within a finance,</span></p><p><span style="font-size:14px;font-family:Georgia;">risk, or compliance data domain. Internal candidates familiar with Uber's data platform stack</span></p><p><span style="font-size:14px;font-family:Georgia;">(Piper/uWorc, Databook, uSecret, DSW, SourceGraph, Query Builder, OneETL) will be</span></p><p><span style="font-size:14px;font-family:Georgia;">prioritized.</span></p><div><br /></div><p><b><span style="font-family:Georgia;font-size:14px;">Responsibilities </span></b><span style="font-family:Georgia;font-size:14px;">:</span><br /></p><p><span style="font-size:14px;font-family:Georgia;">● Own data architecture and system design decisions for pipelines and data models -</span></p><p><span style="font-size:14px;font-family:Georgia;">grain, partitioning, schema evolution, and scalability tradeoffs.</span></p><p><span style="font-size:14px;font-family:Georgia;">● Take end-to-end ownership of pipelines in production: design, build, deploy, monitor,</span></p><p><span style="font-size:14px;font-family:Georgia;">and operate.</span></p><p><span style="font-size:14px;font-family:Georgia;">● Design and build transaction tables (append-only, immutable event/transaction-grain fact</span></p><p><span style="font-size:14px;font-family:Georgia;">tables) alongside standard fact/dimension models using medallion (bronze/silver/gold)</span></p><p><span style="font-size:14px;font-family:Georgia;">architecture.</span></p><p><span style="font-size:14px;font-family:Georgia;">● Build and support pipelines for finance, risk, or compliance use cases where</span></p><p><span style="font-size:14px;font-family:Georgia;">accuracy, auditability, and data lineage are critical.</span></p><p><span style="font-size:14px;font-family:Georgia;">● Implement data quality and auditability controls: validation checks, reconciliation</span></p><p><span style="font-size:14px;font-family:Georgia;">logic, anomaly detection, and audit trails for every pipeline you own.</span></p><p><span style="font-size:14px;font-family:Georgia;">● Write complex, cross-dialect SQL (MySQL + PostgreSQL): window functions,</span></p><p><span style="font-size:14px;font-family:Georgia;">multi-layered CTEs, CASE-driven logic, COALESCE/NULLIF, type casting, and</span></p><p><span style="font-size:14px;font-family:Georgia;">date/timestamp handling.</span></p><p><span style="font-size:14px;font-family:Georgia;">● Build idempotent reload patterns (DELETE+INSERT), UNION ALL/set operations, and</span></p><p><span style="font-size:14px;font-family:Georgia;">templated (Jinja-style) SQL including handling for late-arriving/corrected transaction</span></p><p><span style="font-size:14px;font-family:Georgia;">records without double-counting.</span></p><p><span style="font-size:14px;font-family:Georgia;">● Orchestrate Airflow-style DAGs (Pipeline/BaseTask, ExternalTaskSensor for</span></p><p><span style="font-size:14px;font-family:Georgia;">cross-pipeline deps) with secure credential handling via uSecret.</span></p><p><span style="font-size:14px;font-family:Georgia;">● Build Python ETL tooling: pandas (CSV ↔ DB), SQLAlchemy + raw drivers (MySQLdb,</span></p><p><span style="font-size:14px;font-family:Georgia;">psycopg2), type hints/dataclasses, class-based pipeline design.</span></p><p><span style="font-size:14px;font-family:Georgia;">● Integrate with Google Drive/Sheets APIs; build YAML-driven pipeline configs; handle</span></p><p><span style="font-size:14px;font-family:Georgia;">Piper staging/user_staging quirks.</span></p><p><span style="font-size:14px;font-family:Georgia;">● Own CI/CD for pipelines via standard Git workflows.</span></p><p><span style="font-size:14px;font-family:Georgia;">● Use Uber's internal stack day-to-day: OneETL for pipeline authoring, Piper/uWorc for</span></p><p><span style="font-size:14px;font-family:Georgia;">scheduling, Databook for lineage, uSecret for credentials, DSW notebooks for CSV/table</span></p><p><span style="font-size:14px;font-family:Georgia;">work, SourceGraph for code search, Query Builder for ad hoc SQL</span></p><p><br /><b><span style="font-family:Georgia;font-size:14px;">Required skills </span></b><span style="font-family:Georgia;font-size:14px;">: </span></p><p><span style="font-size:14px;font-family:Georgia;">Primary Skills: Data Engineering, Data Architecture & System Design, Data Modeling (Fact/Dim, Medallion), Expert SQL, Advanced Python, Workflow Orchestration (Airflow), Data Quality & Auditability, Financial/Risk/Compliance Data.</span></p><p><span style="font-size:14px;font-family:Georgia;">Secondary Skills: Hive/Hadoop, Cross-dialect SQL (MySQL/PostgreSQL), Data Lineage & Reconciliation, Production Support & Monitoring.</span></p><p></p><p dir="ltr" style="line-height:1.38;text-align:justify;background-color:#ffffff;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:14px;font-family:Georgia;color:rgb(42,51,62);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.</span></p>
Collected experience requirement
6 - 8 Years