Senior Software Engineer - Planner

Role overview

Senior Software Engineer - Planner at e6data Inc.

Responsibilities

• Lead the development, testing, and maintenance of the query optimizer for e6data's data lake query engine.
• Design and build sophisticated capabilities in the optimizer, including the Learning Optimizer, which intelligently detects and generates essential statistics.

Required qualifications

• Deep Understanding of Database Internals: Requires profound knowledge of how the query optimizer works, including an understanding of various access paths, join algorithms, and join ordering algorithms.
• Theoretical Understanding: A sound theoretical understanding of relational algebra and query rewrites.
• Problem-Solving Abilities: Exceptional ability to troubleshoot and optimize SQL execution plans, particularly in identifying and resolving performance bottlenecks.
• Programming
• Proficiency in Java, with extensive experience in building and optimizing large-scale distributed systems.
• Experience with Advanced Frameworks: Experience with Apache Calcite or similar query optimization frameworks; familiarity with AI and machine learning models, especially in the context of database systems.
• Benefits Why Join Us?:
• Be part of a team that is pushing the boundaries of what’s possible in analytics.
• Lead initiatives that deliver tangible value and impact a wide array of industries.
• Enjoy a dynamic and innovative work environment where your contributions are recognized and valued.

Employment details

• Location: Bangalore North [Karnataka] [India]

Additional role details

• Implement advanced optimization techniques, such as cost-based optimization and rule- based optimization, to enhance engine performance.
• Leverage past query executions to improve cardinality estimates.
• Fine-tune the optimizer to handle complex queries, such as those involving intricate joins, subqueries, or large datasets, ensuring the engine can support diverse customer workloads efficiently.
• Integrate AI-driven optimization techniques to significantly enhance the efficiency of SQL query execution.
• Mentor junior engineers and contribute to the overall architectural decisions of the engine team.