Senior Software Engineer - Planner

● Lead the development, testing, and maintenance of the query optimizer for e6data's data lake query engine. ● Implement advanced optimization techniques, such as cost-based optimization and rule- based optimization, to enhance engine performance. ● Design and build sophisticated capabilities in the optimizer, including the Learning Optimizer, which intelligently detects and generates essential statistics. Leverage past query executions to improve cardinality estimates. ● Fine-tune the optimizer to handle complex queries, such as those involving intricate joins, subqueries, or large datasets, ensuring the engine can support diverse customer workloads efficiently. ● Integrate AI-driven optimization techniques to significantly enhance the efficiency of SQL query execution. ● Mentor junior engineers and contribute to the overall architectural decisions of the engine team. Requirements ● Deep Understanding of Database Internals: Requires profound knowledge of how the query optimizer works, including an understanding of various access paths, join algorithms, and join ordering algorithms. ● Theoretical Understanding: A sound theoretical understanding of relational algebra and query rewrites. ● Problem-Solving Abilities: Exceptional ability to troubleshoot and optimize SQL execution plans, particularly in identifying and resolving performance bottlenecks. ● Programming Experience: Proficiency in Java, with extensive experience in building and optimizing large-scale distributed systems. ● Experience with Advanced Frameworks: Experience with Apache Calcite or similar query optimization frameworks; familiarity with AI and machine learning models, especially in the context of database systems. Benefits Why Join Us?: ● Be part of a team that is pushing the boundaries of what’s possible in analytics. ● Lead initiatives that deliver tangible value and impact a wide array of industries. ● Enjoy a dynamic and innovative work environment where your contributions are recognized and valued.