Senior Software Engineer

4 weeks ago

Bangalore North, Karnataka, India e6data Full-time
● Lead the development, testing, and maintenance of the query optimizer for e6data's data
lake query engine.
● Implement advanced optimization techniques, such as cost-based optimization and rule-
based optimization, to enhance engine performance.
● Design and build sophisticated capabilities in the optimizer, including the Learning
Optimizer, which intelligently detects and generates essential statistics. Leverage past
query executions to improve cardinality estimates.
● Fine-tune the optimizer to handle complex queries, such as those involving intricate
joins, subqueries, or large datasets, ensuring the engine can support diverse customer
workloads efficiently.
● Integrate AI-driven optimization techniques to significantly enhance the efficiency of SQL
query execution.
● Mentor junior engineers and contribute to the overall architectural decisions of the
engine team.

Requirements

● Deep Understanding of Database Internals: Requires profound knowledge of how the
query optimizer works, including an understanding of various access paths, join
algorithms, and join ordering algorithms.
● Theoretical Understanding: A sound theoretical understanding of relational algebra
and query rewrites.
● Problem-Solving Abilities: Exceptional ability to troubleshoot and optimize SQL
execution plans, particularly in identifying and resolving performance bottlenecks.
● Programming Experience: Proficiency in Java, with extensive experience in building
and optimizing large-scale distributed systems.
● Experience with Advanced Frameworks: Experience with Apache Calcite or similar
query optimization frameworks; familiarity with AI and machine learning models,
especially in the context of database systems.

Benefits

Why Join Us?:
● Be part of a team that is pushing the boundaries of what’s possible in analytics.
● Lead initiatives that deliver tangible value and impact a wide array of industries.
● Enjoy a dynamic and innovative work environment where your contributions are
recognized and valued.