Lead Data Engineer

Lead Data Engineer

Experience Range: years

Location: Bengaluru, India

We are looking for a Data Engineer to architect and guide the development of scalable data solutions across the enterprise. Youll be instrumental in shaping our data strategy, driving best practices, and mentoring a team of engineers while partnering with cross-functional stakeholders.

Bonus: Experience in Ad Tech, particularly Linear or Addressable Advertising, is a strong plus.

Preferred: Experience supporting Business Intelligence (BI) data platforms, dashboards, and reporting environments is highly valuable.

Responsibilities and Duties of the Role:

• Champion core engineering principles including pipeline reliability, fault tolerance, and automation
• Drive clean architecture patterns, design for extensibility, and enforce rigorous code quality standards
• Coordinate closely with Product Management to align data engineering deliverables with business goals
• Work collaboratively with Program Management to manage execution timelines, dependencies, and reporting
• Partner with QA to ensure robust testing, validation, and data accuracy for each release including system reliability, fault tolerance, and automation
• Drive clean architecture patterns, design for extensibility, and enforce rigorous code quality standards
• Architect and build reusable and modular components for the data platform
• Drive best practices in pipeline design, performance tuning, version control, CI/CD, and observability
• Lead large-scale data migration, warehousing, and platform modernization efforts
• Mentor junior engineers, lead design discussions, and set technical direction
• Collaborate cross-functionally with Product, Analytics, and Infrastructure teams to ensure alignment and scalability
• Ensure high availability and fault tolerance across all data systems and flows.
• Work closely with BI developers to align data models and delivery schedules

Required Qualifications

• Minimum of 8-10 years of relevant data science, Business Intelligence, or data analytics experience preferably with a digital media or digital advertising company
• Experience delivering products in an agile software development environment including sprint work in Jira
• Excellent interpersonal skills with the ability to collaborate and partner across multiple teams and organizations
• Strong SQL experience including writing/optimizing complex queries against distributed data stores such as Aurora, Hadoop, Hive, Oracle, and Snowflake
• Experience with data pipeline and workflow management tools: Apache NiFi or Apache Airflow
• Expert level knowledge in at least one programming language such as Python, R, Scala, Java.
• Demonstrated experience working with business intelligence tools such as MicroStrategy, Tableau, Business Objects, Looker, etc.

Category Technologies

Languages - Scala, Python, SQL

Data Processing - Apache Spark, Flink, Airflow

Platforms & Tools - Databricks, Hive, Presto, Snowflake

Cloud - AWS (S3, EMR, Glue, Lambda)

• Demonstrated ability to effectively communicate complex concepts to technical and unacquainted audiences
• Experience in working with large datasets (Terabytes or more)
• Strong presentation and documentation skills including experience working with Confluence, Power Point, and Lucid Chart
• Strong analytical and critical thinking skills
• Enjoy working collaboratively with a talented group of people to tackle challenging business problems so we all succeed (or fail fast) as a team.

Preferred Qualifications

• Experience with digital advertising systems and ecosystems
• Experience using data analytics to triage and troubleshoot advertising workflows
• Experience with network topologies, systems architecture overviews, and entity relationship diagrams (ERD)

Required Education

Bachelors degree in computer science, Data Analytics or Science, Applied Mathematics, Statistics, related technical fields, or equivalent experience