Lead Data Pipeline Engineer

Hello, Truecaller is calling you from Bangalore, India Ready to pick up?Our goal is to make communication smarter, safer, and more efficient, while building trust across the world. With our roots in Sweden and a global reach, we deliver smart services that create meaningful social impact. We are committed to protecting you from fraud, harassment, scam calls, and unwanted messages, so you can focus on the conversations that matter.Top 20 most downloaded apps globally, and the world’s #1 caller ID and spam-blocking service for Android and iOS, with extensive AI capabilities, with more than 450 million active users per month.Founded in 2009, listed on Nasdaq OMX Stockholm and is categorised as a Large Cap. Our focus on innovation, operational excellence, sustainable growth, and collaboration has resulted in consistently high profitability and strong EBITDA margins.A team of 400 people from ~45 different nationalities spread across our headquarters in Stockholm and offices in Bangalore, Mumbai, Gurgaon and Tel Aviv with high ambitions.We in the Data Infrastructure Team work on a vision to empower our product-oriented teams with a complete self-service analytics platform to make data-driven decisions possible in Truecaller, guaranteeing the stability, velocity, and delivery of the mainstream events pipeline.As a Senior Data Engineer - Platform, you will play an important role in the development of data pipelines, frameworks and models to support the understanding of our users and making better product decisions. You will contribute to empowering the product teams with a complete self-serve analytics platform by working on scalable and robust solutions while collaborating with data engineers, data scientists and data analysts across the company.What you bring in: 6+ years of hands-on experience in data engineering and large-scale distributed systemsProven expertise in building and maintaining complex ETL/ELT pipelinesDeep knowledge of orchestration frameworks (e.G., Airflow), and workflow optimisationStrong cloud infrastructure experience (GCP preferred; AWS or Azure also relevant)Expert-level programming in Python or Scala; solid understanding of Spark internalsExperience with CI/CD tools (e.G., Jenkins, GitHub Actions) and infrastructure as codeFamiliarity with managing self-hosted tools like Spark or Airflow on KubernetesExperience managing a data warehouse in BigQuery or RedshiftStrong communication skills and a proactive, problem-solving mindsetThe impact you will create: Design, build and optimise the data ingestion pipeline to reliably deliver billions of events daily in a defined SLALead initiatives to improve scalability, performance and reliabilityProvide support for all product teams in building and optimising their complex pipelinesIdentify and address pain points in the existing data platform; propose and implement high-leverage improvementsDevelop new tools and frameworks to streamline the data platform workflowsDrive adoption of best practices in data and software engineering (testing, CI/CD, version control, monitoring)Work in close collaboration with data scientists and data analysts to help support their work in productionSupport production ML workflows and real-time streaming use casesMentor other engineers and contribute to a culture of technical excellence and knowledge sharingIt would be great if you also have:Working with messaging systems like Kafka, RedpandaExperience with real-time data streaming platforms (e.G., Flink, Spark Structured Streaming)Familiarity with ML platforms or MLOps workflowsLife at Truecaller - Behind the code: https://www.Instagram.Com/lifeattruecaller/Sounds like your dream job?We will fill the position as soon as we find the right candidate, so please send your application as soon as possible. As part of the recruitment process, we will conduct a background check.This position is based in Bangalore, India. We only accept applications in English.What we offer: A smart, talented and agile team: An international team where ~35 nationalities are working together in several locations and time zones with a learning, sharing and fun environment.A great compensation package: Competitive salary, 30 days of paid vacation, flexible working hours, private health insurance, parental leave, telephone bill reimbursement, Udemy membership to keep learning and improving and Wellness allowance.Great tech tools: Pick the computer and phone that you fancy the most within our budget ranges.Office life: We strongly believe in the in-person collaboration and follow an office-first approach while offering some flexibility. Enjoy your days with great colleagues with loads of good stuff to learn from, daily lunch and breakfast and a wide range of healthy snacks and beverages. In addition, every now and then check out the playroom for a fun break or join our exciting parties and or team activities such as Lab days, sports meetups etc. There something for everyoneCome as you are: Truecaller is diverse, equal and inclusive. We need a wide variety of backgrounds, perspectives, beliefs and experiences in order to keep building our great products. No matter where you are based, which language you speak, your accent, race, religion, color, nationality, gender, sexual orientation, age, marital status, etc. All those things make you who you are, and that’s why we would love to meet you.