Senior Data Engineer

5 hours ago

Chennai, Tamil Nadu, India C1X Full time ₹ 8,00,000 - ₹ 24,00,000 per year

As a Senior Data Engineer, you will design, build, and scale data platforms and pipelines that power our AdTech ecosystem. You will collaborate closely with product, analytics, and engineering teams to ensure data is accurate, reliable, and actionable for business and product decision-making.

This role requires strong technical expertise, problem-solving ability, and hands-on experience with modern data engineering practices.

Key Responsibilities

  • Architect, build, and optimize large-scale batch and streaming data pipelines using frameworks such as Apache Spark on GCP (mandatory) or AWS.
  • Design, manage, and automate data flows across multiple systems and data stores.
  • Define and enforce data quality, reliability, and governance standards.
  • Develop scalable, efficient, and secure data processing solutions.
  • Collaborate with cross-functional teams (Product, Analytics, Engineering) to translate business requirements into robust data solutions.
  • Implement CI/CD, testing, and automation best practices for data workflows.
  • Monitor and optimize system performance and cost efficiency.
  • Stay current with emerging technologies and drive continuous improvements in the data stack.

Qualifications

  • Experience: 48 years in data engineering or backend data systems.
  • Strong foundation in data structures, algorithms, and system design.
  • Proficiency in Python or Scala (preferred).
  • Hands-on experience with Big Data frameworks: Spark, Hadoop, Hive, Sqoop, HDFS, Airflow, Zookeeper.
  • Mandatory: Experience working with Google Cloud Platform (GCP) — BigQuery, Dataflow, Composer, Dataproc, Pub/Sub, Cloud Storage, etc.
  • Experience with Databricks Notebooks and Jobs API is a strong plus.
  • Strong knowledge of SQL (RDBMS + NoSQL: Postgres, MySQL, Redshift, Redis) with query optimization and schema design.
  • Familiarity with Docker, Kubernetes, and workflow orchestration tools such as Airflow or Luigi.
  • Proficient with Git and collaborative development workflows.
  • Excellent communication, analytical, and problem-solving skills.

Role Details

  • Role: Senior Data Engineer
  • Industry Type: Software Product (AdTech / MarTech)
  • Department: Engineering – Data & Software
  • Employment Type: Full Time, Permanent
  • Role Category: Data Engineering / Software Development

Key Skills

Big Data Frameworks, GCP (Mandatory), AWS, Spark, Python, Scala, Hadoop, Hive, Airflow, Databricks, SQL, Schema Design, Data Structures, Algorithms, Docker, Kubernetes, MySQL, Postgres, Redshift, DynamoDB, Redis, Git, CI/CD, Data Quality, Streaming PipelinRole & responsibilities

  • Senior Data scientist

    1 week ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Scientist Chennai (AI/ML & BFSI Focus) From models to measurable impact — drive real change with AI.Location: Chennai, India Experience: 6–8 years in Data Science/ML (preferably in BFSI or other data-rich industries) Innovators who don't just build models but drive measurable business impact. Expertise: Fierce desire to use AI in every...

  • Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...

  • Senior Software Engineer

    1 week ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Software Engineer Chennai (AI/ML Engineering Focus) Build the backbone of AI — engineer the systems that power enterprise intelligenceLocation: Chennai, India Experience: 6–8 years in software engineering (preferably in AI/ML or data-driven product development) Problem solvers who don't just write code but build scalable, impactful AI...

  • Senior Data Consultant

    1 week ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are looking for a high-energy individual for the role of Senior Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team.The candidate is expected to lead following work-streams:• Drive client meetings with data-driven insights and observations on key website/app metricsfor Upper...

  • Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Data Engineer – Chennai Build the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights. Location: Chennai, India Experience: 2–3 years in data engineering or data-driven product development Role Overview As a Data Engineer, you will be responsible for building and...

  • Senior Data Science Manager

    1 week ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Manager Data Science Chennai (AI/ML, GenAI & BFSI Focus) From vision to enterprise impact — lead the future of AI innovation.Location: Chennai, IndiaExperience: 11–13 years in Data Science/AI/ML (with strong BFSI or other data-rich industry expertise) We're seeking trailblazers who go beyond building models — leaders who drive AI strategy, GenAI...

  • Senior Data Scientist

    2 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Senior Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India YuniQ Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionAt YuniQ, we are driven by a singular vision: to harness the power of technology to create a better world. With over two decades of expertise from our founding team, we have witnessed firsthand the incredible transformations that technology has brought to our lives. Our mission is to craft technology solutions that empower brands to...

  • Senior Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India Grethena Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company Description:Company:  Grethena Private LimitedLocation:  ChennaiExperience:5+ yearsSalary:   As per market standardsJob Title:Senior Data EngineerAbout us:Grethena - Shaping The Digital Landspace Our team of experts has years of experience in App, AI, OTT Platform and Booking App Development. We are passionate about helping our clients succeed...