Senior Data Engineer

6 days ago

Chennai, Tamil Nadu, India Octillion (acquired by TegnaPremion Jan 2024) Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Company Description

Octillion is the only TrustNet certified transparent local platform as a service (PaaS) company that empowers media planning, buying, attribution, and optimization for local and mid-market media companies, co-op advertisers, brands, and agencies. The Octillion PaaS offers both managed and self-service options that help performance marketers and various industries, including retail, automotive, healthcare, and legal, achieve record returns on ad spend with proprietary tech stack, AI-powered decisioning, and contextual targeting tools. When ethics, trust, and transparency in media buying matter, advertisers and agencies rely on Octillion to maximize media accountability and deliver desired business outcomes while minimizing unnecessary costs.

Role Description

This is a full-time role for a Senior Data Engineer, located in Chennai. The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines. Key tasks include data modeling, creating and managing data warehousing solutions, performing Extract, Transform, Load (ETL) processes, and providing data analytics support. The role requires collaboration with cross-functional teams to enhance and optimize technical solutions for improved data processing and analysis.

Qualifications

5-8 years of experience in data engineering, with a focus on building and managing data

pipelines.

  • Strong proficiency in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g.,

MongoDB, Cassandra).

  • Experience in building data pipelines with data warehouses like Snowflake, Redshift
  • Experience in processing unstructured data stored from S3 using Athena, Glue etc.
  • Hands-on experience with Kafka for real-time data streaming and messaging.
  • Solid understanding of ETL processes, data integration, and data pipeline optimization.
  • Proficiency in programming languages like Python, Java, or Scala for data processing.
  • Experience with Apache Spark for big data processing and analytics is an advantage
  • Familiarity with cloud platforms like AWS, GCP , or Azure for data infrastructure is a plus.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Key Responsibilities

  • Design, build, and maintain efficient and scalable data pipelines to support data integration and

transformation across various sources.

  • Work with relational databases (e.g., MySQL, PostgreSQL, etc.) and NoSQL databases (e.g.,
  • MongoDB, Cassandra, etc.) to manage and optimize large datasets.
  • Utilize Apache Spark for distributed data processing and real-time analytics.
  • Implement and manage Kafka for data streaming and real-time data integration between
  • systems.Collaborate with cross-functional teams to gather and translate business requirements

into technical solutions.

  • Monitor and optimize the performance of data pipelines and architectures, ensuring high

availability and reliability.

  • Ensure data quality, consistency, and integrity across all systems.
  • Stay up-to-date with the latest trends and best practices in data engineering and big data

technologies.

  • Senior Data scientist

    7 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Scientist Chennai (AI/ML & BFSI Focus) From models to measurable impact — drive real change with AI.Location: Chennai, India Experience: 6–8 years in Data Science/ML (preferably in BFSI or other data-rich industries) Innovators who don't just build models but drive measurable business impact. Expertise: Fierce desire to use AI in every...

  • Data Engineer

    1 day ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...

  • Senior Software Engineer

    1 week ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Software Engineer Chennai (AI/ML Engineering Focus) Build the backbone of AI — engineer the systems that power enterprise intelligenceLocation: Chennai, India Experience: 6–8 years in software engineering (preferably in AI/ML or data-driven product development) Problem solvers who don't just write code but build scalable, impactful AI...

  • Senior Data Consultant

    6 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are looking for a high-energy individual for the role of Senior Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team.The candidate is expected to lead following work-streams:• Drive client meetings with data-driven insights and observations on key website/app metricsfor Upper...

  • Senior Data Science Manager

    7 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Manager Data Science Chennai (AI/ML, GenAI & BFSI Focus) From vision to enterprise impact — lead the future of AI innovation.Location: Chennai, IndiaExperience: 11–13 years in Data Science/AI/ML (with strong BFSI or other data-rich industry expertise) We're seeking trailblazers who go beyond building models — leaders who drive AI strategy, GenAI...

  • Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, GurugramWork from officeFull timeImmediate joiner Only (15days Notice period only)Candidates with Certification in Databricks is good to haveTechnical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o...

  • Senior GenAI Engineers

    1 day ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    Req ID: 341063NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior GenAI Engineers to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Key Responsibilities Design &...

  • Senior Data Engineer

    20 hours ago

    Chennai, Tamil Nadu, India YuniQ Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionAt YuniQ, we are driven by a singular vision: to harness the power of technology to create a better world. With over two decades of expertise from our founding team, we have witnessed firsthand the incredible transformations that technology has brought to our lives. Our mission is to craft technology solutions that empower brands to...

  • Senior Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per year

    Role: Senior Data Engineer (Scala Specialist)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and...