Senior Data Engineer

6 days ago

Chennai, Tamil Nadu, India Info Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Job Title: Senior Data Engineer

Job Summary

We are looking for a highly skilled
Senior Data Engineer
with expertise in designing, building, and optimizing large-scale data pipelines and integration frameworks. The ideal candidate will have strong experience in
batch and near real-time data processing
within the
AWS ecosystem
, with hands-on exposure to
Databricks, Spark, Flink, and Kafka
. This role requires strong programming skills, advanced SQL knowledge, and the ability to architect scalable, high-performance data solutions to support analytics, AI/ML, and business intelligence initiatives.

Key Responsibilities

  • Design, build, and maintain scalable data pipelines for batch and near real-time data processing.
  • Develop and optimize ETL/ELT workflows using
    Spark, Flink, and Databricks
    .
  • Work extensively within the
    AWS ecosystem
    (S3, Glue, EMR, Redshift, Lambda, etc.) to build reliable data solutions.
  • Implement real-time data streaming and messaging solutions using
    Kafka
    .
  • Write efficient, reusable, and scalable code in
    Scala and Python
    .
  • Design, optimize, and maintain complex queries in
    SQL and SparkSQL
    .
  • Collaborate with data scientists, analysts, and other stakeholders to ensure data availability, quality, and governance.
  • Monitor, troubleshoot, and optimize data workflows for performance and cost-efficiency.
  • Drive best practices in data engineering, automation, and DevOps for data platforms.

Required Skills & Qualifications

  • Proven experience in
    Batch & Near Real-Time Data Integration
    .
  • Strong hands-on expertise with the
    AWS ecosystem
    (data services).
  • Solid experience with
    Databricks, Apache Spark, Flink, and Kafka
    .
  • Proficiency in
    Scala and/or Python
    programming.
  • Strong expertise in
    Advanced SQL and SparkSQL
    for data processing.
  • Strong understanding of distributed data processing and large-scale data architecture.

Preferred Skills

  • Experience with
    Snowflake
    for data warehousing and analytics.
  • Exposure to modern CI/CD, data versioning, and orchestration tools (Airflow, dbt, etc.).
  • Strong problem-solving skills with a focus on scalability and efficiency.

  • Senior Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time

    Senior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - 8+ years Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.

  • Senior Data scientist

    2 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Scientist Chennai (AI/ML & BFSI Focus) From models to measurable impact — drive real change with AI.Location: Chennai, India Experience: 6–8 years in Data Science/ML (preferably in BFSI or other data-rich industries) Innovators who don't just build models but drive measurable business impact. Expertise: Fierce desire to use AI in every...

  • Senior Software Engineer

    2 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Software Engineer Chennai (AI/ML Engineering Focus) Build the backbone of AI — engineer the systems that power enterprise intelligenceLocation: Chennai, India Experience: 6–8 years in software engineering (preferably in AI/ML or data-driven product development) Problem solvers who don't just write code but build scalable, impactful AI...

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks and pipelines using Python, Elasticsearch, SQL DB, and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable and...

  • Senior Data Science Manager

    2 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Manager Data Science Chennai (AI/ML, GenAI & BFSI Focus) From vision to enterprise impact — lead the future of AI innovation.Location: Chennai, IndiaExperience: 11–13 years in Data Science/AI/ML (with strong BFSI or other data-rich industry expertise) We're seeking trailblazers who go beyond building models — leaders who drive AI strategy, GenAI...

  • Senior Data Scientist

    4 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Senior Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India iAgami Full time

    We're Hiring – Senior Data Engineer (GCP) Are you passionate about building data platforms that process billions of transactions and drive real-time decisions? Join our growing team atiAgamiTechnologies, where innovation meets data engineering excellence. Location: Chennai / Trichy (Remote) Role: Senior Data Engineer Experience: 5+ years Type: Full-time...

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India ResourceTree Global Services Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionResourceTree Global Services Pvt Ltd. (ResourceTree) is a Talent Builder focused on offering careers to professionals across various industries such as IT, Manufacturing, Services, Banking, Agri-tech, Edu-tech, and more. With over 7 years of experience, ResourceTree has helped clients hire top-tier talent by utilizing multi-pronged...

  • Senior Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India RapidBrains Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Title:Senior Data Engineer – ODILocation:ChennaiJob Type:ContractExperience :5.5+ YearsWe are seeking a highly skilled Senior Data Engineer with hands-on experience in Oracle Data Integrator (ODI) and enterprise data integration technologies. The ideal candidate will design, build, and optimize scalable data pipelines supporting advanced analytics and...

  • Senior Data Engineer – Datastage

    2 days ago

    Chennai, Tamil Nadu, India Systech Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Engineer – DatastageAbout the CompanySystech is a modern Data and Analytics consulting firm, helping clients embed data-driven capabilities into their business operations. We offer end-to-end data engineering services and outcomes-based analytics solutions, to drive your business forward in the digital age. Systech has over 30 years of...