Senior Data Engineer

4 days ago

Chennai, Tamil Nadu, India Info Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Job Title: Senior Data Engineer

Job Summary

We are looking for a highly skilled
Senior Data Engineer
with expertise in designing, building, and optimizing large-scale data pipelines and integration frameworks. The ideal candidate will have strong experience in
batch and near real-time data processing
within the
AWS ecosystem
, with hands-on exposure to
Databricks, Spark, Flink, and Kafka
. This role requires strong programming skills, advanced SQL knowledge, and the ability to architect scalable, high-performance data solutions to support analytics, AI/ML, and business intelligence initiatives.

Key Responsibilities

  • Design, build, and maintain scalable data pipelines for batch and near real-time data processing.
  • Develop and optimize ETL/ELT workflows using
    Spark, Flink, and Databricks
    .
  • Work extensively within the
    AWS ecosystem
    (S3, Glue, EMR, Redshift, Lambda, etc.) to build reliable data solutions.
  • Implement real-time data streaming and messaging solutions using
    Kafka
    .
  • Write efficient, reusable, and scalable code in
    Scala and Python
    .
  • Design, optimize, and maintain complex queries in
    SQL and SparkSQL
    .
  • Collaborate with data scientists, analysts, and other stakeholders to ensure data availability, quality, and governance.
  • Monitor, troubleshoot, and optimize data workflows for performance and cost-efficiency.
  • Drive best practices in data engineering, automation, and DevOps for data platforms.

Required Skills & Qualifications

  • Proven experience in
    Batch & Near Real-Time Data Integration
    .
  • Strong hands-on expertise with the
    AWS ecosystem
    (data services).
  • Solid experience with
    Databricks, Apache Spark, Flink, and Kafka
    .
  • Proficiency in
    Scala and/or Python
    programming.
  • Strong expertise in
    Advanced SQL and SparkSQL
    for data processing.
  • Strong understanding of distributed data processing and large-scale data architecture.

Preferred Skills

  • Experience with
    Snowflake
    for data warehousing and analytics.
  • Exposure to modern CI/CD, data versioning, and orchestration tools (Airflow, dbt, etc.).
  • Strong problem-solving skills with a focus on scalability and efficiency.

  • Senior Data Engineer

    7 days ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time

    Senior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - 8+ years Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.

  • Senior Data scientist

    9 hours ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Scientist Chennai (AI/ML & BFSI Focus) From models to measurable impact — drive real change with AI.Location: Chennai, India Experience: 6–8 years in Data Science/ML (preferably in BFSI or other data-rich industries) Innovators who don't just build models but drive measurable business impact. Expertise: Fierce desire to use AI in every...

  • Senior Software Engineer

    15 hours ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Software Engineer Chennai (AI/ML Engineering Focus) Build the backbone of AI — engineer the systems that power enterprise intelligenceLocation: Chennai, India Experience: 6–8 years in software engineering (preferably in AI/ML or data-driven product development) Problem solvers who don't just write code but build scalable, impactful AI...

  • Senior Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks and pipelines using Python, Elasticsearch, SQL DB, and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable and...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Senior Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India iAgami Full time

    We're Hiring – Senior Data Engineer (GCP) Are you passionate about building data platforms that process billions of transactions and drive real-time decisions? Join our growing team atiAgamiTechnologies, where innovation meets data engineering excellence. Location: Chennai / Trichy (Remote) Role: Senior Data Engineer Experience: 5+ years Type: Full-time...

  • Senior Data Science Manager

    9 hours ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Manager Data Science Chennai (AI/ML, GenAI & BFSI Focus) From vision to enterprise impact — lead the future of AI innovation.Location: Chennai, IndiaExperience: 11–13 years in Data Science/AI/ML (with strong BFSI or other data-rich industry expertise) We're seeking trailblazers who go beyond building models — leaders who drive AI strategy, GenAI...

  • Senior Data Scientist

    5 days ago

    Chennai, Tamil Nadu, India, Tamil Nadu Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Senior Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India APPIT Software Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Data EngineerLocation: ChennaiJob Type: Contract, 5 monthsExperience: 5-7 yearsJob Summary:We are hiring a Senior Data Engineer to architect enterprise data integration initiatives. This role requires deep technical expertise in data engineering. Familiarity with Oracle Data Integrator (ODI) is preferred, especially in environments using the Oracle...