Senior Data Engineer

2 weeks ago

Bengaluru, Karnataka, India Optimum Solutions Pte Ltd Full time

Role Overview

We are looking for a Senior Data Engineer who can lead the design and development of large-scale data systems on AWS.

This role requires someone with strong technical leadership, hands-on experience with modern data architectures, and a proven track record of delivering enterprise-grade data solutions.

Key Responsibilities

  • Architect and implement end-to-end data pipelines using AWS cloud-native services.
  • Design data lake, lakehouse, and warehouse architectures optimized for performance, scalability, and cost.
  • Lead technical design reviews, code reviews, and solution walkthroughs with internal and client teams.
  • Collaborate with stakeholders including data scientists, analysts, product owners, and enterprise architects to define data needs.
  • Drive best practices in data engineering including testing, versioning, logging, and CI/CD for data pipelines.
  • Implement security, data quality, and governance frameworks across data environments.
  • Troubleshoot and optimize data workflows in production systems.
  • Mentor and guide junior engineers on design, implementation, and delivery standards.

Must-Have Qualifications

  • 8 years of experience in data engineering or a similar field.
  • Expertise in building batch and real-time data pipelines using AWS services:
  • S3, Glue, EMR, Redshift, Athena, Lambda, Kinesis, Step Functions, CloudFormation
  • Strong programming skills in Python and SQL ; working knowledge of PySpark or Scala .
  • Deep understanding of data modeling, partitioning, and performance tuning.
  • Active AWS Certification (e.g., AWS Certified Data Analytics or Solutions Architect – Associate/Professional).
  • Strong understanding of data privacy, security, and compliance requirements.
  • Experience with orchestration tools (e.g., Airflow, Step Functions) and CI/CD automation.

Preferred Skills

  • Familiarity with Delta Lake, Iceberg, or Apache Hudi.
  • Experience with IaC tools such as Terraform or CloudFormation .
  • Exposure to multi-cloud or hybrid data architectures (GCP, Azure optional).
  • Worked in agile and client-facing consulting environments.
  • Prior experience in BFSI or Telco domain preferred.

  • Senior Associate Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...

  • senior hydraulic systems design expert

    2 days ago

    Bengaluru, Karnataka, India beBeehydraulic engineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title:">Senior Hydraulic Systems Design Expert"> ">Job Summary:"]}We are seeking an experienced Senior Hydraulic Systems Design Expert to join our team. As a key member of the engineering department, you will be responsible for designing, developing, and improving hydraulic systems, components, and handling ECNs and ECRs for power equipment and...

  • Senior Data Engineer

    5 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 37,50,000 - ₹ 45,00,000

    Job Opportunity: Senior Data Engineer">We are seeking a highly experienced and skilled Senior Data Engineer to contribute to the design, development, and deployment of large-scale data systems.">This role involves designing, developing, and deploying large-scale data systems that support our business needs. A high degree of technical expertise is required to...

  • Senior Quality Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionReq ID:332649NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Quality Engineer - Remote to join our team in Bangalore, Karntaka (IN-KA), India (IN).Senior Quality...

  • Senior Data Engineer

    7 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and executing test cases for ETL processes and data pipelines.You will perform source-to-target data validation, data quality checks, and reconciliation using your strong expertise in SQL for...

  • Senior Data Engineer

    2 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Senior Data Engineer - MumbaiThe role of Senior Data Engineer is an exciting opportunity for a seasoned professional to drive the development and implementation of our data pipelines, leveraging their expertise in PySpark and Spark APIs.This position requires a strong background in data engineering, with experience in designing, developing, and maintaining...

  • Senior Data Engineer

    5 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Engineer PositionWe are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in designing and implementing large-scale data systems.The Senior Data Engineer will be responsible for owning end-to-end delivery of large features and systems, defining...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India One Click AI Full time

    Senior Data EngineerJob Description : Senior Data EngineerCompany : Think Right Type : : Type : HybridSenior Data Engineer at Think Right Technologies will be responsible for building and deploying scalable data driven solutions. Data Engineers are responsible for working with both SQL and NoSQL technologies and collaborating with other product...

  • Senior Cloud Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Cloud Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN).Request you to share these Screening...

  • Senior Data Engineer

    6 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    We're looking for Senior professionals to join our Data Engineering team. The ideal candidate will have 4-8 years of industry experience in data engineering principles, including data sourcing, integration, management, and transformation.Key ResponsibilitiesConduct system analysis and design moderate to highly complex programs.Support data analysis and...