Senior Data Engineer

2 months ago

Bengaluru, India Kloud9 Full time

Job Description :


As a Senior Data Engineer, you will partner with Software Engineers, Data Scientists and Business Intelligence Engineers. You will gain a deep understanding of our services and the data they produce and become our resident expert in how to transform that data into a format that is useful for analytics and business intelligence. You will proactively help to identify new data for integration with the platform and propose and implement new technologies to help us better understand our data.

- Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and design optimal data solutions on AWS.

- Design, develop, and maintain data pipelines and ETL processes to move data from various sources into our data lake and data warehouse on AWS.


- Implement efficient and reliable data transformation, cleansing, and enrichment processes to ensure high- quality data for downstream analytics and reporting.

- Optimize data pipelines for performance, scalability, and cost-effectiveness using AWS services such as Amazon Redshift, Amazon S3, AWS Glue, AWS Lambda, etc.

- Ensure data security and compliance by implementing appropriate data access controls, encryption mechanisms, and auditing processes.


- Monitor and troubleshoot data pipeline issues, performance bottlenecks, and data quality problems, and implement solutions to address them.

- Design and implement product features in collaboration with business and Technology stakeholders. Anticipate, identify, and solve issues concerning data management to improve data quality.

- Design and build reusable components, frameworks, and libraries at scale to support analytics products. Clean, prepare and optimize data at scale for ingestion and consumption.

- Clean, prepare and optimize data at scale for ingestion and consumption.


- Drive the implementation of new data management projects and re-structure of the current data architecture.

- Implement complex automated workflows and routines using workflow scheduling tools. Build continuous integration, test-driven development, and production deployment frameworks.

- Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards.


- Analyse and profile data for the purpose of designing scalable solutions.

- Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues. Mentor and develop other data engineers in adopting best : BE / BTECH | MTech | MCA

- Minimum 3+ years of work experience in development / Migration project.

- Experience working with distributed technology tools for developing Batch and Streaming pipelines using.

1. SQL, Spark, Python

2. Airflow

2. Scala

Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.

- Able to quickly pick up new programming languages, technologies, and frameworks.

- Strong skills building positive relationships across Product and Engineering.

- Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders

- Experience with creating/ configuring Jenkins pipeline for smooth CI/CD process for Managed Spark jobs, build Docker images, etc.

- Working knowledge of Data warehousing, Data modelling, Governance and Data Architecture

Good to have:

Experience working with Data platforms, including EMR, Airflow, Data bricks (Data Engineering & Delta Lake components, and Lakehouse Medallion architecture), etc.

Experience working in Agile and Scrum development process.

Experience in EMR/ EC2, Data bricks etc.

Experience working with Data warehousing tools, including SQL database, Presto, and Snowflake

Experience architecting data product in Streaming, Server less and Microservices Architecture and platform.

(ref:hirist.tech)

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India. The successful candidate will have a strong background in AWS cloud services, expertise in SQL and relational databases, and proficiency in Python programming.Key Responsibilities:Design and implement data engineering...

  • Senior Data Engineer

    6 days ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 302206 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job...

  • Senior Data Engineering Specialist

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Senior Data Engineering Specialist to join our team in Bangalore, India. The successful candidate will have a strong background in ETL development and data engineering using Azure concepts and technologies.Key ResponsibilitiesDesign and implement high and low-level design documents for ETL processes.Develop ETL code in...

  • Senior Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a $30+ billion global innovator of business and technology services. We help clients innovate, optimize, and transform for success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem. Our services include business and technology consulting, data and artificial intelligence,...

  • Senior Data Engineer

    1 week ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 302206 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job PurposeThe senior data...

  • Data Engineering Senior Specialist

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineering Senior Specialist RoleDiverse and dynamic Data Engineering activities on Azure Data platform. The role involves building and delivering Data pipelines connecting various enterprise data sources, both RDBMS and NoSQL. Develop data mappings to existing data sources and design big data processing notebooks using Azure Databricks. Scripting and...

  • Senior Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Data Engineer - Cloud Solutions Diverse Data Engineering activities on Azure Data platform. Build & Deliver Data pipeline connecting various enterprise data sources. Develop data mappings to existing data sources. Design and develop big data processing notebooks using Azure Databricks. Scripting and programming using programming languages...

  • Data Engineering Specialist

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job SummaryReq ID: 302206NTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India.Job PurposeThe Senior Data Engineer will play a key role within the Data & Analytics team, designing, building, and maintaining systems and infrastructure for processing, collecting, storing, and analyzing large volumes of data.Key...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the Role:We are seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India. The ideal candidate will have a strong background in AWS cloud services, including lambda, glue, s3, emr, sns, sqs, cloudwatch, and redshift.Key Responsibilities:Design and implement scalable data pipelines using AWS servicesDevelop and maintain...

  • Data Systems Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India. The ideal candidate will have a strong background in designing, building, and maintaining data systems.Key ResponsibilitiesDesign and develop data warehouses and data models to support business intelligence and analytics.Create and maintain data...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OpportunityReq ID: 286326 NTT DATA Services is a global leader in IT and business services, committed to helping clients succeed in a rapidly changing world. We are seeking a talented Sr Data Engineer to join our team in Bangalore, India.This role requires a strong background in AWS cloud services, including Lambda, Glue, S3, EMR, SNS, SQS, CloudWatch,...

  • Senior Data Analytics Specialist

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: Senior Data Analytics SpecialistAbout the Role:We are seeking a skilled Senior Data Analytics Specialist to join our team in India. As a Senior Data Analytics Specialist, you will play a key role in designing, building, and maintaining the systems and infrastructure necessary for processing, collecting, storing, and analyzing large volumes of...

  • AWS Data Engineer Senior Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: AWS Data Engineer Senior SpecialistAbout the Role:We are seeking a highly skilled AWS Data Engineer Senior Specialist to join our team at NTT DATA Services. As a key member of our team, you will be responsible for designing, developing, and implementing data pipelines using AWS services such as Glue, Python, and Data Pipeline creation.Key...

  • AWS Data Engineer Senior Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: AWS Data Engineer Senior SpecialistAbout the Role:We are seeking a highly skilled AWS Data Engineer Senior Specialist to join our team at NTT DATA Services. As a key member of our team, you will be responsible for designing, developing, and implementing data pipelines using AWS services such as Glue, Python, and Data Pipeline creation.Key...

  • AWS Data Engineer Senior Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: AWS Data Engineer Senior SpecialistJob Summary:We are seeking a highly skilled AWS Data Engineer Senior Specialist to join our team at NTT DATA Services. As a key member of our team, you will be responsible for designing, developing, and implementing data pipelines using AWS services such as Glue, Python, and Data Pipeline creation.Key...

  • Senior Lead Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Lead EngineerJob Summary:NTT DATA Services is seeking a Senior Lead Engineer to join our team in Remote, India. As a Senior Lead Engineer, you will be responsible for developing custom business logic in APEX, writing test classes, creating Lightning Web Components, Visualforce Pages, and Triggers.Key Responsibilities:Develop custom business...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at NTT DATA Services. As a Data Engineer, you will be responsible for designing and developing data pipelines utilizing Cloud technologies Azure/AWS/GCP.Key ResponsibilitiesDesign and develop data pipelines using Cloud technologies Azure/AWS/GCPLead a team of Data Engineers and act...

  • Senior Cloud Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Cloud EngineerNTT DATA Services is seeking a highly skilled Senior Cloud Engineer to join our team. As a Senior Cloud Engineer, you will be responsible for designing, developing, and implementing cloud-based solutions using leading platforms like Salesforce Consumer Goods Cloud.Key Responsibilities:Design and develop cloud-based solutions...

  • Sr data engineer

    4 months ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 286326 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Senior data...

  • Senior Lead Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Lead EngineerJob Summary:We are seeking a Senior Lead Engineer to join our team in Remote, India. The ideal candidate will have experience developing custom business logic in APEX, writing test classes, creating Lightning Web Components, Visualforce Pages, and Triggers.Key Responsibilities:Develop custom business logic in APEXWrite test...