Developer - Data Engineering

3 months ago


Bengaluru, Karnataka, India 3M Technology Center of Excellence Full time

Developer - Data Engineering is a part of the Data & Analytics function to work on designing, developing, testing, and supporting Digital Data Core pipelines and complex data models development in Amazon Web Services (AWS) and deliver insights to the business.

Primary Responsibilitiesinclude but are not limited to the following:

  • Designs, develops, and maintains scalable data pipelines with delta mechanism in AWS Lake using AWS services and PySpark.
  • Analyzes, designs, develops, tests, deploys and supports Data models in AWS S3 using Spark SQL based on extracts from various sources based on functional design specifications
  • Stay up to date with industry trends and best practices in data engineering, AWS services, AWS Lake, PySpark and Athena
  • Reviews business requirements, helps to create functional design, and develops technical design documents and data lineage, data dictionaries, and metadata management.
  • Understands the functionality of business processes and data that will be required to build, test and implementation.
  • Performs SQL scripting.
  • Participates actively in local and global teams.

Requirements:

  • Bachelors degree in computer science, Engineering or Technology from an accredited university
  • A minimum of 2-4 years of solid experience in data warehousing including data pipelines and data modeling particularly on AWS platform
  • 2-4 of years strong experience in Python, PySpark with SQL scripting
  • 2-3 years Solid experience with AWS services such as S3, Amazon EKS, Amazon EMR, CloudFormation, AWS Secrets Manager, Glue and Athena
  • Good experience in Relational Databases and concepts
  • Extensive working knowledge on any of the business processes including sales, finance, supply chain, manufacturing, Master Data etc.
  • Detail oriented, self-directed and have strong independent problem-solving, analytical and multi-tasking skills with English fluency
  • Have a strong background and interest in technology
  • Additional Job Description

Additional Job Description:

  • AWS certification - Professional is a plus.
  • Good working knowledge in Databricks is preferable.

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at NTT DATA. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines using Azure data factory and Azure databricks.Key Responsibilities:Design and develop innovative data pipelines using Azure...

  • Data Engineer

    7 days ago


    Bengaluru, Karnataka, India iKrux Engineering Full time

    iKrux Engineering: We are seeking a talented Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining Java-based backend applications, ensuring scalability, reliability, and performance.Responsibilities:Data Processing: Utilize Apache Spark to process and analyze large volumes of data...

  • Data Engineer

    4 days ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Diverse Data Engineering Activities on Azure Data PlatformMain Responsibilities:Design and develop big data processing notebooks using Azure DatabricksLead the data identification, data analysis efforts for data sources and work directly with data owner teamsDevelop data requirements for new data sourcesDesign and development...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Capgemini Engineering Full time

    Job Title: Pyspark EngineerAt Capgemini Engineering, we are seeking a highly skilled Pyspark Engineer to join our team. As a Pyspark Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using the PySpark framework.Responsibilities:Design and develop ETL pipelines using PySpark to extract, transform,...

  • Senior Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India. The successful candidate will have a strong background in AWS cloud services, expertise in SQL and relational databases, and proficiency in Python programming.Key Responsibilities:Design and implement data engineering...


  • Bengaluru, Karnataka, India Altair Engineering Full time

    Transforming Business with Data-Driven InsightsAt Altair Engineering, we're looking for a talented Senior Data Engineer to join our team. As a key member of our data analytics group, you will be responsible for designing and implementing scalable data pipelines, ensuring the accuracy and reliability of our data.Key Responsibilities:Design and implement data...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job SummaryReq ID: 302206NTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India.Job PurposeThe Senior Data Engineer will play a key role within the Data & Analytics team, designing, building, and maintaining systems and infrastructure for processing, collecting, storing, and analyzing large volumes of data.Key...

  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at NTT DATA Services. As a Data Engineer, you will be responsible for designing and developing data pipelines utilizing Cloud technologies Azure/AWS/GCP.Key ResponsibilitiesDesign and develop data pipelines using Cloud technologies Azure/AWS/GCPLead a team of Data Engineers and act...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Visualization EngineerJob Summary:Data Visualization Engineer - NTT DATAData visualization engineers utilize expertise in information visualization and design to create and deploy new platforms and services for visualization initiatives. Visualization specialists build interactive and complex data visualizations and analysis tools. They are...


  • Bengaluru, Karnataka, India Hevo Data Full time

    About Hevo DataAt Hevo Data, we're on a mission to simplify data integration for businesses. Our platform enables companies to consolidate data from multiple sources, making it easier to drive informed decision-making. With a strong focus on scalability and performance, we're looking for a talented Software Development Engineer II to join our team.What...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: Data SpecialistWe are seeking a highly skilled Data Specialist to join our team in Bangalore, India. As a Data Specialist, you will be responsible for designing and developing data pipelines utilizing cloud technologies such as Azure, AWS, and GCP.Key Responsibilities:Design and develop data pipelines using cloud technologiesLead a team of data...

  • Data Engineer Lead

    12 hours ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer LeadData Engineers within NTT DATA Services drive the creation of innovative data solutions that benefit our clients. As a Data Engineer Lead, you will be responsible for leading diverse data engineering activities on the Azure Data platform, including the development and delivery of data pipelines connecting various enterprise data sources,...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the JobThis position requires a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using Databricks on AWS. The ideal candidate will have strong experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development.Key ResponsibilitiesDesign, build, and maintain...

  • Senior Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job OpportunityReq ID: 286326 NTT DATA Services is a global leader in IT and business services, committed to helping clients succeed in a rapidly changing world. We are seeking a talented Sr Data Engineer to join our team in Bangalore, India.This role requires a strong background in AWS cloud services, including Lambda, Glue, S3, EMR, SNS, SQS, CloudWatch,...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: Data Visualization EngineerJob Summary:We are seeking a highly skilled Data Visualization Engineer to join our team at NTT DATA Services. As a Data Visualization Engineer, you will be responsible for designing, developing, and maintaining interactive dashboards and reports using PowerBI.Key Responsibilities:Design and develop interactive...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineer - AWS and Oracle ExpertDepartment: IT - Application DevelopmentJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    About NTT DATANTT DATA is a global leader in business and technology services, serving 75% of the Fortune Global 100. We help clients innovate, optimize, and transform for long-term success. Our diverse experts in over 50 countries and robust partner ecosystem enable us to deliver cutting-edge solutions.Job DescriptionWe are seeking a skilled Data Engineer...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: BangaloreJob SummaryWe are seeking a highly skilled Lead Data Engineer to join our team at Data Labs - LANDMARK GROUP. As a Lead Data Engineer, you will be responsible for leading our engineering team in building and deploying cutting-edge analytics products for consumption by different stakeholders.Key...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreJob Summary:We are seeking a highly skilled Lead Data Engineer to join our team at Data Labs - LANDMARK GROUP. The successful candidate will be responsible for leading our engineering team in building and deploying cutting-edge analytics products.Key Responsibilities:Lead the architecture, design, and...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:As a Data Engineer at NTT DATA, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure data factory and Azure databricks. You will work closely with cross-functional teams to ensure data quality, integrity, and security.Key Responsibilities:Design and implement data...