AWS Data Engineer

2 months ago


Bengaluru, India EDGESOFT Full time

Job Description :

- AWS Data Engineer with min of 5 to 7 years of experience.

- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.

- Connect with stakeholders daily to discuss project progress and updates.

- Work within an Agile process to deliver projects in a timely and efficient manner.

- Design and develop Airflow DAGs to schedule and manage ETL workflows.

- Transform SQL queries into Spark SQL code for ETL pipelines.

- Develop custom Python functions to handle data quality and validation.

- Write PySpark scripts to process data and perform transformations.

- Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes.

- Run Spark jobs on AWS EMR cluster using Airflow DAGs.

- Monitor and troubleshoot ETL pipelines to ensure smooth operation.

- Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture.

- Collaborate with other members of the data engineering team to improve processes and implement new technologies.

- Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.

(ref:hirist.tech)
  • AWS Data Engineer

    2 months ago


    Bengaluru, India Torry Harris Full time

    Are you an AWS Data Engineer looking for an exciting new opportunity? Look no further than Torry Harris! We are a leading digital transformation company, and we are currently seeking a talented and experienced AWS Data Engineer to join our team.As an AWS Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining our...


  • Bengaluru, India AWS India - Karnataka - D11 Full time

    AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....

  • AWS Data Engineer

    1 week ago


    Bengaluru, India Synechron Full time

    Job Title: Senior Data Engineer - AWS, Python, PySpark, Hive, SQLLocation: Pune/BangaloreExperience Required: 7+ yearsRole Summary: As a Senior Data Engineer, you will lead the design and implementation of scalable, high-performance data solutions on AWS. You will leverage your deep expertise in Python, PySpark, Hive, and SQL to build and optimize data...

  • AWS Data Engineer

    1 week ago


    Bengaluru, India Synechron Full time

    Job Title: Senior Data Engineer - AWS, Python, PySpark, Hive, SQLLocation: Pune/BangaloreExperience Required: 7+ yearsRole Summary: As a Senior Data Engineer, you will lead the design and implementation of scalable, high-performance data solutions on AWS. You will leverage your deep expertise in Python, PySpark, Hive, and SQL to build and optimize data...

  • Data Engineer

    1 week ago


    Bengaluru, India Acumant Full time

    Company DescriptionAcumant is a IT Services and Solutions company specializing in innovative and scalable data solutions and business applications. The company is dedicated to integrating sustainability, data, and AI solutions to empower organizations with cutting-edge technology. Acumant's focus is on driving businesses forward with tailored and...


  • Bengaluru, India AWS India - Karnataka Full time

    Do you have a desire to make a major contribution to the future in the rapid growth environment of Cloud Computing? Are you passionate about data and code? Does the prospect of dealing with massive volumes of data excite you? Do you want to build data engineering solutions that process millions of records? Amazon Web Services is looking for a Data Engineer...

  • Data Engineer

    1 week ago


    Bengaluru, India Acumant Full time

    Company Description Acumant is a IT Services and Solutions company specializing in innovative and scalable data solutions and business applications. The company is dedicated to integrating sustainability, data, and AI solutions to empower organizations with cutting-edge technology. Acumant's focus is on driving businesses forward with tailored and...

  • Data Engineer

    2 weeks ago


    Bengaluru, India Acumant Full time

    Company DescriptionAcumant is a IT Services and Solutions company specializing in innovative and scalable data solutions and business applications. The company is dedicated to integrating sustainability, data, and AI solutions to empower organizations with cutting-edge technology. Acumant's focus is on driving businesses forward with tailored and...

  • Data Engineer

    2 weeks ago


    Bengaluru, India Acumant Full time

    Company DescriptionAcumant is a IT Services and Solutions company specializing in innovative and scalable data solutions and business applications. The company is dedicated to integrating sustainability, data, and AI solutions to empower organizations with cutting-edge technology. Acumant's focus is on driving businesses forward with tailored and...

  • Data Engineer

    1 month ago


    Bengaluru, India Cayian India Pvt Limited Full time

    Cayian is a global IT and business service provider that delivers consultancy, capability, and system integration services to our partners. Our unique partner model is optimised to accelerate delivery, continuously improve quality, and drive business growth. Find out more about us here.  The role As a Data Engineer, you will be a part of...

  • Aws Cloud Architect

    2 months ago


    Bengaluru, India NTT DATA Full time

    **Req ID**: 248981 We are currently seeking a AWS Cloud Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Background As an Amazon Web Services (AWS) cloud architect, you will be responsible to architect and manage the cloud environment for a Digital Banking Asset. Duties include architecting and implementing cloud solutions,...

  • Data Engineer

    2 months ago


    Bengaluru, India Spectrum Consulting Full time

    Position : Data Infrastructure EngineerCore work that needs accomplished :Architect, design and build Data access solution using various tool sets on Client's AWS and other platforms like DBT, Airflow, Atlan to enable clients data governance goalsThe solution will enable managing access to enterprise data at various layers of clients data solutions and...

  • AWS Data Engineer

    1 week ago


    Bengaluru, India Birlasoft Full time

    About Birlasoft:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...

  • AWS Data Engineer

    1 week ago


    Bengaluru, India Birlasoft Full time

    About Birlasoft: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla...

  • AWS Data Engineer

    2 weeks ago


    Bengaluru, India Birlasoft Full time

    About Birlasoft:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...

  • AWS Data Engineer

    2 weeks ago


    Bengaluru, India Birlasoft Full time

    About Birlasoft:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...

  • AWS Data Engineer

    1 week ago


    Bengaluru, India Deloitte Full time

    What impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potential.Deloitte is where you’ll find unrivaled...

  • AWS Data Engineer

    1 week ago


    Bengaluru, India Deloitte Full time

    What impact will you make? Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potential. Deloitte is where you’ll find...

  • AWS Data Engineer

    1 month ago


    Bengaluru, India VY Systems Pvt Ltd. Full time

    SALARY : 15LPA - 20LPAJob Summary : As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. Leveraging your expertise in data engineering and software development, you will collaborate with cross-functional teams to build robust data solutions...

  • AWS Data Engineer

    4 weeks ago


    Bengaluru, India Lucidspire Full time

    Exciting career opportunities await! Ready for New Challenges? Lucidspire Hiring!"Role: AWS Data EngineerExperience:4-6+YrsLocation: Bangalore ( Hybrid)Notice Period: ImmediateIf interested, please share your resume swathi.b@lucidspire.com Our client is a distinguished USA-based Digital Transformation Company with a global footprint spanning over 100...