See more Collapse

AWS Data Engineer

1 month ago

GurgaonGurugramBangalorePune, India HuQuo Consulting Pvt. Ltd. Full time

- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail

- Programming experience with Python, Shell scripting, and SQL

- Responsible for building, test, QA & UAT environments using Cloud Formation.

- Build & implement

- CI/CD pipelines for the EDP Platform using Cloud Formation and Jenkins

Good to Have :

- Implement high-velocity streaming solutions and orchestration using Amazon Kinesis, AWS Managed

- Airflow, and AWS Managed Kafka (preferred)

- Solid experience building solutions on AWS data lake/data warehouse

- Analyze, design, Development , and implement data ingestion pipeline in AWS

- Knowledge of implementing ETL/ELT for data solutions end to end ingest data from Rest APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift.

- Perform the Peer Code Review and, perform code quality analysis, and associated tools end-to-end for Prudential's platforms

- Create detailed, comprehensive, and well-structured test cases that follow best practices and techniques

- Estimate, prioritize, plan & coordinate quality testing activities

- Understanding requirements, and data solutions (ingest, storage, integration, processing, access) on AWS

- Knowledge of implementing RBAC strategy/solutions using AWS IAM and Redshift RBAC model

- Knowledge of analyzing data using SQL Stored procedures

- Build automated data pipelines to ingest data from relational database systems, file system , and NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift

- Build Automated data pipelines to develop test plans, execute manual and automated test cases, help to identify the root causes, and articulate defects clearly

- Recreate production issues to help determine the issue and verify any fixes

- Conducting End to End verification and validation for the entire application

- Creating Jenkins CI pipelines to integrate Sonar/Security scans and test automation scripts

- Using Git/bitbucket for efficient remote team working, storing framework, and developing test scripts

- Part of DevOps QA and AWS team focusing on building CI/CD pipeline

- Part of the release/build team and mainly worked on release management, CI/CD pipeline

- Deploy multiple instances by using cloud formation templates

Responsibilities :

- Designing, building, and maintaining efficient, reusable, and reliable code

- Ensure the best possible performance and quality of high-scale data applications and services

- Participate in system design discussions

- Independently perform hands-on Development and unit testing of the applications

- Collaborate with the development team and build individual components into the enterprise data platform

- Work in a team environment with the product, QE/QA, and cross-functional teams to deliver a project throughout the whole software development cycle.

- Responsible to identify and resolve any performance issues

- Keep up to date with new technology development and implementation

- Participate in code review to make sure standards and best practices are met

- Project management: Agile developers take responsibility for estimating, planning, and managing all tasks and report on progress

- Software quality: The Agile developer is also responsible for the quality of the software he/she produces.


- The team takes responsibility for the quality of the work they produce instead of turning over some code to a separate and independent group for testing

- Teamwork: This includes collaboration with all other team members with the aim to take shared responsibility for the overall efforts

- Understanding user needs: This is about interacting with users as necessary to clarify requirements

(ref:hirist.tech)

We have other current jobs related to this field that you can find below

  • AWS Data Engineer

    4 weeks ago

    gurgaon, India Deloitte Full time

    As an AWS Data Engineer Consultant at Deloitte, you will be a key player in designing, implementing, and optimizing data solutions on the Amazon Web Services (AWS) cloud platform. This role involves working closely with clients from various industries, understanding their data needs, and delivering robust data engineering solutions. Your role will...

  • AWS Data Engineer

    1 month ago

    Gurgaon/Gurugram/Bangalore/Pune, IN HuQuo Consulting Pvt. Ltd. Full time

    - Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail- Programming experience with Python, Shell scripting, and SQL- Responsible for building, test, QA & UAT...

  • AWS Data Engineer

    4 weeks ago

    Gurugram, India Deloitte Full time

    As an AWS Data Engineer Consultant at Deloitte, you will be a key player in designing, implementing, and optimizing data solutions on the Amazon Web Services (AWS) cloud platform. This role involves working closely with clients from various industries, understanding their data needs, and delivering robust data engineering solutions. Your role will involve:...

  • AWS Data Engineer

    4 weeks ago

    Gurugram, India Deloitte Full time

    As an AWS Data Engineer Consultant at Deloitte, you will be a key player in designing, implementing, and optimizing data solutions on the Amazon Web Services (AWS) cloud platform. This role involves working closely with clients from various industries, understanding their data needs, and delivering robust data engineering solutions. Your role will...

  • AWS Data Engineer

    4 weeks ago

    Gurugram, India Deloitte Full time

    As an AWS Data Engineer Consultant at Deloitte, you will be a key player in designing, implementing, and optimizing data solutions on the Amazon Web Services (AWS) cloud platform. This role involves working closely with clients from various industries, understanding their data needs, and delivering robust data engineering solutions. Your role will...

  • Lead Data Engineer/Manager

    4 weeks ago

    Gurgaon/Gurugram/Bangalore, India HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Lead Data EngineerJob SummaryLooking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data engineering. The ideal...

  • Lead Data Engineer/Manager

    1 month ago

    Gurgaon/Gurugram/Bangalore, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Lead Data EngineerJob SummaryLooking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data engineering. The ideal...

  • Data Scientist, AWS Support Strategy Analytics and Data Science, Support Engineering

    2 weeks ago

    bangalore, India AWS India - Karnataka - D11 Full time

    AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....

  • Data Scientist, AWS Support Strategy Analytics and Data Science, Support Engineering

    1 day ago

    bangalore, India AWS India - Karnataka - D11 Full time

    AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....

  • Lead Data Engineer

    4 weeks ago

    Pune/Gurgaon/Gurugram/Noida/Bangalore, India Pathways Consultant Full time

    Lead Data EngineerLocation : Pune, Gurgaon, Noida, BangaloreExperience : 7 -10 yearsNotice : Early joiners required (0 - 10 Days)Salary : 20 - 25 LPAShift : 12:00 PM-9:00 PM/ 12:30 PM-9:30 PMResponsibilities :- Should possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden...

  • Lead Data Engineer

    2 weeks ago

    Pune/Gurgaon/Gurugram/Noida/Bangalore, IN Pathways Consultant Full time

    Lead Data EngineerLocation : Pune, Gurgaon, Noida, BangaloreExperience : 7 -10 yearsNotice : Early joiners required (0 - 10 Days)Salary : 20 - 25 LPAShift : 12:00 PM-9:00 PM/ 12:30 PM-9:30 PMResponsibilities :- Should possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden...

  • AWS Data Engineer

    3 weeks ago

    bangalore, India EXL Full time

    Job Description: As an AWS Data Engineer, you will be responsible for designing, developing, and managing our cloud-based data infrastructure on Amazon Web Services (AWS). The ideal candidate will have extensive experience with AWS services, strong expertise in data engineering principles, and a passion for building robust and scalable data solutions. Key...

  • AWS Data Engineer

    3 weeks ago

    bangalore, India Torry Harris Full time

    Are you an AWS Data Engineer looking for an exciting new opportunity? Look no further than Torry Harris! We are a leading digital transformation company, and we are currently seeking a talented and experienced AWS Data Engineer to join our team.As an AWS Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining our...

  • AWS Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India True Tech Professionals Full time

    We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL. The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring optimal performance...

  • AWS Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Infogain Full time

    AWS Data Engineer (Senior) with skills AWS - EKS, AWS - CloudFormation, AWS-Apps, AWS-Infra, AWS DBA, Python, Apache Hive, SQL for location Gurugram, India Posted on: June 15, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal...

  • Big Data Engineer

    4 weeks ago

    Gurgaon/Gurugram/Bangalore, India TCCS Full time

    Client : Carelon Global SolutionsNotice Period : 20 days.Job Description :Minimum experience : - Should have hands-on experience in Software development for at least 9 years.- Should have hands-on experience in order to handle project work as Technical Lead for at least 2 yr.- Responsible for designing, deploying, and managing high quality data solutions in...

  • Big Data Engineer

    1 month ago

    Gurgaon/Gurugram/Bangalore, IN TCCS Full time

    Client : Carelon Global SolutionsNotice Period : 20 days.Job Description :Minimum experience : - Should have hands-on experience in Software development for at least 9 years.- Should have hands-on experience in order to handle project work as Technical Lead for at least 2 yr.- Responsible for designing, deploying, and managing high quality data solutions in...

  • Data Engineer

    4 weeks ago

    bangalore, India Concentrix Full time

    Job Description:Experience: 4 Years - 8 YearsJob Location: PAN IndiaNotice Period: Immediate/ 15 DaysShift Timings: 03:00 PM to 12:00 AM (IST)Skills: Data Engineering; data Pipeline; ETL, AWS (and frameworks), Pyspark/ scala; SQL & pythonJob Description:We are seeking an experienced Data Engineer to join our team. The ideal candidate should have a...

  • AWS Data Engineer

    4 weeks ago

    bangalore, India PradeepIT Consulting Services Pvt Ltd Full time

    Job Description: As an AWS Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and data storage solutions on Amazon Web Services (AWS). Your expertise will help us leverage data for critical business insights and analytics. Primary Skills: Experience in implementing at least 2 end-to-end Data Engineering projects....

  • AWS Data Engineer

    2 weeks ago

    Pune, Maharashtra, India HyrEzy Talent Solutions Full time

    Job: AWS Data Engineer We are looking for a skilled AWS Data Engineer to join our team. Check out the details below: Location: Pune, Bangalore, Greater Noida, Trichy Responsibilities: Design, build, and maintain scalable data architectures on AWS cloud platform. Develop and implement data pipelines for ingesting, processing, and transforming large volumes...