AWS Data Engineer

3 weeks ago

BangalorePuneHyderabadGurgaonGurugram, IN HuQuo Consulting Pvt. Ltd. Full time

Position - AWS Data Engineer

Location - Pune/ Gurgaon/Hyderabad Hybrid

Experience - 5+

Job Description :

- 5+ years of experience as a Data Engineer on the AWS Stack

- AWS Solutions Architect or AWS Developer Certification required

- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail

- Programming experience with Python, Shell scripting, and SQL

- Responsible for building, test, QA & UAT environments using Cloud Formation.

- Build & implement CI/CD pipelines for the EDP Platform using Cloud Formation and Jenkins

Good to Have :

- Implement high-velocity streaming solutions and orchestration using Amazon Kinesis, AWS Managed Airflow, and AWS Managed Kafka (preferred)

- Solid experience building solutions on AWS data lake/data warehouse

- Analyze, design, Development , and implement data ingestion pipeline in AWS

- Knowledge of implementing ETL/ELT for data solutions end to end

- ingest data from Rest APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift.

- Perform the Peer Code Review and, perform code quality analysis, and associated tools end-to-end for Prudential's platforms

- Create detailed, comprehensive, and well-structured test cases that follow best practices and techniques

- Estimate, prioritize, plan & coordinate quality testing activities

- Understanding requirements, and data solutions (ingest, storage, integration, processing, access) on AWS

- Knowledge of implementing RBAC strategy/solutions using AWS IAM and Redshift RBAC model

- Knowledge of analyzing data using SQL Stored procedures

- Build automated data pipelines to ingest data from relational database systems, file system , and NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift

- Build Automated data pipelines to develop test plans, execute manual and automated test cases, help to identify the root causes, and articulate defects clearly

- Recreate production issues to help determine the issue and verify any fixes

- Conducting End to End verification and validation for the entire application

- Creating Jenkins CI pipelines to integrate Sonar/Security scans and test automation scripts

- Using Git/bitbucket for efficient remote team working, storing framework, and developing test scripts

- Part of DevOps QA and AWS team focusing on building CI/CD pipeline

- Part of the release/build team and mainly worked on release management, CI/CD pipeline

- Deploy multiple instances by using cloud formation :

- Designing, building, and maintaining efficient, reusable, and reliable code

- Ensure the best possible performance and quality of high-scale data applications and services

- Participate in system design discussions

- Independently perform hands-on Development and unit testing of the applications

- Collaborate with the development team and build individual components into the enterprise data platform

- Work in a team environment with the product, QE/QA, and cross-functional teams to deliver a project throughout the whole software development cycle.

- Responsible to identify and resolve any performance issues

- Keep up to date with new technology development and implementation

- Participate in code review to make sure standards and best practices are met

- Project management: Agile developers take responsibility for estimating, planning, and managing all tasks and report on progress

- Software quality: The Agile developer is also responsible for the quality of the software he/she produces. The team takes responsibility for the quality of the work they produce instead of turning over some code to a separate and independent group for testing

- Teamwork: This includes collaboration with all other team members with the aim to take shared responsibility for the overall efforts

- Understanding user needs: This is about interacting with users as necessary to clarify requirements

Education : Minimum of 15 years of formal education - BE/BTech or Graduate / Postgraduate in Computer Science / Information Technology

(ref:hirist.tech)

  • AWS Data Engineer

    3 weeks ago

    Gurgaon/Gurugram/Bangalore/Pune, IN HuQuo Consulting Pvt. Ltd. Full time

    - Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail- Programming experience with Python, Shell scripting, and SQL- Responsible for building, test, QA & UAT...

  • AWS Data Engineer

    3 weeks ago

    Gurgaon/Gurugram/Bangalore/Pune, IN HuQuo Consulting Pvt. Ltd. Full time

    - Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail- Programming experience with Python, Shell scripting, and SQL- Responsible for building, test, QA & UAT...

  • Lead Data Engineer/Manager

    4 weeks ago

    Gurgaon/Gurugram/Bangalore, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Lead Data EngineerJob SummaryLooking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data engineering. The ideal...

  • Lead Data Engineer/Manager

    3 weeks ago

    Gurgaon/Gurugram/Bangalore, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Lead Data EngineerJob SummaryLooking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data engineering. The ideal...

  • Lead Data Engineer

    6 days ago

    Pune/Gurgaon/Gurugram/Noida/Bangalore, IN Pathways Consultant Full time

    Lead Data EngineerLocation : Pune, Gurgaon, Noida, BangaloreExperience : 7 -10 yearsNotice : Early joiners required (0 - 10 Days)Salary : 20 - 25 LPAShift : 12:00 PM-9:00 PM/ 12:30 PM-9:30 PMResponsibilities :- Should possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden...

  • Big Data Engineer

    1 month ago

    Gurgaon/Gurugram/Bangalore, IN TCCS Full time

    Client : Carelon Global SolutionsNotice Period : 20 days.Job Description :Minimum experience : - Should have hands-on experience in Software development for at least 9 years.- Should have hands-on experience in order to handle project work as Technical Lead for at least 2 yr.- Responsible for designing, deploying, and managing high quality data solutions in...

  • Big Data Engineer

    3 weeks ago

    Gurgaon/Gurugram/Bangalore, IN TCCS Full time

    Client : Carelon Global SolutionsNotice Period : 20 days.Job Description :Minimum experience : - Should have hands-on experience in Software development for at least 9 years.- Should have hands-on experience in order to handle project work as Technical Lead for at least 2 yr.- Responsible for designing, deploying, and managing high quality data solutions in...

  • AWS Data Engineer

    3 weeks ago

    Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    We are seeking a highly motivated and experienced AWS Engineer. This position requires an individual with AWS cloud experience and ambition to continually keep up with best practices when it comes to cloud development. The successful candidate must be able to seek out requirements and create best-in-class cloud-native solutions. The engineer must always...

  • AWS Data Engineer

    3 weeks ago

    Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    We are seeking a highly motivated and experienced AWS Engineer. This position requires an individual with AWS cloud experience and ambition to continually keep up with best practices when it comes to cloud development. The successful candidate must be able to seek out requirements and create best-in-class cloud-native solutions. The engineer must always...

  • AWS Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN True Tech Professionals Full time

    We are seeking a skilled Senior Data Engineer to join our dynamic team.- The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL.- The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring optimal performance...

  • AWS Data Engineer

    2 months ago

    Gurgaon/Gurugram, IN True Tech Professionals Full time

    We are seeking a skilled Senior Data Engineer to join our dynamic team.- The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL.- The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring optimal performance...

  • AWS Data Engineer

    1 month ago

    Bangalore/Pune, IN Technomech Placements Full time

    This is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...

  • AWS Data Engineer

    3 weeks ago

    Bangalore/Pune, IN Technomech Placements Full time

    This is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...

  • AWS Data Engineer

    2 months ago

    Bangalore/Pune/Hyderabad, IN Kezan Consulting Full time

    Company Overview : Kezan Consulting is a leading provider of Human Resources Services in the industry. We specialize in providing comprehensive HR solutions to our clients, helping them achieve their goals and drive business success. With a team of highly skilled professionals and a commitment to delivering excellence, we have established ourselves as a...

  • AWS Data Engineer

    3 weeks ago

    Bangalore/Pune/Hyderabad, IN Kezan Consulting Full time

    Company Overview : Kezan Consulting is a leading provider of Human Resources Services in the industry. We specialize in providing comprehensive HR solutions to our clients, helping them achieve their goals and drive business success. With a team of highly skilled professionals and a commitment to delivering excellence, we have established ourselves as a...

  • AWS Data Engineer

    2 months ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description : Responsibilities :- Proficient in designing and implementing data ingestion pipelines from various sources.- Build and enhance Python and PySpark-based frameworks for efficient and scalable data ingestion processes.- Collaborate with cross-functional teams to understand requirements and tailor frameworks to meet specific business needs.-...

  • AWS Data Engineer

    3 weeks ago

    Bangalore/Pune, IN Xcelyst Full time

    AWS Data EngineerExperience: 5-8 YearsLocation: Bangalore, PuneNotice Period : Immediate Joiner - 30 daysExp - 4+ Yrs in Data Engineering4+ Yrs in AWS ServicesSkills - Hands on exp in Glue is mandatory.Exposure to Lambda,Redshift,RDS,S3+ Python/Scala/Pyspark + SQL. Experience in solution designing.Job Description : - Strong AWS development experience for...

  • AWS Data Engineer

    3 weeks ago

    Bangalore/Pune, IN Xcelyst Full time

    AWS Data EngineerExperience: 5-8 YearsLocation: Bangalore, PuneNotice Period : Immediate Joiner - 30 daysExp - 4+ Yrs in Data Engineering4+ Yrs in AWS ServicesSkills - Hands on exp in Glue is mandatory.Exposure to Lambda,Redshift,RDS,S3+ Python/Scala/Pyspark + SQL. Experience in solution designing.Job Description : - Strong AWS development experience for...

  • AWS Data Architect

    2 months ago

    Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...

  • AWS Cloud Architect

    2 months ago

    Bangalore/Gurgaon/Gurugram/Pune, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Responsibilities : Data Architecture and Cloud Strategy :Develop and maintain a comprehensive data architecture and cloud strategy that aligns with the organization's goals and needs.Design, implement and manage cloud-based data infrastructure on AWS, ensuring scalability, reliability, and cost-efficiency.Utilize AWS services (S3, Glue, EMR,...