AWS Data Engineer

1 week ago


Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time
Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail

  • Programming experience with Python, Shell scripting, and SQL
  • Responsible for building, test, QA & UAT environments using Cloud Formation.
  • Build & implement
CI/CD pipelines for the EDP Platform using Cloud Formation and Jenkins

Good to Have :

  • Implement highvelocity streaming solutions and orchestration using Amazon Kinesis, AWS Managed
  • Airflow, and AWS Managed Kafka (preferred)
  • Solid experience building solutions on AWS data lake/data warehouse
  • Analyze, design, Development , and implement data ingestion pipeline in AWS
  • Knowledge of implementing ETL/ELT for data solutions end to end ingest data from Rest APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift.
  • Perform the Peer Code Review and, perform code quality analysis, and associated tools endtoend for Prudential's platforms
  • Create detailed, comprehensive, and wellstructured test cases that follow best practices and techniques
  • Estimate, prioritize, plan & coordinate quality testing activities
  • Understanding requirements, and data solutions (ingest, storage, integration, processing, access) on AWS
  • Knowledge of implementing RBAC strategy/solutions using AWS IAM and Redshift RBAC model
  • Knowledge of analyzing data using SQL Stored procedures
  • Build automated data pipelines to ingest data from relational database systems, file system , and NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift
  • Build Automated data pipelines to develop test plans, execute manual and automated test cases, help to identify the root causes, and articulate defects clearly
  • Recreate production issues to help determine the issue and verify any fixes
  • Conducting End to End verification and validation for the entire application
  • Creating Jenkins CI pipelines to integrate Sonar/Security scans and test automation scripts
  • Using Git/bitbucket for efficient remote team working, storing framework, and developing test scripts
  • Part of DevOps QA and AWS team focusing on building CI/CD pipeline
  • Part of the release/build team and mainly worked on release management, CI/CD pipeline
  • Deploy multiple instances by using cloud formation templates

Responsibilities :

  • Designing, building, and maintaining efficient, reusable, and reliable code
  • Ensure the best possible performance and quality of highscale data applications and services
  • Participate in system design discussions
  • Independently perform handson Development and unit testing of the applications
  • Collaborate with the development team and build individual components into the enterprise data platform
  • Work in a team environment with the product, QE/QA, and crossfunctional teams to deliver a project throughout the whole software development cycle.
  • Responsible to identify and resolve any performance issues
  • Keep up to date with new technology development and implementation
  • Participate in code review to make sure standards and best practices are met
  • Project management: Agile developers take responsibility for estimating, planning, and managing all tasks and report on progress
  • Software quality: The Agile developer is also responsible for the quality of the software he/she produces.
The team takes responsibility for the quality of the work they produce instead of turning over some code to a separate and independent group for testing

  • Teamwork: This includes collaboration with all other team members with the aim to take shared responsibility for the overall efforts
  • Understanding user needs: This is about interacting with users as necessary to clarify requirements
)
  • AWS Data Engineer

    1 week ago


    Gurgaon, Haryana, India True Tech Professionals Full time

    We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL. The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring optimal performance...

  • AWS Data Engineer

    1 week ago


    Gurgaon, Haryana, India Infogain Full time

    AWS Data Engineer (Senior) with skills AWS - EKS, AWS - CloudFormation, AWS-Apps, AWS-Infra, AWS DBA, Python, Apache Hive, SQL for location Gurugram, India Posted on: June 15, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal...

  • AWS Data Engineer

    1 week ago


    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :Responsibilities : Proficient in designing and implementing data ingestion pipelines from various sources. Build and enhance Python and PySparkbased frameworks for efficient and scalable data ingestion processes. Collaborate with crossfunctional teams to understand requirements and tailor frameworks to meet specific business needs. Utilize...

  • AWS Data Engineer

    1 week ago


    Gurgaon, Haryana, India Incedo Inc. Full time

    As a Technical Lead - at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: •...

  • AWS Data Engineer

    1 week ago


    Gurgaon, Haryana, India Invitas Full time

    Job Position : AWS-Python- PySpark Engineer Job Type : Full-TimeLocation : GurgaonExperience : 5+ YearsMust Have : Cloud Platforms (AWS), Automation Tools such as (Jenkins or Ansible) Python and PySpark, EKS or AKS, Amazon EMR, Amazon Athena AWS Glue, Amazon Lambda, Amazon EC2 and Amazon's Storage service like S3 and few other services like...

  • AWS Data Architect

    1 week ago


    Gurgaon, Haryana, India Valiance Analytics Pvt. Ltd. Full time

    Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises 120+...


  • Gurgaon, Haryana, India AWS India - Telangana Full time

    Sales, Marketing and Global Services (SMGS)AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector.At Amazon Web Services (AWS) India, we are changing the future of IT. Customer Solutions...


  • Gurgaon, Haryana, India AWS India - Telangana Full time

    Sales, Marketing and Global Services (SMGS)AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector.At Amazon Web Services (AWS) India, we are changing the future of IT. Customer Solutions...


  • Gurgaon, Haryana, India KPMG India Full time

    Evaluating, developing, maintaining and testing data engineering solutions for Data Lake and advanced analytics projects. Implement processes and logic to extract, transform, and distribute data across one or more data stores from a wide variety of sources Distil business requirements and translate into technical solutions for data systems including data...

  • Data Engineer

    2 months ago


    Gurgaon, Haryana, India Cognizant Technology Solutions Full time

    Position Summary: The Data engineer is responsible for development & maintenance of the Data Lake within Cognizant. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to required quality standards. You must be a self-starter, think outside the box and enjoy coming up with...


  • Gurgaon, Haryana, India Virtusa Full time

    AWS Cloud Platform Engineer - CREQ188838 Description Rich experience as AWS Cloud Platform Engineer. Extensive experience of AWS services like S3, EC2, IAM, VPC and bigdata specific services like EMR, Sagemaker, Athena, Glue etc Must have expertise in terraform. Good knowledge of version control using Git, Continuous build with Teamcity, Jenkins etc...


  • Gurgaon, Haryana, India AWS India - Haryana - H52 Full time

    Are you a detail-oriented community manager who enjoys building lasting relationships with technical communities? Do you also gravitate towards the program management side of community-building, creating frameworks processes, and playbooks, to help scale community programs globally? The Amazon Web Services (AWS) Developer Relations Team is seeking an...


  • Gurgaon, Haryana, India AWS India - Karnataka - D11 Full time

    Amazon Web Services is the global market leader and technology forerunner in the Cloud business. As a member of the AWS Support team, you will be at the forefront of this transformational technology, assisting a global list of companies and developers that are taking advantage of a growing set of services and features to run their mission-critical...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India True Tech Professionals Private Limited Full time

    Data Engineer - SnowflakeLocation : Gurgaon (Hybrid)Summary :We are seeking a skilled Data Engineer with expertise in Snowflake to join our dynamic team. The ideal candidate will have a solid understanding of data governance principles and extensive experience in developing governance dashboards using Snowflake, Snowpark, Snowflake stored procedures, and...


  • Gurgaon, Haryana, India Huquo Full time

    Job Description : Analytic strategies to meet the demands of business requirements Technical requirements of the analytic solutions Data requirements of the analytic solution processes The person will be part of the Data Science team for a major Insurance client. He/ She will work with different stakeholders as SME for data engineering Engages in technical...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB's target state Marketing Platforms.You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for both...

  • Data Engineer

    2 months ago


    Gurgaon, Haryana, India Cognizant Technology Solutions Full time

    Technical LeadQualification:Bachelors in science , engineering or equivalentResponsibility:Project Planning and Setup: Understand the project scope, identify activities/ tasks, task level estimates, schedule, dependencies, risks and provide inputs to Module Lead for review. Provide inputs to testing strategy, configuration, deployment, hardware/software...


  • Gurgaon, Haryana, India AWS India - Delhi - D01 Full time

    Amazon Web Services is the market leader and technology forerunner in the Cloud business. As a member of the AWS Support team in Amazon Web services, you will be at the forefront of this transformational technology, assisting a global list of companies and developers that are taking advantage of a growing set of services and features to run their...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India True Tech Professionals Private Limited Full time

    Location : Gurgaon (Hybrid Mode)Experience : 5 years and above. (Less than 5 years will not be considered)Immediate Joiners Preferred (Notice Period: 7 to 10 days)We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena,...


  • Gurgaon, Haryana, India Valiance Solutions Full time

    About Valiance: Valiance is a niche AI consulting firm dedicated to transforming businesses by leveraging the power of data science, AI, and cloud technologies. With a team of over 120 professionals, we provide cutting-edge solutions to clients in the US and India. Job Overview: We are seeking a highly skilled and experienced Senior AWS Data Engineer to...