AWS Data Engineer

4 weeks ago


PuneHyderabad, IN Huquo Full time

Job Description :


- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail

- Programming experience with Python, Shell scripting, and SQL

- Responsible for building, test, QA & UAT environments using Cloud Formation.

- Build & implement CI/CD pipelines for the EDP Platform using Cloud Formation and Jenkins

Good to Have:

- Implement high-velocity streaming solutions and orchestration using Amazon Kinesis, AWS Managed Airflow, and AWS Managed Kafka (preferred)

- Solid experience building solutions on AWS data lake/data warehouse

- Analyze, design, Development , and implement data ingestion pipeline in AWS

- Knowledge of implementing ETL/ELT for data solutions end to end


- Ingest data from Rest APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift.

- Perform the Peer Code

- Review and, perform code quality analysis, and associated tools end-to-end for Prudential's platforms

- Create detailed, comprehensive, and well-structured test cases that follow best practices and techniques

- Estimate, prioritize, plan & coordinate quality testing activities

- Understanding requirements, and data solutions (ingest, storage, integration, processing, access) on AWS

- Knowledge of implementing RBAC strategy/solutions using AWS IAM and Redshift RBAC model

- Knowledge of analyzing data using SQL Stored procedures

- Build automated data pipelines to ingest data from relational database systems, file system , and NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift

(ref:hirist.tech)
  • AWS Data Engineer

    4 weeks ago


    Pune/Hyderabad, IN Huquo Full time

    Role : Data EngineerMust-Have : - 4 to 6 years of Relevant experience in Data Engineering and delivery.- 3 to 4 years of relevant work experience in large-scale Data applications- AWS Glue is mandatory.- Strong 4-6 years of working experience in SQL Spark Python, Snowflake, and AWS cloud knowledge.- Good aptitude, strong problem-solving abilities, and...

  • AWS Data Engineer

    2 weeks ago


    Bangalore/Pune/Hyderabad, IN Kezan Consulting Full time

    Company Overview : Kezan Consulting is a leading provider of Human Resources Services in the industry. We specialize in providing comprehensive HR solutions to our clients, helping them achieve their goals and drive business success. With a team of highly skilled professionals and a commitment to delivering excellence, we have established ourselves as a...

  • AWS Data Engineer

    5 days ago


    Bangalore/Pune, IN Technomech Placements Full time

    This is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...

  • AWS Data Engineer

    4 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Data Engineer

    4 weeks ago


    Bangalore/Pune/Chennai, IN Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Platform Engineer

    4 weeks ago


    Hyderabad/pune,chenn, IN Antal International Full time

    Job Description :We are looking for an AWS Platform Engineer who carries experience in architecture of Enterprise Data Warehouse implementation on AWS IAM, Redshift, S3, Glue, VPC, CloudWatch and other relevant services including cluster and node topology, configuration, and sizing. An ideal candidate will be responsible for managing, maintaining, and...

  • AWS Data Engineer

    4 weeks ago


    Bangalore/Trivandrum/Thiruvananthapuram/Cochin/Kochi/Noida/Hyderabad/Pune/Chennai, IN SPG Consulting Solutions Pvt.Ltd Full time

    - 5-7 years of Data engineering experience.- Must have hands-on experience in AWS Aurora RDS Postgre SQL, AWS S3, AWS Athena and AWS Quicksight, AWS protegrity etc.- Strong knowledge on Creating objects , data modeling tuning, Interface , ETL and reporting.- Should have knowledge on SQL Queries with Databases like Oracle, MySQL etc.- Strong knowledge on...

  • AWS Data Architect

    4 weeks ago


    Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...


  • Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full time

    Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...

  • Data Engineer

    4 weeks ago


    Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full time

    Position Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...

  • AWS Cloud Architect

    4 weeks ago


    Bangalore/Gurgaon/Gurugram/Pune, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Responsibilities : Data Architecture and Cloud Strategy :Develop and maintain a comprehensive data architecture and cloud strategy that aligns with the organization's goals and needs.Design, implement and manage cloud-based data infrastructure on AWS, ensuring scalability, reliability, and cost-efficiency.Utilize AWS services (S3, Glue, EMR,...


  • Bangalore/Chennai/Hyderabad, IN Infinite Computer Solutions Full time

    Job Description :As a DevOps Engineer with AWS expertise, you will play a crucial role in designing, implementing, and optimizing data pipelines on AWS infrastructure using Databricks. You will work closely with cross-functional teams to ensure the efficient management of data workflows, from ingestion to processing and integration, while adhering to...

  • Python Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Pune/Mumbai/Chennai, IN Swift Strategic Staff Solutions INC Full time

    Job Description :We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.Responsibilities :- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python...

  • Lead Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Lead Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune)Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...

  • Senior Data Engineer

    4 weeks ago


    Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...

  • Lead Data Engineer

    4 weeks ago


    Pune/Hyderabad/Gurgaon/Gurugram, IN LnS Infotech Full time

    Position : Lead Data EngineerLocation : : 8+ YearsRoles & Responsibilities : This role is a hybrid across Data Engineering skill sets and DBA. Ideally someone with a background in Oracle DBA roles who has branched into data engineering.- 8+ years of hands-on experience in SQL, Py Spark & Python, should be experienced in shell scriptingJob Description :-...

  • DevOps Engineer

    4 weeks ago


    Bangalore/Pune, IN Talent Corner HR Full time

    Job Description Roles and Responsibilities :- Design, implement, and manage robust code pipelines for seamless software delivery and deployment on AWS infrastructure.- Strong experience with serverless architectures, particularly using AWS Lambda.- Configure and optimize CI/CD processes to automate software builds, testing, and deployments.- Familiarity with...

  • Data Engineer

    4 weeks ago


    Bangalore/Pune, IN Gethyr Full time

    We are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...

  • AWS DevOps Engineer

    2 weeks ago


    Pune/Hyderabad, IN Burgeon It Services Pvt Ltd Full time

    Job Description :- Participate in the design and implementation of a framework, made for automatizing and testing infrastructure deployments in a financial institution.- Experience in Jenkins, Groovy, Bash, Terraform, Golang and Bitbucket.- Experience in building an integrative API in an AWS lambda to consume secrets from Hashicorp Vault, using Golang for...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Trivandrum/Thiruvananthapuram/Chennai/Pune, IN Arting Digital Full time

    Senior Data EngineerExperience : 6y+ Location : Trivandrum, Chennai, Pune, Bangalore Budget : 15 - 25 LPA Work Mode : On-SiteSkills : - Ataccama, Syndigo, Snowflake, Databricks- Requirements :- 6+ Years experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutions- Programming experience in Scala or Python, SQL-...