Data Engineer(AWS,S3, Datalake, AWS Glue, Lambda, RMR,"Python", Pyspark Engineer)

4 weeks ago

Bengaluru, India Tata Consultancy Services Full time

Job Description



SN

Required Information

Details

1

Role

AWS Data Engineer

2

Required Technical Skill Set

AWS


Desired Experience Range

4-6 yrs.

5

Location of Requirement

Pune


Desired Competencies (Technical/Behavioral Competency)

Must-Have

  • Should have expertise in creating data warehouses in AWS utilizing the following tools: EC2, S3, EMR, Athena, Sagemaker, Aurora and Snowflake., Kafka, Kinesis, Glue, Lambda, DMS, AppFlow, PowerBI
  • Advanced development experience in cloud technologies such as AWS Aurora/RDS/S3, Lambda, JSON, Python
  • Proficiency in scripting, querying, and/or analytics tools: Linux, python, SQL (already covered in description)

Analyze, re-architect and re-platform on premise / cloud data sources to AWS platform using AWS Glue.

  • Design, build and automate AWS data pipelines from ingestion of data into consumption layer using Java / Python


Good-to-Have

  • Basic knowledge in Redhat Linux and Windows Operating Systems
  • Good at Console and the AWS CLI and APIs
  • Knowledge of writing infrastructure as code (IaC) using CloudFormation or Terraform.
  • AWS API's for integration




SN

Role descriptions / Expectations from the Role

1

Ability to understand and articulate the different functions within AWS and design appropriate solution, HLD, LLD around it.

2

Ability to identify and gather requirements to define a solution to be built and operated on AWS, perform high level and low-level design.

3

AWS Data Engineer will be responsible for building the services as per the design

  • Data Engineer(AWS,S3, Datalake, AWS Glue, Lambda, RMR,"Python", Pyspark Engineer)

    4 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Job Description SN Required Information Details 1 Role AWS Data Engineer 2 Required Technical Skill Set AWS Desired Experience Range 4-6 yrs. 5 Location of Requirement Pune Desired Competencies (Technical/Behavioral Competency) Must-Have - Should have expertise in creating data warehouses in AWS utilizing the following tools: EC2, S3, EMR, Athena, Sagemaker,...

  • Data Engineer(AWS,S3, Datalake, AWS Glue, Lambda, RMR,"Python", Pyspark Engineer)

    4 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Job DescriptionSNRequired InformationDetails1RoleAWS Data Engineer2Required Technical Skill SetAWSDesired Experience Range4-6 yrs.5Location of RequirementPuneDesired Competencies (Technical/Behavioral Competency)Must-Have- Should have expertise in creating data warehouses in AWS utilizing the following tools: EC2, S3, EMR, Athena, Sagemaker, Aurora and...

  • Data Engineer(AWS,S3, Datalake, AWS Glue, Lambda, RMR,"Python", Pyspark Engineer)

    4 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Job Description SN Required Information Details 1 Role AWS Data Engineer 2 Required Technical Skill Set AWS Desired Experience Range 4-6 yrs. 5 Location of Requirement Pune Desired Competencies (Technical/Behavioral Competency) Must-Have Should have expertise in creating data warehouses in AWS utilizing the following tools: EC2, S3, EMR, Athena,...

  • AWS Glue Data Engineer

    2 weeks ago

    Bengaluru, Chennai, Hyderabad, India Perficient Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Perficient is the global AI-first consultancy. Our team of strategists, designers, technologists, and engineers partners with the worlds most innovative enterprises and admired brands to deliver real business results through the transformative power of AI. As part of our AI-First strategy, we empower every employee to build AI fluency and actively engage...

  • AWS Data Engineer with Redshift, Lambda, Glue expertise

    2 weeks ago

    Bengaluru, Karnataka, India Tredence Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role descriptionAt Tredence AWS Data Engineer designs, builds, and maintains scalable data pipelines and infrastructure using AWS services like Glue, S3, and Redshift, focusing on data ingestion, transformation (ETL), modeling, and quality. They write SQL and Python code, orchestrate workflows with tools like Airflow, and collaborate with data scientists and...

  • Data Engineer- AWS

    2 weeks ago

    Bengaluru, Karnataka, India Rapsys Tech Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    *Min 5 years of experience in data engineering, specifically working with *Apache Airflow and AWS technologies.*AWS services, particularly S3, Glue, EMR, Redshift, and AWS Lambda.*Proficiency in Python, PySpark and SQL*Snowflake Data Lake is reqd.

  • Data Engineer with Snowflake, AWS Glue, Kafka, API

    7 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    6+ years of experience in Data Engineering or related role.Hands-on experience with Snowflake (data modelling, performance tuning, query optimization, Snowpipe, Time Travel, Streams & Tasks).Strong expertise in AWS Glue for ETL job development, orchestration, and optimization.Proficiency with AWS services such as S3, Lambda, Redshift, Athena, Step Functions,...

  • Aws Data Engineer

    2 weeks ago

    Bengaluru, Gurugram, Noida, India EXL Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    System Design & architecture understanding, PySpark, Python, SQL, Git, Github, AWS Services Glue, Lambda, Step Functions, S3, Athena.Job Description:We are seeking a talented and skilled Senior AWS Data Engineer with expertise in PySpark, Python, SQL, Git, and AWS Services, to join our dynamic team. The ideal candidate will have a strong background in data...

  • Aws data engineer

    14 hours ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill: AWS Data Engineer Exp range: 6 yrs to 10 yrslocation: BangaloreNotice period – 30 – 45 daysPls find the Job Description below.Hands-on experience in Pyspark, GlueExperience on EMR, S3, IAM, Lambda, Cloud formation, PythonAMI Rehydration, Python, ELB and other AWS components...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India HireWand Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The AWS Data Engineer will design, develop, and maintain scalable data pipelines and architectures using AWS Glue, Amazon Redshift, AWS Lambda, and Amazon S3. This role requires expertise in AWS Kinesis, AWS CloudFormation, Apache Spark, Python, and AWS IAM to ensure secure and efficient data processing. The candidate will leverage AWS Data Pipeline, AWS...