AWS Data Engineer with Redshift, Lambda, Glue expertise

6 days ago

Bengaluru, India Tredence Full time

Role description

At Tredence AWS Data Engineer designs, builds, and maintains scalable data pipelines and infrastructure using AWS services like Glue, S3, and Redshift, focusing on data ingestion, transformation (ETL), modeling, and quality. They write SQL and Python code, orchestrate workflows with tools like Airflow, and collaborate with data scientists and analysts, aiming to ensure data is accurate, accessible, and optimized for analysis and business decision-making.

Role – AWS Data Engineer
Years of Experience: 2~5 years

Roles and responsibilities

  • The day-to-day work of a junior-to-mid AWS data engineer involves a mix of development, monitoring, and collaboration.
  • Pipeline development: Designing, building, and maintaining robust and scalable ETL/ELT (Extract, Transform, Load) pipelines on AWS.
  • Managing and optimizing cloud-based data warehouses like Amazon Redshift to support business intelligence and analytics.
  • Implementing validation and cleansing techniques to ensure data accuracy and reliability throughout the pipeline.
  • Managing data storage (e.g., S3), transformation services (e.g., Glue), and orchestration tools (e.g., Airflow/MWAA).
  • Working closely with data analysts, data scientists, and business stakeholders to understand data requirements and deliver reliable data solutions.
  • Monitoring and tuning data workflows and database queries to ensure fast and efficient processing.
  • Creating clear and comprehensive documentation of data processes, infrastructure, and technical specifications.

Skills

Required Skills - AWS, Redshift, Lambda, Glue, S3, SQL, Python, Pyspark, Step function

Looking for immediate joiners

About Tredence
Welcome to Tredence Since our founding in 2013, we have been dedicated to transforming data into actionable insights, helping over 50 Fortune 500 clients win in their respective industries. With our headquarters in San Jose and a presence in 5 countries, our mission is to be the world's most indispensable analytics partner. At Tredence, we blend deep domain expertise with advanced AI and data science to drive unparalleled business value. We are excited to have you join us on this innovative journey.

  • AWS Data Engineer with Redshift, Lambda, Glue expertise

    6 days ago

    Bengaluru, India Tredence Inc. Full time

    Role description At Tredence AWS Data Engineer designs, builds, and maintains scalable data pipelines and infrastructure using AWS services like Glue, S3, and Redshift, focusing on data ingestion, transformation (ETL), modeling, and quality. They write SQL and Python code, orchestrate workflows with tools like Airflow, and collaborate with data scientists...

  • Data Engineer with Snowflake, AWS Glue, Kafka, API

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    6+ years of experience in Data Engineering or related role.Hands-on experience with Snowflake (data modelling, performance tuning, query optimization, Snowpipe, Time Travel, Streams & Tasks).Strong expertise in AWS Glue for ETL job development, orchestration, and optimization.Proficiency with AWS services such as S3, Lambda, Redshift, Athena, Step Functions,...

  • Data Engineer with Snowflake, AWS Glue, Kafka, API

    6 days ago

    Bengaluru, India NTT DATA, Inc. Full time

    6+ years of experience in Data Engineering or related role. Hands-on experience with Snowflake (data modelling, performance tuning, query optimization, Snowpipe, Time Travel, Streams & Tasks). Strong expertise in AWS Glue for ETL job development, orchestration, and optimization. Proficiency with AWS services such as S3, Lambda, Redshift, Athena, Step...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Xtentics Consultancy Services Private Limited Full time

    Job DescriptionRole OverviewWe are looking for an experienced AWS Data Engineer / Developer with strong expertise in Athena, Python, Glue, Lambda, DMS, RDS, Redshift, CloudFormation, and other AWS serverless resources. The ideal candidate will design, develop, and optimize scalable data architectures and pipelines to support business intelligence, analytics,...

  • Aws Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Mastech Digital Full time

    Position: AWS Data Engineer Locations :- Chennai, Hyderabad, Bangalore Duration: Contract / FTEExp:- 5+ years Hybrid model weekly 3 days at office.Primary Skills: Python, Pyspark, Glue, Redshift, Lambda, DMS, RDS , Cloud Formation and other AWS serverless Strong exp in SQLDetailed JDSeeking a developer who has good Experience in Athena, Python code, Glue,...

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Mastech Digital Full time

    Position: AWS Data Engineer Locations :- Chennai, Hyderabad, Bangalore Duration: Contract / FTE Exp:- 5+ years Hybrid model weekly 3 days at office. Primary Skills: Python, Pyspark, Glue, Redshift, Lambda, DMS, RDS ,Cloud Formation and other AWS serverless Strong exp in SQL Detailed JD Seeking a developer who has good Experience in Athena, Python code, Glue,...

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Mastech Digital Full time

    Position: AWS Data EngineerLocations :- Chennai, Hyderabad, BangaloreDuration: Contract / FTEExp:- 5+ yearsHybrid model weekly 3 days at office.Primary Skills: Python, Pyspark, Glue, Redshift, Lambda, DMS, RDS ,Cloud Formation and other AWS serverlessStrong exp in SQLDetailed JDSeeking a developer who has good Experience in Athena, Python code, Glue, Lambda,...

  • Python+ Redshift/snowflake + Aws

    1 week ago

    Bengaluru, Karnataka, India Black & White Business Solutions Full time

    **Job Information**: Industry **IT Services*** Province **Karnataka*** City **Bangalore North*** Postal Code **560001*** Country **India*** **Python+ Redshift/snowflake + AWS**. - Development exclusively Spark, AWS around -Good experience in AWS, Glue, Redshift, Lambda, S3, Athena, Step Functions, SQL, SSIS, Power BI, Spark SQL and Pyspark. -Worked...

  • AWS Data Engineer

    14 hours ago

    Bengaluru, India Mastech Digital Full time

    Position: AWS Data EngineerLocations :- Chennai, Hyderabad, BangaloreDuration: Contract / FTEExp:- 5+ yearsHybrid model weekly 3 days at office.Primary Skills: Python, Pyspark, Glue, Redshift, Lambda, DMS, RDS ,Cloud Formation and other AWS serverlessStrong exp in SQLDetailed JDSeeking a developer who has good Experience in Athena, Python code, Glue, Lambda,...

  • Senior AWS Data Engineer

    6 days ago

    Bengaluru, India Ampstek Full time

    Title: Senior AWS Data Engineer Location: Chennai/Bengaluru/Hyderabad/Pune(Onsite) Job Type: Fulltime Key Skills – AWS Glue, RedShift, S3, Lambda Athena. Hands on experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Redshift. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is...