AWS Data Engineer

3 weeks ago

PuneChennaiMumbaiBangaloreDelhi NCRHyderabad, India Change Leaders Full time

Job Description : AWS Glue + Python Pyspark

Job Overview :

Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.

Location : India (Most Preferrable - Bangalore)

Experience Level : 5-12 years

Role Overview :

We are seeking a highly skilled and motivated Senior Cloud Data Engineer to join our dynamic team. As a key member of our cloud engineering group, you will play a crucial role in designing, implementing, and maintaining data pipelines and workflows on AWS. Your expertise in AWS Glue, AWS Redshift, AWS Managed Airflow, SQL, and optionally Python will be essential in ensuring the success of our data-driven projects.

Primary Skills :


- AWS PySpark Python programming. He has to do coding in day to day activities and also expected to review the code developed by the team.

- Must be aware of AWS services like Glue, redshift, S3, Airflow etc.

- Candidate is expected to manage stakeholder management along with mentoring the offshore team.

- Candidate must have technical expertise to advise effective solutions to the client on AWS platform.

Responsibilities :

Data Pipeline Development :

- Design, develop, and maintain ETL processes using AWS Glue to extract, transform, and load data from various sources (including S3, ORC/Parquet/Text files) into AWS Redshift.

- Optimize data pipelines for performance, scalability, and reliability.

- Implement data aggregation, consolidation, and enrichment.

Workflow Automation :

- Utilize AWS Managed Airflow (Apache Airflow) to orchestrate complex data workflows.

- Schedule, monitor, and manage data processing tasks efficiently.

Database Management :

- Leverage your strong SQL skills to create and optimize database queries.

Cloud Infrastructure :

- Collaborate with architecture teams to design and implement AWS cloud infrastructure.

- Ensure security, scalability, and cost-effectiveness of cloud resources.

Support Project Processes :

- Work closely with cross-functional teams to understand project requirements and deliverables.

- Provide technical support during project execution and troubleshoot issues as needed.

Optional Python Skills :

- Familiarity with Python for scripting and automation tasks is a plus.

Willingness to Work Late Hours :

The role involves working until 12:30 AM IST (Indian Standard Time) due to global project requirements. Flexibility in working hours is essential.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

- AWS certifications (e.g., AWS Certified Data Analytics - Specialty) are advantageous.

- Strong problem-solving skills and ability to work independently.

- Excellent communication and collaboration skills.

Benefits :

- Competitive salary and benefits package.

- Opportunity to work on cutting-edge cloud technologies.

- Career growth and professional development.

If you are passionate about cloud data engineering, thrive in a collaborative environment, and are ready to take on exciting challenges, we encourage you to apply

(ref:hirist.tech)

  • AWS Data Engineer

    6 days ago

    Delhi NCR, India A2mantras Full time

    Overview :We are seeking a talented AWS Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on the AWS cloud platform. This role requires a deep understanding of AWS services, data engineering best practices, and proficiency in programming and scripting...

  • AWS Data Engineer

    2 months ago

    Delhi NCR, India A2mantras Full time

    Overview : We are seeking a talented AWS Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on the AWS cloud platform. This role requires a deep understanding of AWS services, data engineering best practices, and proficiency in programming and scripting...

  • Data Scientist, AWS Support Strategy Analytics and Data Science, Support Engineering

    5 days ago

    bangalore, India AWS India - Karnataka - D11 Full time

    AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....

  • AWS Data Engineer

    3 weeks ago

    Bangalore/Chennai/Pune/Mumbai, India Voyager Partners Full time

    Company : Mastek Digital (https :// Overview :We are looking for a talented AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on the AWS platform. Your expertise in AWS services and data engineering will be critical in building scalable,...

  • AWS Data Engineer

    2 months ago

    Bangalore/Chennai/Pune/Mumbai, India Voyager Partners Full time

    Company : Mastek Digital (https :// Overview :We are looking for a talented AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on the AWS platform. Your expertise in AWS services and data engineering will be critical in building scalable,...

  • Data Engineer

    2 months ago

    Bangalore/Chennai, Tamil Nadu, India Notus Full time

    AWS Data EngineerJob Title: AWS Data EngineerLocation: Bangalore / ChennaiExperience: 8+ YearsJob Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services, Kafka,...

  • Data Engineer

    3 weeks ago

    Bangalore/Chennai, India Notus Full time

    AWS Data Engineer Job Title: AWS Data Engineer Location: Bangalore / Chennai Experience: 8+ Years Job Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services,...

  • Data Engineer

    2 months ago

    Bangalore/Chennai, India Notus Full time

    AWS Data Engineer Job Title: AWS Data Engineer Location: Bangalore / Chennai Experience: 8+ Years Job Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services,...

  • Data Engineer

    7 days ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 282638 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...

  • Aptus Data Labs

    2 months ago

    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    2 months ago

    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • AWS Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India CliqHR Full time

    Job Description :Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns Work closely with DevOps engineer to support...

  • AWS Data Engineer

    7 days ago

    bangalore, India EXL Full time

    Job Description: As an AWS Data Engineer, you will be responsible for designing, developing, and managing our cloud-based data infrastructure on Amazon Web Services (AWS). The ideal candidate will have extensive experience with AWS services, strong expertise in data engineering principles, and a passion for building robust and scalable data solutions. Key...

  • AWS Data Engineer

    2 weeks ago

    bangalore, India Torry Harris Full time

    Are you an AWS Data Engineer looking for an exciting new opportunity? Look no further than Torry Harris! We are a leading digital transformation company, and we are currently seeking a talented and experienced AWS Data Engineer to join our team.As an AWS Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining our...

  • AWS Data Engineer

    3 weeks ago

    Hyderabad, India ProArch Full time

    ProArch is seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, building, and maintaining data solutions on the AWS platform.Job Description:Must to Have Skills : AWS - Data Engineer - PySpark, Glue, S3, AthenaTo work in the capacity of AWS Cloud developer.Scripting/programming in...

  • AWS Data Engineer

    3 weeks ago

    Hyderabad, India ProArch Full time

    ProArch is seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, building, and maintaining data solutions on the AWS platform.Job Description:Must to Have Skills : AWS - Data Engineer - PySpark, Glue, S3, AthenaTo work in the capacity of AWS Cloud developer.Scripting/programming in...

  • Sr Data Scientist, AWS Support Strategy Analytics and Data Science, Support Engineering

    2 months ago

    bangalore, India AWS India - Karnataka - D11 Full time

    AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....

  • Sr Data Scientist, AWS Support Strategy Analytics and Data Science, Support Engineering

    3 weeks ago

    bangalore, India AWS India - Karnataka - D11 Full time

    AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....

  • Data Engineer

    4 weeks ago

    bangalore, India Concentrix Full time

    Job Description:Experience: 4 Years - 8 YearsJob Location: PAN IndiaNotice Period: Immediate/ 15 DaysShift Timings: 03:00 PM to 12:00 AM (IST)Skills: Data Engineering; data Pipeline; ETL, AWS (and frameworks), Pyspark/ scala; SQL & pythonJob Description:We are seeking an experienced Data Engineer to join our team. The ideal candidate should have a...