Senior Cloud Data Engineer

2 months ago


Bengaluru, India Changeleaders Full time

Job Overview:

- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.

- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.

Location: India (Most Preferrable - Bangalore)

Experience Level : 5-12 years


Budget : 28 lpa

Role Overview :

- We are seeking a highly skilled and motivated Senior Cloud Data Engineer to join our dynamic team.

- As a key member of our cloud engineering group, you will play a crucial role in designing, implementing, and maintaining data pipelines and workflows on AWS.

- Your expertise in AWS Glue, AWS Redshift, AWS Managed Airflow, SQL, and optionally Python will be essential in ensuring the success of our data-driven projects.

Primary Skills :


- AWS PySpark Python programming.

- He has to do coding in day to day activities and also expected to review the code developed by the team.

- Must be aware of AWS services like Glue, redshift, S3, Airflow etc.

- Candidate is expected to manage stakeholder management along with mentoring the offshore team.

- Candidate must have technical expertise to advise effective solutions to the client on AWS Pipeline Development:

- Design, develop, and maintain ETL processes using AWS Glue to extract, transform, and load data from various sources (including S3, ORC/Parquet/Text files) into AWS Redshift.

- Optimize data pipelines for performance, scalability, and reliability.

- Implement data aggregation, consolidation, and enrichment.

Workflow Automation :

- Utilize AWS Managed Airflow (Apache Airflow) to orchestrate complex data workflows.

- Schedule, monitor, and manage data processing tasks efficiently.

Database Management :

- Leverage your strong SQL skills to create and optimize database queries.

Cloud Infrastructure :

- Collaborate with architecture teams to design and implement AWS cloud infrastructure.

- Ensure security, scalability, and cost-effectiveness of cloud resources.

Support Project Processes :

- Work closely with cross-functional teams to understand project requirements and deliverables.

- Provide technical support during project execution and troubleshoot issues as needed.

Optional Python Skills :

- Familiarity with Python for scripting and automation tasks is a plus.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

- AWS certifications (e.g., AWS Certified Data Analytics - Specialty) are advantageous.

- Strong problem-solving skills and ability to work independently.

- Excellent communication and collaboration skills.

Benefits :

- Competitive salary and benefits package.

- Opportunity to work on cutting-edge cloud technologies.

- Career growth and professional development.

(ref:hirist.tech)

  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story of...


  • Bengaluru, Karnataka, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.Manpower Planning.Preparing of Project Cost.Schedule wise work execution.As Drawing & quality work execution.Client & Third Party Manage.Working Team Manage & Review.Reporting to Management.ROB & FOB Fabrication & Erection Work Knowledge.


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server

  • Senior Data Engineer

    2 months ago


    Bengaluru, India Lorven Technologies Full time

    Job Description: As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms.- Leveraging your expertise in data engineering, cloud technologies, and analytics tools, you will play a key role in enabling data-driven...

  • Senior Data Engineer

    4 weeks ago


    Bengaluru, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...

  • Data Engineer

    5 days ago


    Bengaluru, Karnataka, India CLOUD RAPTOR INDIA DIGITAL SERVICES Full time

    About the job:About us : At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across many industries. Focused on cloud technologies and technical expertise, we help organisations navigate the everchanging landscape of the digital era. With dedicated Centres of Excellence across the globe, we are enabled to deliver...


  • Bengaluru, Karnataka, India CIEL HR Services Full time

    Description: Title: Senior Cloud Data Engineer Location: Bangalore Top Skills: 1. Python and Pyspark 2. SQL ( must able to write complex sql) 3. Working knowledge with primary AWS Services like Glue, Airflow, DMS, Cloudwatch, cloudformation. 4. Database: Redshift, Aurora Responsibilities: • Design, implement, and support various database services...

  • Aws Cloud Architect

    5 days ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID: 248981We are currently seeking a AWS Cloud Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN).BackgroundAs an Amazon Web Services (AWS) cloud architect, you will be responsible to architect and manage the cloud environment for a Digital Banking Asset. Duties include architecting and implementing cloud solutions, automating cloud...

  • Senior Cloud Engineer

    4 weeks ago


    Bengaluru, India Avis Budget Group Full time

    Role: Senior Engineer Job Summary : The Technology Transformation team in Avis is a technology specialist team to roll out new capabilities into the cloud to support engineers, analysts, and business teams. This role does NOT require night shifts but need to have overlapping hours between IST and US east morning hours for proper hand holding with...


  • Bengaluru, Karnataka, India Changeleaders Full time

    Job Overview: Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.Location: India (Most...

  • Sr data engineer

    2 days ago


    Bengaluru, India NTT DATA Services Full time

    Req ID:286326NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Senior data engineerStrong...

  • Senior Data Engineer

    1 month ago


    Bengaluru, India [24]7.ai Full time

    Job Role: Senior– Data EngineerJob Location: BangaloreWorking: HybridSummary of Essential Job Functions- Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.- Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud Platform.-...

  • Cloud Data Engineer

    2 weeks ago


    Bengaluru, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Cloud Data EngineerCloud Data EngineerReq ID: Department: Tech CDIS Cloud, Data and Analytics Division: Technology Location: BengaluruAbout UsAt ANZ, we're applying new ways technology and data can be harnessed as we work towards a common goal: to improve the financial wellbeing and sustainability of our millions of customers.Our community of over 5,...

  • Senior Cloud Engineer

    2 months ago


    Bengaluru, India Avis Budget Group (ABG) Full time

    Role: Senior EngineerJob Summary:The Technology Transformation team in Avis is a technology specialist team to roll out new capabilities into the cloud to support engineers, analysts, and business teams. This role does NOT require night shifts but need to have overlapping hours between IST and US east morning hours for proper hand holding with...

  • Senior Cloud Engineer

    2 months ago


    Bengaluru, India Avis Budget Group (ABG) Full time

    Role: Senior Engineer Job Summary : The Technology Transformation team in Avis is a technology specialist team to roll out new capabilities into the cloud to support engineers, analysts, and business teams. This role does NOT require night shifts but need to have overlapping hours between IST and US east morning hours for proper hand holding with...

  • Cloud Data Engineer

    6 days ago


    Bengaluru, Karnataka, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Cloud Data EngineerCloud Data EngineerReq ID: Department: Tech CDIS Cloud, Data and Analytics Division:Technology Location: BengaluruAbout UsAt ANZ, we're applying new ways technology and data can be harnessed as we work towards a common goal: to improve the financial wellbeing and sustainability of our millions of customers.Our community of over 5,...

  • Cloud Data Engineer

    5 days ago


    Bengaluru, Karnataka, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Cloud Data Engineer Cloud Data Engineer Req ID: Department: Tech CDIS Cloud, Data and Analytics Division: Technology Location: Bengaluru About UsAt ANZ, we're applying new ways technology and data can be harnessed as we work towards a common goal: to improve the financial wellbeing and sustainability of our millions of customers. Our community of over 5,...


  • Bengaluru, Karnataka, India Lorven Technologies Full time

    JOB TITLE: Senior Data Engineer - Cloud Analytics SpecialistJoin our team as a Senior Data Engineer specializing in Cloud Analytics! You will have a pivotal role in designing, constructing, and managing scalable data pipelines and analytics solutions on various cloud platforms. Utilize your expertise in data engineering, cloud technologies, and analytics...


  • Bengaluru, India NTT DATA Services Full time

    Lead Data Engineering Project Team,Expertise in Databricks,Expertise in Azure Cloud and its services,Experienced in Healthcare projects,Experience implementing FHIR Data model and FHIR Server