Senior Cloud Data Engineer

1 month ago

Bangalore, India Changeleaders Full time

Job Overview:

- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.

- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.

Location: India (Most Preferrable - Bangalore)

Experience Level : 5-12 years


Budget : 28 lpa

Role Overview :

- We are seeking a highly skilled and motivated Senior Cloud Data Engineer to join our dynamic team.

- As a key member of our cloud engineering group, you will play a crucial role in designing, implementing, and maintaining data pipelines and workflows on AWS.

- Your expertise in AWS Glue, AWS Redshift, AWS Managed Airflow, SQL, and optionally Python will be essential in ensuring the success of our data-driven projects.

Primary Skills :


- AWS PySpark Python programming.

- He has to do coding in day to day activities and also expected to review the code developed by the team.

- Must be aware of AWS services like Glue, redshift, S3, Airflow etc.

- Candidate is expected to manage stakeholder management along with mentoring the offshore team.

- Candidate must have technical expertise to advise effective solutions to the client on AWS Pipeline Development:

- Design, develop, and maintain ETL processes using AWS Glue to extract, transform, and load data from various sources (including S3, ORC/Parquet/Text files) into AWS Redshift.

- Optimize data pipelines for performance, scalability, and reliability.

- Implement data aggregation, consolidation, and enrichment.

Workflow Automation :

- Utilize AWS Managed Airflow (Apache Airflow) to orchestrate complex data workflows.

- Schedule, monitor, and manage data processing tasks efficiently.

Database Management :

- Leverage your strong SQL skills to create and optimize database queries.

Cloud Infrastructure :

- Collaborate with architecture teams to design and implement AWS cloud infrastructure.

- Ensure security, scalability, and cost-effectiveness of cloud resources.

Support Project Processes :

- Work closely with cross-functional teams to understand project requirements and deliverables.

- Provide technical support during project execution and troubleshoot issues as needed.

Optional Python Skills :

- Familiarity with Python for scripting and automation tasks is a plus.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

- AWS certifications (e.g., AWS Certified Data Analytics - Specialty) are advantageous.

- Strong problem-solving skills and ability to work independently.

- Excellent communication and collaboration skills.

Benefits :

- Competitive salary and benefits package.

- Opportunity to work on cutting-edge cloud technologies.

- Career growth and professional development.

(ref:hirist.tech)

  • Senior Mechanical Engineer

    2 weeks ago

    bangalore, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.

  • Senior Cloud Data Engineer

    1 month ago

    bangalore, India CIEL HR Services Full time

    Description: Title: Senior Cloud Data Engineer Location: Bangalore Top Skills: 1. Python and Pyspark 2. SQL ( must able to write complex sql) 3. Working knowledge with primary AWS Services like Glue, Airflow, DMS, Cloudwatch, cloudformation. 4. Database: Redshift, Aurora Responsibilities: • Design, implement, and support various database...

  • Senior Data Engineer

    1 day ago

    bangalore, India [24]7.ai Full time

    Job Role: Senior– Data EngineerJob Location: BangaloreWorking: HybridSummary of Essential Job FunctionsDesign, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...

  • Senior Cloud Data Engineer

    1 month ago

    bangalore, India Info Origin Inc Full time

    Job Description :As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions. Your primary responsibilities will include :Key Responsibilities :- Cloud Data Engineering...

  • Senior Cloud Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Info Origin Inc Full time

    Job Description :As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions. Your primary responsibilities will include :Key Responsibilities :- Cloud Data Engineering...

  • Senior Cloud Data Engineer

    2 weeks ago

    Bangalore, India Info Origin Inc Full time

    Job Description :As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions. Your primary responsibilities will include :Key Responsibilities :- Cloud Data Engineering...

  • Senior Cloud Data Engineer

    1 month ago

    Bangalore Rural, India CIEL HR Services Full time

    Description: Title: Senior Cloud Data Engineer Location: Bangalore Top Skills: 1. Python and Pyspark 2. SQL ( must able to write complex sql) 3. Working knowledge with primary AWS Services like Glue, Airflow, DMS, Cloudwatch, cloudformation. 4. Database: Redshift, Aurora Responsibilities: • Design, implement, and support various database services of our...

  • Senior Data Engineer

    1 month ago

    bangalore, India News Corp Full time

    Job Description : Senior Data Engineer About the Role We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airflow, DataFusion, SQL , GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the...

  • Senior Data Engineer

    3 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN Lorven Technologies Full time

    Job Description: As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms.- Leveraging your expertise in data engineering, cloud technologies, and analytics tools, you will play a key role in enabling data-driven...

  • Senior Data Engineer

    3 weeks ago

    Bangalore,Anywhere in India,Multiple Locations Lorven Technologies Full time

    Job Description: As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms.- Leveraging your expertise in data engineering, cloud technologies, and analytics tools, you will play a key role in enabling data-driven...

  • Senior Engineer Google Cloud Monitoring

    1 day ago

    bangalore, India Ericsson Full time

    Description Join our Team About this opportunity We are looking for a Sr. Engineer-Cloud Monitoring with hands-on experience in Integration Monitoring ticketing tool, Deployment, configuration.What you will do • Work with cloud native application design and development using APIs, containers, Kubernetes, service mesh (Istio),...

  • Senior Cloud Engineer

    1 week ago

    bangalore, India Avis Budget Group Full time

    Role: Senior EngineerJob Summary :The Technology Transformation team in Avis is a technology specialist team to roll out new capabilities into the cloud to support engineers, analysts, and business teams. This role does NOT require night shifts but need to have overlapping hours between IST and US east morning hours for proper hand holding with...

  • Senior Engineer, Data

    2 weeks ago

    bangalore, India News Corp Full time

    Job Description : Senior Engineer, Data One of the most innovative and high-profile teams in News Corp is looking for a seasoned data engineer to help accelerate its vision. The role will involve combining all of News Corp’s data across categories, countries and organizations into a singular view of a customer enabling engagement,...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Muoro Full time

    Job Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...

  • Senior Data Engineer

    1 month ago

    Bangalore, India Muoro Full time

    Job Description : About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions...

  • Aptus Data Labs

    4 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    2 weeks ago

    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    1 month ago

    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Senior Data Engineer

    3 weeks ago

    bangalore, India ZoomInfo Full time

    Senior Data Engineer Position: Senior Data Engineer Location: Bangalore Experience : 7-10 Years About the Role: Join our Product Data Monitoring team as a Data Engineer, where you play a pivotal role in enhancing and architecting the strategy behind our data monitoring and quality assurance systems. In this dynamic position, you'll serve as both a...

  • Senior Cloud Engineer

    1 week ago

    Bengaluru/ Bangalore, India TIBCO Software India Pvt Ltd Full time

    Apply for Senior Cloud Engineer, Career Progress Consultants in Bengaluru/ Bangalore for 5 - 10 Year of Experience on TimesJobs.com.