Senior Cloud Data Engineer

4 weeks ago


BangaloreAnywhere in IndiaMultiple Locations, IN Change leaders Full time

Job Overview:

Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.

This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.

Location: India (Most Preferrable - Bangalore)

Experience Level: 5-12 years , Budget 28 lpa

Role Overview:

We are seeking a highly skilled and motivated Senior Cloud Data Engineer to join our dynamic team.

As a key member of our cloud engineering group, you will play a crucial role in designing, implementing, and maintaining data pipelines and workflows on AWS.

Your expertise in AWS Glue, AWS Redshift, AWS Managed Airflow, SQL, and optionally Python will be essential in ensuring the success of our data-driven projects.


Primary Skills : AWS PySpark Python programming.

- He has to do coding in day to day activities and also expected to review the code developed by the team.

- Must be aware of AWS services like Glue, redshift, S3, Airflow etc.

- Candidate is expected to manage stakeholder management along with mentoring the offshore team.

- Candidate must have technical expertise to advise effective solutions to the client on AWS platform.

Responsibilities:

Data Pipeline Development:

- Design, develop, and maintain ETL processes using AWS Glue to extract, transform, and load data from various sources (including S3, ORC/Parquet/Text files) into AWS Redshift.

- Optimize data pipelines for performance, scalability, and reliability.

- Implement data aggregation, consolidation, and enrichment.

Workflow Automation:

- Utilize AWS Managed Airflow (Apache Airflow) to orchestrate complex data workflows.

- Schedule, monitor, and manage data processing tasks efficiently.

Database Management:

- Leverage your strong SQL skills to create and optimize database queries.

Cloud Infrastructure:

- Collaborate with architecture teams to design and implement AWS cloud infrastructure.

- Ensure security, scalability, and cost-effectiveness of cloud resources.

Support Project Processes:

- Work closely with cross-functional teams to understand project requirements and deliverables.

- Provide technical support during project execution and troubleshoot issues as needed.

Optional Python Skills:

- Familiarity with Python for scripting and automation tasks is a Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

- AWS certifications (e.g., AWS Certified Data Analytics - Specialty) are advantageous.

- Strong problem-solving skills and ability to work independently.

- Excellent communication and collaboration skills.

Benefits:

- Competitive salary and benefits package.

- Opportunity to work on cutting-edge cloud technologies.

- Career growth and professional development.

(ref:hirist.tech)
  • Senior Data Engineer

    3 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Lorven Technologies Full time

    Job Description: As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms.- Leveraging your expertise in data engineering, cloud technologies, and analytics tools, you will play a key role in enabling data-driven...

  • Sigmoid Analytics

    4 weeks ago


    Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full time

    This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...


  • Anywhere in India/Multiple Locations, IN Rigel Networks Pvt.Ltd Full time

    Role Description:This is role for a Senior Data Engineer specializing in PySpark, Python, and SQL.As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines.You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement data...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Change leaders Full time

    Primary Skill - GCP + Python + SQLORGCP + Java + SQL NP - Immediate to 35 Days maxJob Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida- Bachelor's degree in computer science or a related discipline- 6+ years of applicable engineering experience- Experience in GCP, Big Query- Strong proficiency in Python with an emphasis in...


  • Bangalore/Anywhere in India/Multiple Locations, IN Kodehash Technologies Pvt Ltd Full time

    This is a full-time remote role for a Senior Cloud Engineer at Kodehash.The Senior Cloud Engineer will be responsible for participating in the design and implementation of cloud-based solutions, and will provide technical leadership throughout the development process.The Senior Cloud Engineer will collaborate closely with other members of the development...


  • Anywhere in India/Multiple Locations, IN ASPIRE NXT PRIVATE LIMITED Full time

    Experience : 5 - 8 yrs Employment Type : Permanent with AspireNxtJob Title : Senior Azure Cloud Engineer The Cloud Engineer under moderate supervision is responsible for designing, developing, implementing, and supporting the recommended infrastructure. This involves analysing, configuring, testing, and implementing the infrastructure. This may also involve...


  • Anywhere in India/Multiple Locations/Bangalore, IN Squareroot Consulting Pvt Ltd. Full time

    Job Title : Senior DevOps EngineerLocation : Bangalore / RemoteJob Description :We are seeking an experienced Senior DevOps Engineer to join our dynamic team. The ideal candidate will have 8+ years of experience in DevOps roles, with a strong background in startups or fast-paced environments. As a Senior DevOps Engineer, you will play a crucial role in...


  • Anywhere in India/Multiple Locations, IN SportsGameX Full time

    SportsGameX is seeking a highly skilled and experienced Senior Data Engineer to join our data team. This is an exciting opportunity to play a key role in designing and implementing robust data pipelines for our advanced analytics and machine learning Overview :As a Senior Data Engineer, you will be responsible for architecting, implementing, and maintaining...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations, IN AAR Consultancy Full time

    Technical Skills :1. Google Cloud Platform (GCP) : In-depth knowledge and hands-on experience with GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Data Studio, and Cloud Storage.2. Data Engineering : Strong understanding of data engineering principles, including data ingestion, transformation, processing, and storage.3. Big Data Technologies :...

  • Sigmoid Analytics

    4 weeks ago


    Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full time

    Job Description :This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

  • Aptus Data Labs

    1 day ago


    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Geektrust.in Full time

    About the job :Required Skills :- Open and capable of pair or mob programming.- Can work closely with developers in cross-functional teams.- Programming language and coding experience (e. g., able to build a simple service with automated tests).- Strong automation skills, including experience with unit testing and automated testing tools.- Delivers small...


  • Anywhere in India/Multiple Locations, IN HNM Solutions Full time

    Note : Immediate joinerRole : Alibaba cloud - Senior DevOps engineerTotal Experience : 6 +yearsResponsibilities :Cloud Infrastructure Management :- Design, implement, and maintain cloud infrastructure on Alibaba Cloud.- Ensure the scalability, performance, and security of cloud environments.Service Deployment and Optimization :- Deploy and optimize cloud...

  • Data Engineer

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Connectio IT Pvt Ltd Full time

    This is a full-time on-site role for a GCP Data Engineer. As a Data Engineer, your responsibilities will include data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Job Description :- You will work closely with the development team to design and implement data solutions to meet the organization's needs.-...


  • Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • MLOPS Azure Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Randstad Full time

    Job Description : - Lead MLOps initiatives, collaborating with key stakeholders to strategize, plan, and deliver projects.- Design, develop, and deploy complex AI/ML solutions on cloud infrastructure, ensuring scalability for changing business and technical needs.- Create infrastructure and architecture diagrams for projects.- Project manage, allocate tasks...


  • Anywhere in India/Multiple Locations/Bangalore, IN Unijob Solution & Training Pvt Ltd Full time

    Job Role : Senior AWS Cloud Engineer. Exp : 5 to 10 Year. Location : Pune. Package : 15 to 20 LPA. Notice Period : Immediate to 30 Days. Job Description : Responsibilities :- Design, implement, and maintain cloud-based solutions on the Google Cloud Platform (GCP).- Collaborate with cross-functional teams to understand business requirements and translate them...


  • Anywhere in India/Multiple Locations, IN Hiresoft Full time

    Female candidates onlySenior Python Developer - Cloud PlatformJob Description :We are seeking a seasoned Senior Python Developer with a strong background in cloud services (AWS, Azure, GCP) to join our dynamic team. The ideal candidate will possess a deep understanding of Python programming and significant experience working with major cloud platforms. This...

  • Senior Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN DigiMoksha Solutions Full time

    Job Description :- 3 to 5 years of experience with OBIEE and Oracle Analytics Cloud (OAC)- Any knowledge on OBIA (BI Apps), ODI, Oracle autonomous Datawarehouse (ADW), OTBI is a plus- Must have good understand on Oracle Data Visualization, user stories, data model development (with or without RPD)- Experience in configuring OBIEE /OACS security...

  • Cloud Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Chennai/Pune/Anywhere in India/Multiple Locations, IN Amk technologies Full time

    Job Description :We are seeking a talented and motivated Cloud Data Engineer to join our dynamic team.As a Cloud Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on Azure Cloud Platform. You will work closely with cross-functional teams to ensure efficient data flow and integration across...