AWS Cloud Data Pipeline Specialist

1 week ago

Chennai, Tamil Nadu, India beBeeDataEngineer Full time US$ 1,80,000 - US$ 2,50,000

Job Opportunity:

We are seeking a seasoned professional with expertise in designing, developing, and deploying large-scale data pipelines on cloud infrastructure.

The ideal candidate will have a strong background in data processing and transformation using Apache Spark and SQL to support analytics and reporting requirements. They will also be responsible for building and maintaining orchestration workflows to automate data pipeline execution, scheduling, and monitoring.

In addition, the candidate will collaborate with analysts and business stakeholders to understand data requirements and deliver scalable data solutions. They will optimize data pipelines for performance, reliability, and efficiency, leveraging cloud-native technologies.

  • Main Responsibilities:
  • Design, develop, and deploy end-to-end data pipelines on cloud infrastructure.
  • Implement data processing and transformation workflows using Apache Spark and SQL.
  • Build and maintain orchestration workflows to automate data pipeline execution, scheduling, and monitoring.
  • Collaborate with analysts and business stakeholders to understand data requirements.
  • Optimize data pipelines for performance, reliability, and efficiency.

Necessary Skills:

  • Minimum 8+ years of experience building and deploying large-scale data processing pipelines in a production environment.
  • Hands-on experience in designing and building data pipelines on cloud infrastructure.
  • Strong proficiency in AWS services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.
  • Strong experience with Apache Spark for data processing and analytics.
  • Hands-on experience on orchestrating and scheduling data pipelines using AppFlow, Event Bridge, and Lambda.
  • Solid understanding of data modeling, database design principles, and SQL and Spark SQL.

About Our Company:

We are a leading technology company that values innovation, collaboration, and excellence. We offer a dynamic work environment, competitive compensation, and opportunities for growth and development.

  • AWS Data Pipeline Architect

    4 days ago

    Chennai, Tamil Nadu, India beBeeDataPipelineEngineer Full time ₹ 1,20,00,000 - ₹ 2,10,00,000

    Cloud Engineer Role SummaryWe are seeking an experienced professional to fill the Cloud Engineer position.The ideal candidate will possess strong proficiency in AWS Glue and PySpark, as well as a solid understanding of data lake architecture.This role requires collaboration with cross-functional teams to ensure seamless integration of data pipelines.Key...

  • Data Pipelines Specialist

    6 days ago

    Chennai, Tamil Nadu, India beBeeDataPipelines Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Pipelines SpecialistAbout the Role:We are seeking a skilled Data Pipelines Specialist to join our team. The ideal candidate will have hands-on experience designing, building, and maintaining production-grade pipelines at scale.Dream Job Responsibilities:Create end-to-end ETL/ELT processes that ensure reliability, scalability, and high...

  • Cloud Data Specialist

    1 day ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a seasoned Cloud Data Specialist with expertise in designing, developing, and maintaining scalable data pipelines and ETL processes using AWS services.

  • Cloud Data Specialist

    6 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Cloud Data SpecialistWe are seeking a skilled Cloud Data Specialist to join our team. The ideal candidate will have strong expertise in designing and developing data pipelines using Python, AWS Glue, and EMR.Key Responsibilities:Design and develop efficient and scalable ETL scripts to process structured and unstructured data.Work on data...

  • AWS Cloud Infrastructure Specialist

    6 days ago

    Chennai, Tamil Nadu, India beBeeCloudInfrastructure Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Job Title: Cloud Infrastructure SpecialistAbout the Role:We are seeking a skilled cloud infrastructure specialist to join our team. The ideal candidate will have expertise in designing, deploying, and managing scalable, secure, and high-performance cloud infrastructure.Key Responsibilities:Design and deploy cloud infrastructure using IaC tools like Terraform...

  • AWS Data

    6 days ago

    Chennai, Tamil Nadu, India Virtusa Full time US$ 1,00,000 - US$ 1,50,000 per year

    Job Summary:We are looking for a skilled AWS Data Engineer with strong experience in building and managing cloud-based ETL pipelines using AWS Glue, Python/PySpark, and Athena, along with data warehousing expertise in Amazon Redshift. The ideal candidate will be responsible for designing, developing, and maintaining scalable data solutions in a cloud-native...

  • Cloud Engineer

    3 days ago

    Chennai, Tamil Nadu, India beBeeCloudEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Job DescriptionWe are seeking a skilled Cloud Engineer to build robust data pipelines and integrate AWS services. This role involves developing scalable applications, collaborating with cross-functional teams, and ensuring seamless integration.Required Skills and QualificationsProficiency in programming languages: Python, JavaExperience with AWS services...

  • AWS Data Solutions Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    AWS Data EngineerJob Summary:We are seeking a highly skilled AWS data engineer to join our team. The ideal candidate will have hands-on experience with AWS data services, a strong background in data engineering, and a passion for delivering high-quality data solutions.This role involves designing, developing, and maintaining scalable and secure data...

  • AWS Cloud Architect Specialist

    1 week ago

    Chennai, Tamil Nadu, India beBeeDevops Full time ₹ 15,00,000 - ₹ 35,00,000

    Job Title: AWS Cloud StrategistWe are seeking an experienced AWS cloud architect with a strong DevOps background and proven expertise in AI/ML platforms to lead our team as a freelancer/part-time contractor.Key Responsibilities:Architect and optimize secure, scalable AWS cloud solutions for enterprise systems and AI/ML workloads.Design and manage VPC...

  • AWS Cloud Infrastructure Specialist

    7 days ago

    Chennai, Tamil Nadu, India beBeeCloudAdministrator Full time ₹ 83,00,000 - ₹ 1,63,00,000

    About the RoleAs a Cloud Administrator, you will play a key role in ensuring the high availability, security, and scalability of our AWS cloud infrastructure.Key responsibilities include managing and maintaining AWS cloud infrastructure, administering and supporting Kubernetes clusters and containerized applications, working closely with development and...