Cloud-Based Data Pipeline Specialist

4 days ago

Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

Job Title: Data Engineer

Domain: Cloud-based Solutions

Overview:

Leading organizations are seeking skilled data engineers to design, build, and manage robust data pipelines that power cloud-based solutions.

Key Responsibilities:

  • Design, develop, and maintain ETL/ELT pipelines to process structured, unstructured, and streaming data in the cloud.
  • Leverage cloud services such as S3, Glue, EMR, Lambda, Kinesis, Step Functions, Redshift, Athena, DynamoDB, RDS, and Lake Formation for scalable data ingestion, transformation, storage, and querying.
  • Ensure robust data governance, security, and quality controls throughout the data lifecycle, supporting regulatory compliance.
  • Enable both real-time and batch data processing pipelines to power AI-driven workflows and applications.
  • Collaborate closely with AI/ML teams to prepare clean, high-quality datasets optimized for model training, inference, and fine-tuning.
  • Optimize data infrastructure to achieve high performance, scalability, reliability, and cost efficiency.
  • Implement CI/CD pipelines and data engineering best practices in a cloud-native architecture for automated deployments.
  • Monitor, debug, and resolve issues in data pipelines to ensure high availability, reliability, and minimal latency.
  • Maintain thorough documentation of data pipelines, architecture, and processes to facilitate reproducibility and knowledge transfer.

Requirements:

  • Proven experience in designing, developing, and maintaining large-scale data pipelines.
  • Familiarity with cloud services and AWS ecosystem.
  • Strong understanding of data governance, security, and quality control principles.
  • Excellent collaboration and communication skills.
  • Ability to work in a fast-paced environment and adapt to changing requirements.

What We Offer:

  • Competitive salary and benefits package.
  • Opportunities for professional growth and development.
  • A dynamic and collaborative work environment.

  • Cloud-Based Data Architect

    3 days ago

    Kozhikode, Kerala, India beBeeEngineer Full time ₹ 15,60,000 - ₹ 20,16,000

    We are seeking a highly experienced Senior Informatica Engineer to design and develop cloud-based ETL pipelines using Azure services and integrate data into AWS Datalake or other modern data platforms.Job Description:The ideal candidate will have a strong background in designing and developing scalable ETL pipelines using Azure Data Factory and related...

  • AWS Cloud Data Specialist

    5 days ago

    Kozhikode, Kerala, India beBeeCloud Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: AWS Cloud Data SpecialistWe are seeking an experienced AWS Cloud Data Specialist to join our team. The ideal candidate will have a strong background in designing, implementing, and maintaining data integration pipelines using AWS services.This includes proficiency in developing ETL pipelines with PySpark, focusing on performance, scalability, and...

  • Cloud Data Specialist

    7 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job Title: Cloud Data SpecialistOverview:We are seeking a skilled Cloud Data Specialist to lead our data strategy and implementation. This role involves designing, building, and maintaining large-scale data systems on Google Cloud Platform (GCP).Key Responsibilities:Design and develop data architectures for real-time analytics using GCP services like...

  • Data Pipeline Architect

    1 week ago

    Kozhikode, Kerala, India beBeeCloud Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior AWS Glue DeveloperAs a senior developer, you will be responsible for designing and implementing data ingestion and transformation pipelines using serverless and cloud-based services.The ideal candidate will have experience with the Extract-Load-Transform approach, metadata-driven integration design, and Data Build Tool to enable rapid onboarding of...

  • Senior Data Pipeline Specialist

    15 hours ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Are you a data pipeline specialist with a passion for driving business growth through data-driven insights? As a seasoned ETL Engineer, you will play a key role in designing and deploying large-scale data pipelines to support our business intelligence initiatives.Key Responsibilities:Design and Develop Scalable ETL PipelinesWork extensively with SQL to...

  • Cloud Data Architecture Specialist

    3 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking an experienced data architect to lead the development and deployment of cloud-based data solutions. The ideal candidate will oversee technical project direction, mentor team members, and deliver scalable systems using cloud and big data technologies.Design, develop, and deploy reliable data processing systems in a cloud...

  • Cloud Data Specialist

    1 week ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Cloud Data SpecialistWe are seeking a skilled and experienced professional to join our team as a Cloud Data Specialist. This role involves designing, developing, and maintaining data-intensive applications using cutting-edge technologies.Key Responsibilities:Collaborate with cross-functional teams to deliver high-quality solutionsDesign and...

  • Cloud Data Engineer with Expertise in ETL Pipelines

    1 day ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    We are seeking an experienced Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems on Google Cloud Platform (GCP).The ideal candidate will have extensive experience in GCP, specifically with GCS, PubSub, Dataflow or DataProc, Bigquery,...

  • Building Financial Data Pipelines

    1 week ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data SpecialistOur organization is seeking a skilled professional to design, develop, and maintain robust data pipelines that handle high-volume financial data.Key Responsibilities:Design and manage end-to-end data pipelines for stocks, crypto, and other financial datasets.Integrate third-party APIs and data feeds into internal systems.Develop and...

  • Cloud Data Migration Specialist

    5 days ago

    Kozhikode, Kerala, India beBeeMigration Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Migration SpecialistWe are seeking an experienced professional to lead and execute end-to-end data migration projects from on-premises to cloud platforms.Strong expertise in data migrations with hands-on experience in on-prem - cloud and cloud - cloud workloads is required.Proficiency in cloud migration tools (Azure Data Factory, Azure DMS,...