Cloud Data Engineer

1 day ago

hubballi, India beBeeDataEngineer Full time

Senior Data Engineer Job DescriptionWe are building the future of healthcare analytics to design, build and scale robust data pipelines powering nationwide analytics and supporting our machine learning systems.About this role:This senior position involves designing, building and maintaining scalable ETL pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow (MWAA).Data Pipeline Development: Design, build and maintain scalable ETL pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow (MWAA).Data Lake/Lakehouse Management: Develop and maintain the SAIVA Data Lake/Lakehouse on AWS, ensuring quality, governance, scalability and accessibility.Distributed Processing: Run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS.Ingestion Frameworks: Implement batch and streaming ingestion frameworks (APIs, databases, files, event streams).Quality Checks: Enforce validation and quality checks to ensure reliable analytics and ML readiness.Pipeline Monitoring: Monitor and troubleshoot pipelines with CloudWatch, integrating observability tools like Grafana, Prometheus or Datadog.The ideal candidate will have experience in designing and implementing large-scale data pipelines, as well as expertise in cloud-based technologies such as AWS. They should be able to work independently and as part of a team, with excellent communication and problem-solving skills.

  • Senior Cloud Data Engineer

    3 days ago

    hubballi, India beBeeData Full time

    Data Solutions ArchitectWe are looking for an experienced professional with strong hands-on expertise in designing and building scalable data pipelines and cloud-based data solutions.Design, build, and optimize large-scale data pipelines and ETL workflows to efficiently process high-volume data.Develop reusable Python scripts for data processing and...

  • Cloud-Based Data Engineer Position

    3 days ago

    hubballi, India beBeeDataEngineer Full time

    Data Pipeline Specialist needed to design, build and maintain large-scale data pipelines using Google Cloud Platform technologies.This role requires expertise in cloud-based technologies and strong skills in big data processing. Key responsibilities include:Designing data pipelines with efficient data processing and analysis techniques.Implementing scalable...

  • Senior Cloud Data Engineering Specialist

    1 day ago

    hubballi, India beBeeCloudDataEngineer Full time

    We are seeking an experienced Cloud Data Engineer to join our team.Job Overview:The ideal candidate will have a strong background in cloud-based data engineering, with a focus on GCP technologies.5+ years of experience in data engineeringExpertise in GCP Data Side, Storage Classes, Dataflow, Big Query, PySpark/Python, and AirflowKey Responsibilities:- Design...

  • Cloud Data Engineer

    3 days ago

    hubballi, India beBeeData Full time

    Cloud Data SpecialistWe are seeking a highly skilled Cloud Data Specialist to develop data pipelines for enterprise search applications using Azure services.Build and maintain data integration feeds according to requirements;Analyze business needs and design efficient data pipelines that load data into cloud-based storage systems;Develop data pipelines...

  • Senior Cloud Data Architect

    4 days ago

    hubballi, India beBeeData Full time

    Cloud Data Engineer OpportunityWe are seeking a highly skilled Cloud Data Engineer to join our team and contribute to the design, development, and implementation of large-scale cloud-native data engineering projects. The ideal candidate will have hands-on experience with modern data engineering tools and frameworks, including AWS Glue, Redshift, EMR, Azure...

  • Data Engineer

    4 days ago

    hubballi, India beBeeCloud Full time

    About Data EngineeringWe are looking for an experienced professional to design, implement and maintain robust data pipelines and scalable data lakes.Key Responsibilities:Design, develop and maintain scalable ETL processes using cloud-native tools such as AWS DMS, AWS Glue and Azure Data Factory.Architect and implement data lakes and warehouses on cloud...

  • Cloud Data Engineer

    2 days ago

    hubballi, India beBeeDatabricks Full time

    Job Title: Cloud Data Engineer - Azure Databricks Expert We are seeking a seasoned cloud data engineer to manage complex data ingestion pipelines, ETL/ELT processes, and incident management in a global team. Proficiency in Databricks for cluster management, job execution, and troubleshooting is required.Key Responsibilities:Demonstrate strong knowledge of...

  • Cloud Engineering Specialist

    3 days ago

    hubballi, India beBeePlatform Full time

    Platform Engineer Job DescriptionJob Summary:The Platform Engineer will design and develop scalable data pipelines and platform services using Python, Apache Spark, and Databricks. They will also develop and manage notebook-based workflows for data processing, analysis, and automation.Key Responsibilities:Design and Develop Scalable Data Pipelines: Create...

  • Cloud Data Architect

    1 day ago

    hubballi, India beBeeDataEngineer Full time

    GCP Data Engineer Job DescriptionThis is a key role in our data engineering team, focusing on the development and maintenance of large-scale data processing systems on Google Cloud Platform (GCP). The ideal candidate will have strong expertise in GCP services, particularly BigQuery and DataProc, as well as proficient skills in SQL, Python, and...

  • Freelance Cloud Data Scientist

    1 day ago

    hubballi, India beBeeDataEngineer Full time

    Job DescriptionWe are seeking a highly skilled Freelance GCP Data Engineer to join our team on a freelance basis. The ideal candidate will have expertise in Apache NiFi, SQL, and API integrations to design, implement, and optimize real-time data pipelines.This role involves working with the Google Cloud Platform (GCP) ecosystem, including BigQuery, Pub/Sub,...