Senior Data Pipeline Engineer – Cloud Computing

2 days ago

Malappuram, India beBeePlatform Full time

Platform Engineer JobSyntasa is seeking a high-caliber and dedicated Platform Engineer to join its development center in India. This position offers an exciting opportunity to contribute to the growth of a world-class engineering center.This role will focus on designing and developing scalable data pipelines and platform services using Python, Apache Spark, and Databricks.The ideal candidate will have experience working with notebooks (Jupyter, Zeppelin, or Databricks) for data processing, analysis, and automation.Design and develop scalable data pipelines and platform services using Python, Apache Spark, and Databricks.Develop and manage notebook-based workflows for data processing, analysis, and automation.Build and optimize data integration workflows and reusable components for ingestion, transformation, and orchestration.Deploy and manage workloads on Kubernetes, ensuring scalability and reliability.Implement and maintain cloud-native solutions on AWS, GCP, or Azure.Collaborate with data science, application, and platform teams to deliver efficient and robust data services.Drive automation, observability, and CI/CD improvements across the platformStrong experience in Python for data engineering, scripting, and automation.Solid understanding of Apache Spark and distributed data processing.Experience working with notebooks (Jupyter, Zeppelin, or Databricks).Hands-on experience with Kubernetes for container orchestration, workload deployments and scaling.Bachelor's or Master's degree (or foreign equivalent) in Computer Science, Engineering, or a related field.4+ years of progressive experience as a Software Engineer, Data Engineer, or Platform Engineer.Strong problem-solving, collaboration, and communication skills.Ability to thrive in a fast-paced, distributed engineering environment.Familiarity with DevOps practices, CI/CD pipelines, and cloud environments (AWS, GCP, Azure).Experience with Kafka, real-time streaming, Java/Spring Boot.Knowledge of RDBMS (PostgreSQL) and NoSQL databases.Knowledge of BigData services like BigQuery, BigTable, Hive.A challenging and rewarding role with opportunities for growth and development.A collaborative and dynamic work environment.A competitive salary and benefits package.

  • Cloud Computing Data Specialist

    2 days ago

    Malappuram, India beBeeData Full time

    Cloud Computing Data SpecialistWe are seeking a seasoned professional to design and implement large-scale data processing systems using Google Cloud Platform (GCP) technologies.The ideal candidate will be responsible for:Designing and developing scalable data pipelines using GCP's Dataflow serviceDeveloping and maintaining big data processing applications...

  • Data Pipeline Architect

    4 days ago

    Malappuram, India beBeeAzure Full time

    Job Opportunity: Experienced professionals are sought after to leverage their expertise in designing and developing ETL/ELT pipelines, optimizing data workflows, and ensuring robust data observability and streaming.Key Responsibilities:Design, develop, and maintain scalable data pipelines using cloud-based tools like Azure Data Factory (ADF) and Databricks...

  • Senior Data Engineer

    2 weeks ago

    Malappuram, India DataOrbit AI Full time

    Company Description DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, we enable organizations to adopt AI solutions that unlock growth opportunities and operational efficiencies. With expertise in AI strategy,...

  • Senior Cloud Data Solutions Architect

    2 days ago

    Malappuram, India beBeeData Full time

    Senior Data Architect OpportunityJob Title: Senior Data ArchitectLocation: Flexible, Hyderabad, Pune, Jaipur Experience required: 12+ yearsJob Description:We are seeking an experienced senior data architect to lead the design and implementation of robust, scalable, and high-performance data architectures that support our enterprise data initiatives.The ideal...

  • Cloud Data Architect

    6 days ago

    Malappuram, India beBeeDataEngineering Full time

    Job Title: Cloud Data ArchitectWe are seeking an experienced and skilled Cloud Data Architect to lead the design, development, and implementation of data solutions using AWS and Snowflake. The ideal candidate will have a strong understanding of cloud computing, data warehousing concepts, and best practices.The successful candidate will work closely with...

  • Senior Cloud Data Architect

    2 days ago

    Malappuram, India beBeeDataEngineer Full time

    Job OverviewWe're seeking experienced data engineers to contribute to our international data platform, analytics, and cloud engineering teams.Core Responsibilities:Key Objectives:Develop scalable data pipelines using cutting-edge tools and frameworks.Implement ETL/ELT workflows for structured semi-structured, and unstructured data.Design and build data...

  • Leading Cloud Data Architect

    4 days ago

    Malappuram, India beBeeDataEngineer Full time

    Establishing a robust data infrastructure on the cloud requires strategic leadership from a Senior Data Engineer.This professional will be responsible for architecting and optimizing data pipelines and workflows, leveraging technologies such as Apache Iceberg, AWS Glue, Redshift, and Atlan for governance. The goal is to create scalable platforms that support...

  • Cloud Data Engineer

    2 days ago

    Malappuram, India beBeeDataEngineer Full time

    We're seeking a skilled professional to build and optimize data pipelines, design data architectures, and work on cloud-native data solutions. This role is ideal for individuals with hands-on experience in data engineering.The successful candidate will be responsible for designing and maintaining scalable schemas in MSSQL, Redshift, and Snowflake. They will...

  • Senior Data Pipeline Specialist

    6 days ago

    Malappuram, India beBeeDataPipelineDeveloper Full time

    Job RoleWe are seeking a meticulous and proactive individual to ensure the accuracy, reliability, and performance of data pipelines built on Google Cloud Platform.Design and implement comprehensive test plans, test cases, and test scenarios for ETL pipelinesCreate and maintain test certificates and validation documentation for audit and compliance...

  • Data Engineering Leader

    4 days ago

    Malappuram, India beBeeData Full time

    Job Title: Senior Data EngineerWe're seeking a skilled and experienced Senior Data Engineer to join our team.Design, build, and optimize data lakehouse solutions for analytics, AI, and MLOps across multiple clients.Develop scalable PySpark pipelines, implement data quality, validation, and lineage tracking, integrate pipelines with MLflow for experiment...