Mastering Data Pipelines

4 days ago


Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 16,00,000 - ₹ 20,10,000
Job Overview

We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and ETL workflows.

The ideal candidate will have strong expertise in Python, Spark, PySpark, and experience working with streaming data and collaborating with data scientists and business stakeholders to deliver high-quality solutions.

Required Skills and Qualifications
  • Technical Skills:
    • Expertise in Python, Spark, PySpark, and SQL
    • Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution
    • Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC)
    • Proficiency in Airflow/Prefect for scheduling and orchestration
    • Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins)
  • Experience:
    • Minimum 4 years of professional experience as a Data Engineer
    • Proven experience in building ETL pipelines, real-time streaming, and data transformations
    • Collaboration with data scientists and product teams to integrate AI/ML models into production
  • Education:
    • Bachelor's/Master's degree in Computer Science, Computer Engineering, or related field
Benefits

This role offers the opportunity to work with cutting-edge technology and collaborate with a talented team to deliver high-quality solutions.

Other Information

The ideal candidate will be able to manage and process large datasets using Spark, PySpark, and SQL, and deploy and manage Spark workloads on cloud platforms.



  • Thrissur, Kerala, India beBeeDataPipelineSpecialist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: OCI Data Flow SpecialistOverview:We are seeking a skilled professional to design, develop and manage data pipelines using Oracle Data Flow or Apache Spark (PySpark), with a solid understanding of data patterns, Python, and SQL.Responsibilities:3–12 years of experience in building and managing Data Lakes, Data Warehouses, and Data...


  • Thrissur, Kerala, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000

    Unlock the Power of Data EngineeringAs a Senior Data Engineer, you will play a vital role in building and maintaining scalable data pipelines that integrate healthcare data. This is a critical position where you will create high-performance pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated...


  • Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled data engineer to take on the challenge of designing, developing and maintaining scalable data pipelines. The successful candidate will ensure high-quality, reliable data for player behavior analysis, game performance and optimization.Key Responsibilities:Build, maintain and optimize data pipelines for large-scale slot game and player...


  • Thrissur, Kerala, India beBeeReltiodataintegration Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewThe role entails designing, configuring and integrating Reltio with enterprise systems to ensure data quality, governance and scalability for business-critical master data domains.Key Responsibilities:Implementing Reltio MDM platform configuration, workflows, APIs and ensuring smooth integration with other systems.Maintaining a strong...


  • Thrissur, Kerala, India beBeeETL Full time ₹ 15,00,000 - ₹ 25,00,000

    As a highly skilled ETL specialist, you will be responsible for designing and deploying efficient data pipelines that drive business growth.The ideal candidate will have hands-on experience with ETL development using Informatica and a strong understanding of data warehousing concepts. Additionally, proficiency in Python programming for data processing and...


  • Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Opportunity: Data EngineerWe are seeking a skilled professional to join our team as a Data Engineer.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Integrate data from various sources, ensuring data quality and consistency.Optimize data processing workflows for...

  • Data Engineer

    1 week ago


    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Job Title:Data Engineer - Pipeline Architect\About the Role:\We are seeking a highly skilled Data Engineer to design, implement and manage data pipelines. Key responsibilities include building CI/CD pipelines using GitHub Actions or equivalent tools, configuring and maintaining branch protection rules and workflows, automating Databricks deployments using...


  • Thrissur, Kerala, India beBeeElasticsearch Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    About this position:We are seeking a highly skilled professional to manage and maintain our Elasticsearch clusters.This includes evaluating cluster performance, planning changes for high-load events, applying security fixes, testing and performing incremental upgrades, and extending and improving our monitoring and alert infrastructure.Key...


  • Thrissur, Kerala, India beBeeDataGovernance Full time ₹ 80,00,000 - ₹ 1,25,00,000

    Job SummaryData Governance SpecialistThe Data Governance Specialist plays a critical role in ensuring the accuracy, completeness, and integrity of master data across various domains. This involves providing expert guidance, training, and support to business units on master data standards and processes.ResponsibilitiesExpert Guidance & Training Develop and...


  • Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Freelance Data EngineerWe are seeking a Freelance Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines using Python, SQL, Linux/Bash, PySpark, AWS, and Databricks.Job Description:Data Engineering is a key component of our organization's ability to drive business outcomes through data-driven decision making. We are...