Big Data Engineer

1 day ago

Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

As a senior data engineer, you will play a critical role in designing and developing scalable data pipelines that process massive datasets efficiently. Our team relies on talented individuals like you to drive business growth through innovative solutions.

Key Responsibilities
  • Data Pipeline Development: Design and build high-throughput, low-latency pipelines to process large-scale datasets, ensuring they can handle 5-10 TB of structured and unstructured data.
  • Data Filtering & Curation: Optimize data ingestion and transformation for downstream AI/ML models, implementing intelligent scanning mechanisms to filter out relevant data.
  • AI/ML Integration: Leverage GenAI models under the Vertex AI umbrella, building and fine-tuning custom models when necessary.
  • Cloud Infrastructure: Architect scalable solutions primarily on GCP (Vertex AI, BigQuery, GKE, Cloud Run, PostgreSQL, Dataflow, Pub/Sub), with Azure knowledge being a plus.
  • Performance Optimization: Ensure real-time, low-latency processing for high-volume workloads, optimizing GPU/CPU-intensive environments to manage cost and efficiency.
  • Collaboration & Ownership: Work closely with data scientists, ML engineers, and solution architects, taking end-to-end ownership of assigned tasks and deliverables.
Required Skills & Qualifications
  • Programming: Expert-level Python is mandatory.
  • Data Engineering: Hands-on experience with streaming pipelines and large-scale data ingestion frameworks.
  • AI/ML Expertise: Experience integrating and fine-tuning LLMs and GenAI models, comfortable working with custom model development where necessary.
  • Cloud: GCP (mandatory) experience with Vertex AI, BigQuery, GKE, Cloud Run, PostgreSQL, Dataflow, Pub/Sub, etc.
  • Scalability & Low Latency: Proven ability to design and implement high-performance, distributed data solutions.
  • High-Volume Data Processing: Experience processing massive datasets efficiently within strict timeframes.

  • Big Data Engineer

    15 hours ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 27,00,000

    Big Data Engineers are responsible for designing, developing and maintaining large-scale data pipelines using cloud-based platforms.Job Role:Develop data engineering solutions to drive business insightsCollaborate with cross-functional teams to deliver high-quality data solutionsIntegrate machine learning models into production-ready codeKey...

  • Big Data Specialist

    7 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 32,00,000

    Job Title: Big Data SpecialistAre you looking for a challenging role that involves working with large datasets? Do you have experience with data analytics and visualization tools?We are seeking a skilled Big Data Specialist to join our team. The ideal candidate will have a strong background in data analysis, machine learning, and programming languages such...

  • Big Data Solutions Architect

    5 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Big Data EngineerWe are looking for a skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines that handle terabytes of structured and unstructured data.The ideal candidate has 1–2 years of experience in big data engineering and is excited to solve tough...

  • Engineering Leader

    7 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleSigma Engineer at ScaleAbout the Role:In this pivotal position, you will spearhead the development of a high-performance big data platform.Key responsibilities include designing and implementing distributed components using Big Data technologies.You will also provide technical leadership and manage day-to-day tasks.This opportunity calls for an...

  • Big Data Specialist

    6 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data EngineerOur organization seeks an experienced data engineer to design and implement scalable, high-performance data pipelines using AWS cloud services and Databricks. The ideal candidate will have a strong understanding of big data frameworks, data warehousing, and data modeling.Job Summary:The data engineer will be responsible for designing,...

  • Big Data Expert

    3 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Engineer RoleWe are seeking a highly skilled data professional to join our team.About the Position:The ideal candidate will have experience with big data, scalable architectures, and cloud services.A minimum of 2+ years of experience in the field is required.Key Responsibilities:Design, implement, and deploy large-scale data processing...

  • Big Data Engineer Position

    6 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 22,00,000

    Job Title:Data ArchitectAbout the Role:We are seeking an experienced data architect to design, develop and implement scalable data systems that support real-time and batch data processing.You will collaborate with cross-functional teams to deliver reliable, high-quality data architectures that power analytics, insights and data-driven decision-making.Key...

  • Big Data Systems Specialist

    1 week ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a seasoned Data Engineer to join our team. The ideal candidate will have extensive experience in designing, developing, and deploying large-scale data systems.This role involves working with various big data technologies such as AWS, Python, and PySpark. The successful candidate will be responsible for building robust data...

  • Big Data Architect

    1 week ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Unlock Data Potential as a Databricks Engineer">Design, Develop, and Evolve Data PipelinesDrive Scalable, Secure, and High-Performance Data SolutionsCollaborate with Business Stakeholders to Deliver Actionable InsightsOptimize Data Workflows for Performance, Efficiency, and ReliabilityIntegrate Multiple Data Sources into Delta Lake and Cloud Data...

  • Advanced Big Data Specialist

    7 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionOur organization seeks a seasoned Data Engineer to take on key responsibilities, leveraging technical expertise and data engineering principles.Key Responsibilities:Data Pipeline Development: Design, develop, and maintain batch and streaming data pipelines using PySpark.Big Data Processing: Proficient in using Spark SQL, DataFrame, and RDD...