Senior Big Data Engineer

2 days ago

Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Overview

Seeking a skilled data engineer with expertise in big data processing, cloud analytics, and advanced visualization technologies. The ideal candidate will have hands-on experience with Apache Airflow, Apache Spark, Azure data services, Python programming, and emerging technologies like IoT and AR/VR/MR.

The successful candidate will be responsible for designing, building, and optimizing large-scale data pipelines and delivering insightful analytics solutions. This role requires collaboration with cross-functional teams to gather requirements, optimize pipelines, and ensure high data quality.

Key Responsibilities:

  • Design, develop, and maintain scalable ETL/ELT pipelines using Apache Airflow, Apache Spark, Azure Data Factory, and Databricks.
  • Integrate and manage structured and unstructured data from diverse sources, including Azure Cosmos DB, Azure Data Lake, and Azure Synapse Analytics.
  • Implement IoT data ingestion, processing, and analytics solutions using Azure IoT services.
  • Develop and deploy Python scripts for automation, data transformation, and analytics workflows.
  • Create dashboards, visualizations, and reports to support data-driven decision-making (e.g., Power BI, immersive AR/VR/MR analytics).

Mandatory Skills:

  • Apache Airflow
  • Apache Spark
  • Python
  • Azure Cosmos DB
  • Azure Data Factory
  • Azure IoT
  • Azure Synapse Analytics
  • Azure Data Lake
  • Data bricks
  • AR/VR/MR

Required Experience & Qualifications:

  • 5+ years of experience in data engineering, cloud analytics, or BI development.
  • Strong SQL skills and experience with data modeling.
  • Proficiency in distributed data processing frameworks.
  • Experience working in Microsoft Azure cloud environments.
  • Strong problem-solving skills and ability to work with large-scale datasets.

Preferred Skills:

  • Experience with AI/ML integrations into analytics pipelines.
  • Familiarity with real-time data streaming solutions (Kafka, Event Hubs).
  • Exposure to immersive analytics using AR/VR/MR.

  • Big Data Engineer

    14 hours ago

    Thrissur, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a skilled Big Data Developer to join our team with a dual focus on hands-on project support and mentoring junior engineers.This role is ideal for a developer who not only thrives in a technical environment but is also passionate about coaching and developing the next generation of talent.Key Responsibilities:Perform hands-on Big...

  • Big Data Engineering Lead

    2 weeks ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Scientist - Big Data EngineerWe are looking for a seasoned professional to lead our data engineering initiatives. As a key member of the team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Design and develop scalable data pipelines using Python, PySpark, and AWS services.Collaborate with...

  • Big Data Architect

    1 week ago

    Thrissur, Kerala, India beBeeData Full time ₹ 17,57,300 - ₹ 24,32,900

    Job Title: Advanced Data Solution ArchitectThis is a high-profile role responsible for designing and implementing sophisticated big data architectures and systems.Key Responsibilities:Design, develop, and deploy scalable and efficient big data platforms using cutting-edge tools and technologiesDevelop and implement ETL processes to extract valuable insights...

  • Big Data Expert

    2 days ago

    Thrissur, Kerala, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a highly skilled professional with deep expertise in Big Data technologies and AWS Cloud Services. The ideal candidate will bring strong hands-on experience in designing, architecting, and implementing scalable data engineering solutions while driving innovation.Design, develop, and optimize Big Data architectures leveraging AWS services for...

  • Big Data Engineering Specialist

    1 week ago

    Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking an experienced Big Data Engineer to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, as well as hands-on experience in distributed data systems and cloud-based solutions.Key Responsibilities:Design, develop, and optimize large-scale data...

  • Senior Big Data Technology Expert

    2 days ago

    Thrissur, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Lead Aws Data EngineerWe are seeking a highly skilled and experienced Data Engineering Lead to join our team. The successful candidate will be responsible for leading the design, development, and implementation of large-scale data processing systems.The ideal candidate will have a strong background in data engineering, with experience in working...

  • Expert Big Data Leader

    17 hours ago

    Thrissur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Platform ArchitectAs a seasoned Senior Data Platform Architect, you will be responsible for designing and delivering high-performing, scalable data platforms that meet the evolving needs of our business.This is an excellent opportunity to leverage your expertise in cloud technologies, microservices, and big data to drive innovation and...

  • Big Data Specialist

    1 week ago

    Thrissur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data SpecialistWe are seeking a skilled big data professional to fill this role. As a big data specialist, you will be responsible for designing and implementing large-scale data processing systems using big data technologies such as Hadoop and Spark.Key Responsibilities:Design and develop scalable data processing architectures using PySpark...

  • Big Data Specialist

    2 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Big Data SpecialistThe position of Big Data Specialist involves designing, developing, and maintaining large-scale data pipelines using Python, PySpark, and SQL.Key Responsibilities include:Designing scalable data architectures to process complex datasets.Developing and implementing efficient ETL processes to extract insights from structured and unstructured...

  • Big Data Professional

    14 hours ago

    Thrissur, Kerala, India beBeeAdministration Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a skilled Big Data Administrator to join our team. As a key member of our data management team, you will be responsible for designing, implementing, and maintaining large-scale big data platforms.About the Role:The ideal candidate will have hands-on experience with Hadoop, Hive, HBase, and other big data components. They should...