Big Data Engineering Specialist

3 days ago

Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000
Job Overview

We are seeking an experienced Big Data Engineer to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, as well as hands-on experience in distributed data systems and cloud-based solutions.

Key Responsibilities:

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Contribute to product development with a focus on scalability, maintainability, and performance.
Mandatory Skills and Qualifications

To be successful in this role, you must possess the following skills and qualifications:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.
Preferred Skills and Qualifications

The following skills and qualifications are highly desirable:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Big Data Specialist

    2 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data SpecialistWe are seeking a skilled big data professional to fill this role. As a big data specialist, you will be responsible for designing and implementing large-scale data processing systems using big data technologies such as Hadoop and Spark.Key Responsibilities:Design and develop scalable data processing architectures using PySpark...

  • Big Data Engineering Lead

    4 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Scientist - Big Data EngineerWe are looking for a seasoned professional to lead our data engineering initiatives. As a key member of the team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Design and develop scalable data pipelines using Python, PySpark, and AWS services.Collaborate with...

  • Big Data Architect

    2 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 17,57,300 - ₹ 24,32,900

    Job Title: Advanced Data Solution ArchitectThis is a high-profile role responsible for designing and implementing sophisticated big data architectures and systems.Key Responsibilities:Design, develop, and deploy scalable and efficient big data platforms using cutting-edge tools and technologiesDevelop and implement ETL processes to extract valuable insights...

  • Data Engineering Specialist

    5 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 17,50,000

    About this role\This is a key position in our organization that focuses on data engineering and architecture. We are looking for an experienced professional to join our team and contribute to the development of innovative solutions using big data, cloud-based technologies, and advanced analytics.\

  • Senior Data Engineering Specialist

    4 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    Job Title:Data Engineering ExpertJob Description:We are seeking a skilled Data Engineer with expertise in Telemetry, Big Data and backend engineering to help implement an application for a leading retailer.Key Responsibilities:Developing and maintaining large-scale data processing systemsDesigning and implementing data pipelines and workflowsCollaborating...

  • Sr Big Data Developer

    2 weeks ago

    Thrissur, Kerala, India IQVIA Full time

    Job Role: Sr Big Data Developer Years of Experience: 4 to 8 years Job Location: Bangalore Work Mode: Hybrid Must Have Skills: Bigdata Developer, Spark & Scala/Java/Python Experience and Skills: Strong experience with big data technologies and associated tools such as Hadoop, Unix, HDFS, Hive, Impala, etc. Proficient in using Spark &...

  • Data Engineer Specialist

    7 days ago

    Thrissur, Kerala, India beBeeData Full time

    Senior Data Solutions ArchitectKey Responsibilities:Design, develop, and maintain scalable, secure, and high-performance data pipelines on Databricks.Lead the architecture and implementation of data solutions that integrate multiple structured and unstructured sources into Delta Lake and cloud data warehouses.Collaborate with stakeholders to deliver...

  • Data Operations Specialist

    3 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Data Operations SpecialistThe Technical Business Analyst role is a key position within the organization, supporting critical operations across process improvement, data platform engineering, and automation. This role contributes to the customer's strategic vision of expanding EDP data entitlement.Main Responsibilities:Process Improvement &...

  • Senior Big Data Project Lead

    2 days ago

    Thrissur, Kerala, India beBeeTechnicalProjectManagement Full time US$ 1,00,000 - US$ 1,50,000

    **Job Opportunity:** Technical Project ManagerLocation: Remote ContractThe role of the Technical Project Manager is to lead and manage large-scale projects within big data and analytics environments, particularly on Databricks. The successful candidate will have strong expertise in managing complex technical projects, ensuring timely delivery, scope...

  • High-Performance Data Engineer

    2 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking an experienced Data Engineer to design and implement high-performance data pipelines. Our ideal candidate will have a strong background in big data technologies, Python programming skills, and experience with database performance optimization.Key ResponsibilitiesDesign and implement scalable batch processing systems using big...