Advanced Data Processing Specialist

7 days ago

Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000
Job Title: Big Data Engineer

We are seeking a highly skilled Big Data Engineer with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team.

The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.

Key Responsibilities:

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi/Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Contribute to product development with a focus on scalability, maintainability, and performance.
Mandatory Skills:
  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi/Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.
Preferred Skills:
  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Senior Data Integration Specialist

    7 days ago

    Davangere, Karnataka, India beBeeDataIntegration Full time ₹ 39,69,000 - ₹ 44,10,000

    Job Overview">As a senior data integration specialist, you will play a pivotal role in designing and implementing efficient data workflows that drive business value.">This is an exciting opportunity to leverage your expertise in automation tools like Autosys/Oracle Scheduler/Airflow, scripting languages (Python/Shell/PowerShell), and ETL tools...

  • Data Insights Specialist

    3 days ago

    Davangere, Karnataka, India beBeeData Full time ₹ 5,00,000 - ₹ 10,00,000

    Become a Data Insight SpecialistWe are looking for a talented and motivated individual to join our team as a Data Insight Specialist. In this role, you will have the opportunity to design and implement an organization-wide data collection system, ensuring information accuracy and reliability, and establishing standardized reporting formats.Key...

  • Data Insights Specialist

    1 week ago

    Davangere, Karnataka, India beBeeDataAnalyst Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job Summary:Data Insights SpecialistWe are seeking a skilled professional to join our team as a Data Insights Specialist.The ideal candidate will possess strong analytical skills, effective communication skills, and the ability to work independently with strong domain knowledge.Key Responsibilities include:Gathering project requirements,...

  • Advanced Excel Training Specialist

    7 days ago

    Davangere, Karnataka, India beBeeExcel Full time ₹ 5,00,000 - ₹ 10,00,000

    Job TitleAdvanced Excel Training SpecialistJob Description:The primary responsibility of the Advanced Excel Training Specialist will be to develop and deliver comprehensive training programs for students.Key areas of focus include imparting in-depth knowledge of Microsoft Excel, creating engaging learning experiences, and ensuring standard outcomes across...

  • Radar Signal Processing Specialist

    7 days ago

    Davangere, Karnataka, India beBeeSignalProcessing Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Radar Signal Processing SpecialistOur team is seeking a skilled Radar Signal Processing Specialist to design, develop, and implement advanced signal processing algorithms. As an expert in this field, you will be responsible for leading the development of radar systems for defense, aerospace, and communication applications.Key Responsibilities:Design and...

  • Expertise in Advanced Excel and Quality Assurance

    1 week ago

    Davangere, Karnataka, India beBeeDataMigration Full time ₹ 6,00,000 - ₹ 12,00,000

    Job Description:We are seeking an experienced Data Migration Specialist with a strong background in Excel, Quality Assurance (QA) testing, and accountancy. The ideal candidate will be highly proficient in Excel for data analysis and transformation, have strong English communication skills, solid mathematical abilities, and experience with accounting or...

  • Advanced Time Tracking Specialist

    4 days ago

    Davangere, Karnataka, India beBeeTimeTracking Full time ₹ 8,00,000 - ₹ 12,00,000

    Expert Time Tracking SpecialistWe seek an experienced time tracking specialist to play a key role in the implementation, configuration, and support of advanced time tracking solutions.Contribute to planning, organization, and governance setup within project frameworks.Deliver workshops to identify, analyze, and specify time tracking requirements.Develop...

  • Advanced Analytics Specialist

    1 week ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job Title:Senior Data EngineerWe are looking for an experienced Senior Data Engineer to design, construct and optimize large-scale data processing systems that enable advanced analytics and business intelligence.The ideal candidate will have 5+ years of experience in data engineering or related fields, with a focus on large-scale data systems.In this role,...

  • Advanced Data Quality Specialist

    10 hours ago

    Davangere, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Unlock a world of innovation and excellence as a Senior Manager, leading comprehensive testing strategies for complex data engineering pipelines and product delivery initiatives.Drive quality assurance across integrated systems, data workflows, and customer-facing applications while coordinating cross-functional testing efforts.Key Responsibilities:Test...

  • Data Annotation Specialist

    3 days ago

    Davangere, Karnataka, India beBeeProficiency Full time ₹ 30,49,850 - ₹ 50,14,787

    Job Title: Data Annotation SpecialistWe are seeking a skilled and detail-oriented individual to join our team as a Data Annotation Specialist. In this role, you will play a critical part in assisting our technology team on global projects.Job DescriptionAs a Data Annotation Specialist, you will be responsible for annotating and labeling data according to...