High-Performance Data Processing Specialist

3 days ago

Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000
Big Data Engineer Job Description

We are seeking a skilled Big Data Engineer to design, build, and maintain high-performance data pipelines that process massive amounts of data.

The successful candidate will have experience with big data technologies, such as Spark and Hadoop, and a strong understanding of database performance optimization.

Key Responsibilities:
  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance, focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing
Requirements:
  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
Benefits:
  • Collaborative team environment
  • Opportunities for professional growth and development
  • Recognition and reward for outstanding performance
Preferred Qualifications:
  • Master's degree in Computer Science or related field
  • Experience with SEO data or web crawling systems
  • Experience with Clickhouse Database
Skills and Abilities:
  • Strong analytical thinking and problem-solving skills
  • Excellent attention to detail and commitment to data quality
  • Ability to work effectively in a collaborative team environment
  • Good communication skills to explain complex technical concepts

  • High-Performance Data Architect

    1 day ago

    Mangalore, Karnataka, India beBeeDatabricksEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    The role of a Senior Databricks Data Engineer is to design, develop and maintain high-performance data pipelines using scalable technologies like Databricks and PySpark.We are looking for an experienced professional with strong hands-on experience in Databricks and cloud-based services.The ideal candidate will have expertise in distributed data processing...

  • High-Performance Data Specialist

    2 hours ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data EngineerWe are seeking a highly skilled data engineer to join our team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that handle high-volume financial data.Key Responsibilities:Design, develop, and manage end-to-end data pipelines for stocks, crypto, and other financial datasets.Integrate...

  • High-Performance Data Specialist

    3 days ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering Role OverviewWe are seeking a highly skilled professional with 4+ years of experience as an Azure Data Engineer, possessing strong expertise in Python, Scala, Spark (PySpark & Scala Spark), and Azure Cloud technologies.

  • High-Performance Database Specialist

    13 hours ago

    Mangalore, Karnataka, India beBeeDatabase Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Oracle Database AdministratorWe are seeking a skilled Oracle Database professional to oversee the design, implementation, and maintenance of high-performance database systems.Main Responsibilities:• Performance Optimization & Tuning: Identify and resolve database bottlenecks impacting application/API performance.• Application & Middleware...

  • High-Performance Tester

    2 hours ago

    Mangalore, Karnataka, India beBeePerformance Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Performance Testing EngineerAbout Our Company:We are a global digital solutions and technology consulting company. We balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation.We guide customers from what's now to what's next by unlocking the value of their data and...

  • High-Performance Cloud Architect

    14 hours ago

    Mangalore, Karnataka, India beBeeDevOps Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Architect & DevOps SpecialistJob DescriptionWe are seeking an experienced Cloud Architect and DevOps Specialist to join our team. The ideal candidate will have a strong background in designing and implementing scalable, secure, and highly available cloud-based systems.The successful candidate will be responsible for:Designing and deploying cloud-based...

  • High-Performance Software Engineer

    1 day ago

    Mangalore, Karnataka, India beBeeJavaScript Full time ₹ 30,00,000 - ₹ 40,00,000

    About Us:Job Title: Senior JavaScript DeveloperWe are seeking an experienced Senior JavaScript Developer to join our team. This role will involve designing and implementing complex software systems using algorithmic coding skills.Key Responsibilities:Software Development: Design, implement, and deploy high-quality software systems that meet customer...

  • Intelligent Document Processing Specialist

    6 days ago

    Mangalore, Karnataka, India beBeeidp Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Intelligent Document Processing SpecialistWe are seeking a highly skilled and experienced Intelligent Document Processing Specialist to join our team. As an IDP Specialist, you will play a key role in developing and implementing intelligent document processing solutions that automate data extraction from semi-structured and unstructured...

  • High Performance Backend Developer

    3 days ago

    Mangalore, Karnataka, India beBeeBackend Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    About the RoleWe are seeking a talented Backend Developer to join our core team. As a key member, you will design and develop high-performance backend systems using Node.js and TypeScript.Your primary responsibilities will include:Designing, building, and maintaining robust backend services.Developing and optimizing real-time communication systems leveraging...

  • Design High-Performance AI Architectures

    2 hours ago

    Mangalore, Karnataka, India beBeeAccelerator Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: High-Performance AI Accelerator DesignerWe are seeking an experienced designer to contribute to the development of next-generation AI accelerators from scratch. In this role, you will collaborate with cross-functional teams to define and implement high-performance AI architectures.Key Responsibilities:Design and implement high-performance...