High-Performance Data Engineer

2 days ago

Thrissur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Description

We are seeking an experienced Data Engineer to design and implement high-performance data pipelines. Our ideal candidate will have a strong background in big data technologies, Python programming skills, and experience with database performance optimization.

Key Responsibilities

  • Design and implement scalable batch processing systems using big data technologies
  • Optimize database performance focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing
  • Collaborate with data scientists and product teams to understand data requirements
  • Monitor and troubleshoot data pipeline issues in production
  • Implement data quality checks and validation mechanisms
  • Document data architecture and engineering processes

Required Skills and Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)
  • Understanding of performance optimization techniques and profiling tools
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Ability to translate business requirements into technical specifications

Benefits

  • Opportunity to work with a talented team of engineers
  • Chance to learn new technologies and best practices
  • Competitive compensation package

Others

  • Familiarity with container orchestration (Kubernetes, Docker) is a plus
  • Contributions to open-source projects are valued

  • High-Performance Data Engineer

    12 hours ago

    Thrissur, Kerala, India beBeeDataDriven Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionWe are seeking a seasoned data engineer to design and implement cutting-edge intelligence infrastructure for enterprise transformation in complex telecom and ITAM environments.The RoleYou will be responsible for developing robust ETL pipelines, building scalable BI solutions, and driving data-powered outcomes that enhance client...

  • High-Performance Data Architect

    3 days ago

    Thrissur, Kerala, India beBeeDatabricks Full time ₹ 25,00,000 - ₹ 27,00,000

    Senior Databricks Data EngineerOur organization seeks a Senior Databricks Data Engineer with hands-on experience in Databricks and AWS to manage our data engineering team's infrastructure and applications.Key Responsibilities:Design, develop, and maintain scalable and high-performance data pipelines using Databricks and PySpark.Implement and manage data...

  • High-Performance Data Pipeline Architect

    5 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    We're seeking a highly skilled Big Data Engineer to help us scale and optimize our data processing capabilities.As a key member of our team, you'll design, build, and maintain high-performance data pipelines that process terabytes of data. Your focus will be on optimizing existing systems, identifying performance bottlenecks, and implementing solutions to...

  • High-Performance Observability Engineer

    6 days ago

    Thrissur, Kerala, India beBeeElkexpert Full time ₹ 25,00,000 - ₹ 35,00,000

    Observability Expert SoughtWe are looking for an experienced Observability Expert to lead our observability strategy and drive the implementation of large-scale observability infrastructure.Main Responsibilities:Design and manage high-volume ELK clusters ingesting terabytes of data dailyEnhance reliability across distributed systemsDrive automation within...

  • High-Performance Data Solutions Specialist

    7 days ago

    Thrissur, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Seeking an experienced Data Engineer to lead the design and implementation of robust data solutions on Microsoft Fabric and Azure platforms.About the Role:Collaborate with stakeholders to architect technical solutions that meet business objectivesDevelop end-to-end data pipelines using Microsoft Fabric and Azure servicesDesign and optimize data lake zones...

  • High-Performance Data Storage Innovation Specialist

    1 hour ago

    Thrissur, Kerala, India beBeeData Full time ₹ 70,00,000 - ₹ 1,30,00,000

    Job OpportunityThis role offers the chance to contribute to a pioneering company in AI and high-performance data storage innovation.Key ResponsibilitiesDesign automated and manual test cases to validate product featuresRun tests as needed to verify product defect fixes and functionalityCollaborate with Engineering managers and distributed teams to understand...

  • High-Touch Senior Data Engineer

    3 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    As a seasoned professional, we are seeking a highly skilled Senior Data Engineer to join our team. This individual will be responsible for designing and implementing high-quality, secure, and scalable data pipelines and systems that power reporting, analytics, and operational use cases.Key Responsibilities:Data Pipeline DesignWrite and optimize complex SQL...

  • High-Performance AI Specialist

    13 minutes ago

    Thrissur, Kerala, India beBeeArtificialintelligence Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Generative AI EngineerBigRio is a technology consulting firm that specializes in advanced data and software solutions. We partner with forward-thinking organizations to deliver scalable, cost-effective, and innovative technology.We are seeking a highly skilled Generative AI Specialist with expert-level experience in LLMs, OpenAI APIs, prompt...

  • High-Performing Performance Tester

    1 day ago

    Thrissur, Kerala, India beBeePerformance Full time ₹ 20,00,000 - ₹ 35,00,000

    Job DescriptionWe are seeking a highly skilled Performance Test Engineer to join our organization. The ideal candidate will possess strong analytical and problem-solving skills, with the ability to work in a fast-paced Agile environment.This role involves designing, implementing, and maintaining automated performance tests, identifying and troubleshooting...

  • High-Performance Java Software Engineer

    2 days ago

    Thrissur, Kerala, India beBeeSenior Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    We are seeking a highly experienced and skilled Senior Java Developer to join our Development Team.Job OverviewThis is an on-site role that requires working in the office 5 days a week. We prefer candidates who can start immediately, with a focus on delivering high-quality solutions.The successful candidate will have at least 8 years of experience as a...