High-Performance Data Engineer

18 hours ago

Cochin, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

**Data Engineering Opportunity**

We are seeking an experienced Data Engineer to join our team at BrightEdge. As a key member of our data infrastructure team, you will design and build high-performance data pipelines that process massive amounts of data.

**Key Responsibilities:**

  • Design and implement scalable batch processing systems using Python and big data technologies.
  • Optimize database performance focusing on slow-running queries and latency improvements.
  • Use Python profilers and performance monitoring tools to identify bottlenecks.
  • Reduce P95 and P99 latency metrics across our data platform.
  • Build efficient ETL pipelines that can handle large-scale data processing.
  • Collaborate with data scientists and product teams to understand data requirements.
  • Monitor and troubleshoot data pipeline issues in production.
  • Implement data quality checks and validation mechanisms.
  • Document data architecture and engineering processes.
  • Stay current with emerging big data technologies and best practices.

**Required Skills and Qualifications:**

  • Bachelor's degree in Computer Science, Engineering, or related technical field.
  • 4+ years of experience in data engineering roles.
  • Strong Python programming skills with focus on data processing libraries.
  • Experience with big data technologies (Spark, Hadoop, etc.).
  • Proven experience optimizing database performance (SQL or NoSQL).
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.).
  • Understanding of performance optimization techniques and profiling tools.
  • Experience with cloud platforms (AWS, GCP, or Azure).
  • Ability to translate business requirements into technical specifications.

**Benefits:**

  • The opportunity to work on complex data engineering projects.
  • A collaborative and dynamic work environment.
  • The chance to stay up-to-date with emerging big data technologies.

**Preferred Qualifications:**

  • Master's degree in Computer Science or related field.
  • Experience with SEO data or web crawling systems.
  • Experience with Clickhouse Database.
  • Knowledge of distributed systems and microservices architecture.
  • Familiarity with container orchestration (Kubernetes, Docker).
  • Experience with real-time data processing.
  • Contributions to open-source projects.
  • Experience with machine learning operations.

  • High-Performance Data Specialist

    3 days ago

    Cochin, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer JobWe are seeking a Senior Data Engineer to join our team. As a key member of our professional services group, you will be responsible for designing and building high-performance data pipelines that process large amounts of data.Design and implement scalable batch processing systems using Python and big data technologies.Optimize...

  • High Performance Backend Software Engineer

    7 hours ago

    Cochin, Kerala, India beBeeBackend Full time ₹ 15,00,000 - ₹ 20,00,000

    Back End EngineerAbout the RoleWe are seeking a highly skilled software engineer with expertise in Golang and experience in Ruby to contribute to the development and scaling of our high-performance backend systems.Responsibilities:Design and build scalable backend services and APIs using Golang.Collaborate with product managers, frontend engineers, and other...

  • High-Performance Test Engineer

    2 hours ago

    Cochin, Kerala, India beBeePerformance Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: High-Performance Test EngineerThis is a challenging role for an experienced test engineer to plan, design, and execute performance tests. The ideal candidate will have strong technical skills in performance testing tools like LoadRunner, JMeter, and Gatling.Create and enhance test scripts with correlations, parameterization, and custom...

  • High-Performance Software Engineer

    2 hours ago

    Cochin, Kerala, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job SummaryWe are seeking a skilled Backend Developer to join our team.You will be responsible for designing scalable backend systems and microservices, building high-performance RESTful and GraphQL APIs, leveraging modern frameworks like Pydantic and FastAPI for production-ready code, working closely with AI engineers and product teams to integrate LLMs and...

  • High-Performance Software Engineer

    4 days ago

    Cochin, Kerala, India beBeeSoftware Full time ₹ 5,30,00,000 - ₹ 6,50,00,000

    Job Opening: Scala DeveloperWe are seeking an experienced professional to fill a senior backend engineering position. The ideal candidate will be responsible for designing and developing scalable software systems using the Scala programming language.Main Responsibilities:Design, develop, and maintain large-scale Scala applications for high-performance data...

  • High-Performance Test Engineer

    23 hours ago

    Cochin, Kerala, India beBeePerformance Full time ₹ 1,45,11,120 - ₹ 1,83,14,100

    Job DescriptionAbout our organization:We strive for innovation within an open, friendly atmosphere. We drive customers from what's current to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society.Our company operates across several major industry sectors,...

  • High-Performing Enterprise Data Strategist

    2 hours ago

    Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleA high-performing Enterprise Data Architect to lead our client's data strategy and implement scalable solutions.

  • High-Performance Software Developer

    1 day ago

    Cochin, Kerala, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Software Engineering ExpertOur team is seeking an experienced software engineering expert to develop scalable and efficient software applications.The ideal candidate will have a strong understanding of algorithmic complexity, performance optimization, and computational constraints.Key Responsibilities:Design and develop software solutions using Ruby on...

  • High-Performance System Engineer

    2 hours ago

    Cochin, Kerala, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    High-Performance System EngineerWe are dedicated to pushing the boundaries of technology and innovation, striving for excellence in our Mass Customization Platform.The ideal candidate will have a strong background in high-performance system engineering, with experience in designing and implementing scalable, fault-tolerant systems. They will work closely...

  • High-Performance Trading Software Engineer

    7 hours ago

    Cochin, Kerala, India beBeeSoftware Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Senior C++ DeveloperWe are looking for an experienced and skilled software engineer to join our high-performance trading team.This role is responsible for designing, developing, and maintaining low-latency, real-time distributed systems that support our market making, pricing, algorithm trading, position and risk management activities.The ideal candidate...