High Performance Data Engineer

1 day ago

Alleppey, Kerala, India beBeeData Full time US$ 90,000 - US$ 1,20,000

About BrightEdge, we're looking for a talented Big Data Engineer to help us scale and optimize our data processing capabilities.

As a Big Data Engineer at BrightEdge, you will design, build, and maintain high-performance data pipelines that process terabytes of data. You'll work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.

Data Engineering Role
  • We're seeking a professional with expertise in designing and implementing scalable batch processing systems using Python and big data technologies.
  • You'll be responsible for optimizing database performance, focusing on slow-running queries and latency improvements.
  • Using Python profilers and performance monitoring tools, you'll identify bottlenecks and implement solutions to reduce P95 and P99 latency metrics across our data platform.
  • You'll design and develop efficient ETL pipelines that can handle large-scale data processing.
  • Collaborating with data scientists and product teams, you'll understand data requirements and implement data quality checks and validation mechanisms.
  • You'll monitor and troubleshoot data pipeline issues in production and document data architecture and engineering processes.
Qualifications
  • Bachelor's degree in Computer Science, Engineering, or related technical field.
  • 4+ years of experience in data engineering roles.
  • Strong Python programming skills with focus on data processing libraries.
  • Experience with big data technologies (Spark, Hadoop, etc.).
  • Proven experience optimizing database performance (SQL or NoSQL).
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.).
  • Understanding of performance optimization techniques and profiling tools.
  • Experience with cloud platforms (AWS, GCP, or Azure).
  • Ability to translate business requirements into technical specifications.
  • Ability to work in UK timezone (12 PM IST to 9:30 PM IST).
Preferred Qualifications
  • Master's degree in Computer Science or related field.
  • Experience with SEO data or web crawling systems.
  • Experience with Clickhouse Database.
  • Knowledge of distributed systems and microservices architecture.
  • Familiarity with container orchestration (Kubernetes, Docker).
  • Experience with real-time data processing.
  • Contributions to open-source projects.
Skills and Abilities
  • Strong analytical thinking and problem-solving skills.
  • Excellent attention to detail and commitment to data quality.
  • Ability to work effectively in a collaborative team environment.
  • Good communication skills to explain complex technical concepts.
  • Self-motivated with the ability to work independently.
  • Possession for performance optimization and efficiency.

  • High-Performance Data Engineer

    4 days ago

    Alleppey, Kerala, India beBeeData Full time ₹ 14,35,200 - ₹ 21,66,400

    Job Title:Senior Data Engineer">">Job Description: We are seeking a skilled and experienced Senior Data Engineer to design and implement high-performance data pipelines that process massive amounts of data.The ideal candidate will have a strong background in data engineering, experience working with big data technologies such as Spark and Hadoop, and be...

  • High-Performance Data Architect

    4 days ago

    Alleppey, Kerala, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000

    Senior Data Engineer Position OverviewWe are seeking an experienced Data Pipeline Architect with expertise in cloud-based data engineering to lead the design and development of high-performance data pipelines.This role involves building, maintaining, and optimizing large-scale data environments on AWS using Databricks for advanced analytics and machine...

  • High-Performance Data Specialist

    3 days ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Senior Data EngineerThe Mastermind Group is seeking an experienced Data Engineer to join our product development team.We're building the infrastructure that powers enterprise transformation across telecom and IT Asset Management environments.You'll design robust pipelines, build scalable solutions, and drive data-driven outcomes for clients.Your...

  • High Performance QA Engineer

    5 days ago

    Alleppey, Kerala, India beBeeQAEngineer Full time ₹ 25,00,000 - ₹ 30,00,000

    Job OverviewWe are seeking a highly skilled and detail-oriented QA Engineer to join our dynamic team. The ideal candidate will be responsible for ensuring the quality, reliability, and performance of our trading platforms and financial applications through comprehensive testing strategies and automation frameworks.The successful candidate will work closely...

  • High-Performance Computing Engineer

    4 days ago

    Alleppey, Kerala, India beBeeGpu Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    GPU Development ExpertWe are seeking a highly skilled GPU development expert to spearhead the creation of cutting-edge, high-performance computing solutions. In this role, you will be responsible for developing and optimizing GPU-accelerated software components using industry-standard frameworks such as CUDA, HIP, or OpenCL.Key Responsibilities:Design,...

  • High-Performance Software Engineer

    20 hours ago

    Alleppey, Kerala, India beBeeSoftware Full time ₹ 6,00,000 - ₹ 12,00,000

    Seeking an experienced software engineer to join our team.We are looking for a professional with strong background in MuleSoft integration and API design.Key Responsibilities:Develop and implement MuleSoft applications using cutting-edge technologies.Work collaboratively with development teams to ensure seamless integration with existing systems.Maintain and...

  • High-Performance Storage Solutions Validator

    19 hours ago

    Alleppey, Kerala, India beBeeInfrastructure Full time ₹ 80,00,000 - ₹ 1,50,00,000

    AI Infrastructure ProfessionalThis is a unique opportunity to work with a leading organization that has pioneered AI and high-performance data storage innovation for over two decades.The company powers many of the world's most demanding AI data centers, serving various industries including life sciences, healthcare, financial services, autonomous vehicles,...

  • High-Performance Application Tester

    1 day ago

    Alleppey, Kerala, India beBeePerformance Full time ₹ 10,00,000 - ₹ 20,00,000

    About this roleWe are seeking a skilled Performance Test Engineer to optimize the performance of our applications. This is an exciting opportunity for someone who is passionate about delivering high-quality software solutions.Minimum 3-5.5 years of experience in Performance testing with good hands-on knowledge of scripting using tool JMeter.Well-versed in...

  • High-Performance System Architect

    4 days ago

    Alleppey, Kerala, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Design and Implement Scalable Backend ServicesJoin a high-performing team as a senior backend engineer where you will design and implement scalable backend services for our platform core services and infrastructure.This role is perfect for someone who thrives on building high-performance systems, empowering cross-functional teams through reliable backend...

  • High-Performance Web Developer

    1 day ago

    Alleppey, Kerala, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Web Engineer OpportunityAs a skilled Web Engineer, you will play a pivotal role in building high-performance and scalable web applications for millions of users.This position involves collaborating with cross-functional teams to deliver seamless user experiences and owning the end-to-end delivery process from technical design to deployment and monitoring.