High-Performance Data Engineer

17 hours ago

Kottayam, Kerala, India beBeeData Full time US$ 1,40,000 - US$ 1,80,000
Senior Data Engineer

We are seeking a talented and skilled Senior Data Engineer to join our team. As a key member of the engineering team, you will be responsible for designing, building, and maintaining high-performance data pipelines that process large volumes of data.

The ideal candidate will have strong Python programming skills with a focus on data processing libraries, experience with big data technologies, and proven experience optimizing database performance.

Key Responsibilities:

  • Design and implement scalable batch processing systems using Python and big data technologies.
  • Optimize database performance, focusing on slow-running queries and latency improvements.
  • Use Python profilers and performance monitoring tools to identify bottlenecks.
  • Reduce P95 and P99 latency metrics across our data platform.
  • Build efficient ETL pipelines that can handle large-scale data processing.
  • Collaborate with data scientists and product teams to understand data requirements.
  • Monitor and troubleshoot data pipeline issues in production.
  • Implement data quality checks and validation mechanisms.
  • Document data architecture and engineering processes.

Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or related technical field.
  • 4+ years of experience in data engineering roles.
  • Strong Python programming skills with focus on data processing libraries.
  • Experience with big data technologies (Spark, Hadoop, etc.).
  • Proven experience optimizing database performance (SQL or NoSQL).
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.).

Preferred Qualifications:

  • Master's degree in Computer Science or related field.
  • Experience with SEO data or web crawling systems.
  • Experience with Clickhouse Database.
  • Knowledge of distributed systems and microservices architecture.
  • Familiarity with container orchestration (Kubernetes, Docker).

Skills and Abilities:

  • Strong analytical thinking and problem-solving skills.
  • Excellent attention to detail and commitment to data quality.
  • Ability to work effectively in a collaborative team environment.
  • Good communication skills to explain complex technical concepts.
  • Self-motivated with the ability to work independently.

  • High-Performance Data Systems Engineer

    5 days ago

    Kottayam, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    As a seasoned data professional, you have the opportunity to craft large-scale data pipelines using SQL, Python, and PySpark.Key Responsibilities:Develop high-performance data systems that seamlessly integrate with cross-functional teamsCollaborate with experienced engineers to drive innovative data solutionsRequirements:At least 5 years of experience in...

  • High-Performance System Designer

    1 day ago

    Kottayam, Kerala, India beBeeSystem Full time ₹ 1,25,08,000 - ₹ 1,75,46,000

    Our organization is dedicated to empowering governments to transform the healthcare sector and ensure that high-quality services are accessible to all.We are at the forefront of bringing healthcare into the digital age with cutting-edge platforms, creating an integrated ecosystem for all stakeholders in the industry.About the RoleThe System Design Manager...

  • High Performance Diesel Engine Professional

    7 days ago

    Kottayam, Kerala, India beBeeDieselEngineMechanic Full time ₹ 3,00,000 - ₹ 3,60,000

    Job Title: Diesel Engine MechanicWe are seeking a skilled diesel engine professional to perform maintenance, repairs and troubleshooting of diesel generators and related systems.Responsibilities:Conduct routine maintenance and repair tasks on diesel generators and associated equipmentUndertake site visits to diagnose and resolve mechanical issuesMaintain...

  • High Performance Computing Professional

    1 week ago

    Kottayam, Kerala, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: High Performance Computing ProfessionalAbout the RoleWe are seeking an experienced High Performance Computing Professional to join our team. In this role, you will be responsible for ensuring the reliability and scalability of our systems, with a focus on technical support and engineering in AI/ML environments.Key Responsibilities:Develop and...

  • High-Performance Backend Developer Wanted

    1 week ago

    Kottayam, Kerala, India beBeeBackend Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Backend Developer OpportunityAs a seasoned backend developer, you will design and develop high-performance applications, services, and APIs. With expertise in Java, database architecture, data analytics, and AI/ML integration, you will drive architectural decisions, mentor team members, and deliver scalable, data-driven solutions leveraging...

  • High Performance Testing Specialist

    1 week ago

    Kottayam, Kerala, India beBeePerformance Full time ₹ 15,00,000 - ₹ 25,00,000

    About our company:We are a global leader in software development, consulting, and business process services with a presence in 60+ countries.Job Title: Performance TesterRole Summary:Bachelor's degree in Computer Science, Engineering, or related technical field required.3 years of experience as a Performance Engineer or equivalent experience in high-traffic,...

  • High-Performance C++ Software Engineer Wanted

    1 week ago

    Kottayam, Kerala, India beBeeHighPerformanceDeveloper Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior C++ Developer PositionWe are seeking a skilled Software Engineer to join our high-performance eTrading team.Job Responsibilities:Design, develop, and maintain real-time distributed applications for pricing/risk/algo/market making framework, integration with analytical library, eTrading platform for connectivity and execution, ticker plant and trade...

  • High-Performance Tester

    1 day ago

    Kottayam, Kerala, India beBeePerformance Full time ₹ 12,00,000 - ₹ 16,00,000

    Performance Testing Expert">We are seeking a skilled Performance Test Engineer to join our team. The ideal candidate should have strong expertise in JMeter and performance testing practices, along with solid analytical and problem-solving skills.Key Responsibilities:Design, develop, and execute performance test scripts using JMeter.Analyze test results to...

  • High-Performance Machine Learning Engineer

    2 days ago

    Kottayam, Kerala, India beBeeMachineLearning Full time ₹ 25,00,000 - ₹ 48,00,000

    Work with researchers to develop high-performance software addressing novel machine learning algorithms.RequirementsExpertise in Python programming and tensor operations, including NumPy 100.Proficiency in at least one ML framework (PyTorch or TensorFlow).Hands-on experience with ML benchmarks, data, models, and metrics.Experience with collaborative software...

  • High-Performance Backend Software Developer

    5 days ago

    Kottayam, Kerala, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking an experienced Full Stack Engineer to join our project and develop high-quality server-side applications and APIs.About the Role:Design scalable, secure, and high-performance backend services & APIsImplement server-side logic, databases & data storage solutionsOptimize database schemas, queries & indexes for efficiencyDiagnose & resolve...