High-Performance Data Engineer Position

3 days ago

Kolkata, West Bengal, India beBeeData Full time ₹ 1,62,87,736 - ₹ 2,03,09,871

Big Data Engineer Role Overview

We're seeking a talented Big Data Engineer to join our team to help us scale and optimize our data processing capabilities.

The ideal candidate will have strong analytical thinking and problem-solving skills, excellent attention to detail, and the ability to work effectively in a collaborative environment.

Key Responsibilities:

  • Design and implement scalable batch processing systems using Python and big data technologies.
  • Optimize database performance, focusing on slow-running queries and latency improvements.
  • Use Python profilers and performance monitoring tools to identify bottlenecks.
  • Reduce P95 and P99 latency metrics across our data platform.
  • Build efficient ETL pipelines that can handle large-scale data processing.
  • Collaborate with data scientists and product teams to understand data requirements.
  • Monitor and troubleshoot data pipeline issues in production.
  • Implement data quality checks and validation mechanisms.
  • Document data architecture and engineering processes.
  • Stay current with emerging big data technologies and best practices.

Required Skills and Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or related technical field.
  • 4+ years of experience in data engineering roles.
  • Strong Python programming skills with focus on data processing libraries.
  • Experience with big data technologies (Spark, Hadoop, etc.).
  • Proven experience optimizing database performance (SQL or NoSQL).
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.).
  • Understanding of performance optimization techniques and profiling tools.
  • Experience with cloud platforms (AWS, GCP, or Azure).
  • Ability to translate business requirements into technical specifications.
  • Ability to work in flexible hours.

Preferred Skills and Qualifications:

  • Master's degree in Computer Science or related field.
  • Experience with SEO data or web crawling systems.
  • Experience with Clickhouse Database.
  • Knowledge of distributed systems and microservices architecture.
  • Familiarity with container orchestration (Kubernetes, Docker).
  • Experience with real-time data processing.
  • Contributions to open-source projects.
  • Experience with machine learning operations.

  • High Performing System Engineer

    16 hours ago

    Kolkata, West Bengal, India beBeeSite Full time ₹ 1,00,00,000 - ₹ 1,75,00,000

    Senior Reliability Engineering ManagerWe are seeking an experienced and dynamic individual to oversee the reliability, scalability, and performance of our critical systems.This role combines software engineering and systems engineering expertise to build and maintain high-performing, reliable systems.Reliability & PerformanceMaintain high availability and...

  • High-Performance Systems Engineer

    1 day ago

    Kolkata, West Bengal, India beBeePerformanceEngineer Full time ₹ 15,00,000 - ₹ 21,00,000

    Job DescriptionWe are looking for a performance engineer to join our team. This role provides opportunities to work on the development and application of performance/scalability benchmarks, and to characterize, debug, and improve system performance and scalability.Develop and apply performance/scalability benchmarks.Work in cross-functional teams to identify...

  • High-Performance Software Engineer

    15 hours ago

    Kolkata, West Bengal, India beBeeBackend Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Senior Backend DeveloperAbout Us:We deliver inspiring solutions and experiences that create value for our Partners and Society at large.We cater to a wide range of customer needs in collaboration with trusted suppliers, powered by destinations experts.About the Business / Function:We are a multinational technology support company serving as a...

  • High-Performance Backend Engineer Wanted

    1 day ago

    Kolkata, West Bengal, India beBeeBackend Full time ₹ 20,00,000 - ₹ 25,00,000

    Backend Developer PositionWe're seeking a skilled Backend Engineer to join our team and contribute to the development of scalable, reliable, and high-performance backend services.The successful candidate will work closely with our engineering and product teams to design, develop, and maintain core backend systems that power our applications.Key...

  • High-Performance Database Specialist

    14 hours ago

    Kolkata, West Bengal, India beBeeSQL Full time ₹ 15,00,000 - ₹ 20,00,000

    Database Developer OpportunityWe are seeking an experienced professional to join our team in the capacity of Database Developer. The successful candidate will have a strong proficiency in SQL and experience in software engineering, algorithm design, or systems-level programming.Key Responsibilities:Design and develop complex algorithms using SQL and other...

  • High-Performance Database Administrator

    1 day ago

    Kolkata, West Bengal, India beBeeDatabase Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking a highly skilled and experienced professional to design, implement, and maintain high-performance databases.Key Responsibilities:Azure SQL (IaaS/PaaS) deployments and migrationsT-SQL, PowerShell scripting, and SQL Server automation tasksThe selected candidate will be responsible for ensuring data integrity and security. Strong communication...

  • High-Performing Marketing Leader

    2 days ago

    Kolkata, West Bengal, India beBeeMarketing Full time ₹ 45,00,000 - ₹ 75,00,000

    Job Opening:Performance Marketing StrategistWe are seeking a seasoned marketing professional to lead our performance marketing efforts.Main Responsibilities:Develop and execute comprehensive performance marketing strategies that drive business growth and revenue.Manage, mentor, and grow a team of media buyers and specialists, providing guidance on best...

  • High-Profile Performance Testing Position

    1 week ago

    Kolkata, West Bengal, India beBeePerformance Full time

    Job Title: Performance TesterThis is an exciting opportunity to join our team as a Performance Tester. As a Performance Tester, you will be responsible for designing, developing and executing performance test scripts and scenarios based on expected user load and business needs.Key Responsibilities:Take ownership of performance testing activities for Oracle...

  • Senior Data Engineer Position

    1 day ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Description:We seek a seasoned data engineer with expertise in designing and maintaining large-scale data processing systems.The ideal candidate will have extensive knowledge of Azure Data Factory, Data Bricks, MS Synapse, and Python programming languages.Design and develop large-scale data processing systems using Azure Data Factory, Data Bricks, MS...

  • Data Engineer

    18 hours ago

    Kolkata, West Bengal, India Zorba Consulting Full time

    Job DescriptionThis role is a great fit for a Senior Data Engineer or a Snowflake Cortex Specialist. The position is for an experienced professional who will design, implement, and optimize data solutions using Snowflake's advanced features.Key Responsibilities- Data Warehousing: You will design, implement, and optimize scalable data warehousing solutions...