High Performance Data Pipeline Specialist

3 days ago

Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,56,00,000 - ₹ 2,42,40,000

Data Engineering Position

We are seeking a skilled Data Engineer to join our Professional Services team. The successful candidate will design, build, and maintain high-performance data pipelines that process large volumes of data.

The role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards. Key responsibilities include:

  • Designing and implementing scalable batch processing systems using Python and big data technologies
  • Optimizing database performance, focusing on slow-running queries and latency improvements
  • Using Python profilers and performance monitoring tools to identify bottlenecks
  • Reducing P95 and P99 latency metrics across our data platform
  • Building efficient ETL pipelines that can handle large-scale data processing
  • Collaborating with data scientists and product teams to understand data requirements
  • Monitoring and troubleshooting data pipeline issues in production
  • Implementing data quality checks and validation mechanisms
  • Documenting data architecture and engineering processes
  • Staying current with emerging big data technologies and best practices

The ideal candidate will have a Bachelor's degree in Computer Science, Engineering, or related technical field, and 4+ years of experience in data engineering roles. Strong Python programming skills, experience with big data technologies, and knowledge of performance optimization techniques and profiling tools are also essential.

We offer a collaborative team environment, excellent attention to detail, and a commitment to data quality. If you are passionate about performance optimization and efficiency, we encourage you to apply for this challenging position.

  • High-Performance Data Pipeline Architect

    2 weeks ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    We're seeking a highly skilled Big Data Engineer to help us scale and optimize our data processing capabilities.As a key member of our team, you'll design, build, and maintain high-performance data pipelines that process terabytes of data. Your focus will be on optimizing existing systems, identifying performance bottlenecks, and implementing solutions to...

  • Data Pipeline Specialist

    7 days ago

    Thrissur, Kerala, India beBeeDataPipelineSpecialist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: OCI Data Flow SpecialistOverview:We are seeking a skilled professional to design, develop and manage data pipelines using Oracle Data Flow or Apache Spark (PySpark), with a solid understanding of data patterns, Python, and SQL.Responsibilities:3–12 years of experience in building and managing Data Lakes, Data Warehouses, and Data...

  • Data Pipeline Specialist

    7 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled data engineer to take on the challenge of designing, developing and maintaining scalable data pipelines. The successful candidate will ensure high-quality, reliable data for player behavior analysis, game performance and optimization.Key Responsibilities:Build, maintain and optimize data pipelines for large-scale slot game and player...

  • Data Pipeline Architect

    5 days ago

    Thrissur, Kerala, India beBeeETL Full time ₹ 15,00,000 - ₹ 25,00,000

    As a highly skilled ETL specialist, you will be responsible for designing and deploying efficient data pipelines that drive business growth.The ideal candidate will have hands-on experience with ETL development using Informatica and a strong understanding of data warehousing concepts. Additionally, proficiency in Python programming for data processing and...

  • High-Performance Data Engineer

    2 weeks ago

    Thrissur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking an experienced Data Engineer to design and implement high-performance data pipelines. Our ideal candidate will have a strong background in big data technologies, Python programming skills, and experience with database performance optimization.Key ResponsibilitiesDesign and implement scalable batch processing systems using big...

  • High-Performance Data Architect

    2 weeks ago

    Thrissur, Kerala, India beBeeDatabricks Full time ₹ 25,00,000 - ₹ 27,00,000

    Senior Databricks Data EngineerOur organization seeks a Senior Databricks Data Engineer with hands-on experience in Databricks and AWS to manage our data engineering team's infrastructure and applications.Key Responsibilities:Design, develop, and maintain scalable and high-performance data pipelines using Databricks and PySpark.Implement and manage data...

  • Data Pipeline Specialist

    7 days ago

    Thrissur, Kerala, India beBeeElasticsearch Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    About this position:We are seeking a highly skilled professional to manage and maintain our Elasticsearch clusters.This includes evaluating cluster performance, planning changes for high-load events, applying security fixes, testing and performing incremental upgrades, and extending and improving our monitoring and alert infrastructure.Key...

  • Data Pipeline Architect

    6 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000

    Unlock the Power of Data EngineeringAs a Senior Data Engineer, you will play a vital role in building and maintaining scalable data pipelines that integrate healthcare data. This is a critical position where you will create high-performance pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated...

  • High-Performance Data Engineer

    1 week ago

    Thrissur, Kerala, India beBeeDataDriven Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionWe are seeking a seasoned data engineer to design and implement cutting-edge intelligence infrastructure for enterprise transformation in complex telecom and ITAM environments.The RoleYou will be responsible for developing robust ETL pipelines, building scalable BI solutions, and driving data-powered outcomes that enhance client...

  • Data Pipeline Specialist

    5 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Opportunity: Data EngineerWe are seeking a skilled professional to join our team as a Data Engineer.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Integrate data from various sources, ensuring data quality and consistency.Optimize data processing workflows for...