Big Data Processing Specialist

2 days ago


Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

We are seeking a skilled Data Engineering expert to design, build and maintain high-performance data pipelines that process large volumes of data.

This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.

Key Responsibilities include:

  • Designing and implementing scalable batch processing systems using Python and big data technologies
  • Optimizing database performance, focusing on slow-running queries and latency improvements
  • Using Python profilers and performance monitoring tools to identify bottlenecks
  • Reducing P95 and P99 latency metrics across our data platform
  • Building efficient ETL pipelines that can handle large-scale data processing

Required Skills and Qualifications include:

  • Bachelor's degree in Computer Science, Engineering or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)

The ideal candidate will have strong analytical thinking and problem-solving skills, excellent attention to detail and commitment to data quality, and the ability to work effectively in a collaborative team environment.



  • Erode, Tamil Nadu, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerThe Role:We are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have a strong background in designing, developing, and maintaining large-scale data processing systems using big data technologies.Key Responsibilities:Design and develop scalable and efficient data processing systems using big...


  • Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary:A Senior Data Engineer will lead a team of big data engineers, collaborating with clients and team members to design architectures that meet client needs.Key Responsibilities• Develop efficient data pipelines for new sources, including data transformations within the Data Lake.• Collaborate with cross-functional teams to source data and make...


  • Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Role SummaryWe seek highly skilled Data Engineers with expertise in real-time data processing to build and maintain large-scale data infrastructures.Key Responsibilities:Data Modeling: Design efficient architectures and implement effective data storage solutions.ETL Processes: Develop and maintain seamless data transfer processes.Data Quality and Efficiency:...

  • Key Architect

    2 days ago


    Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:A seasoned Senior Data Engineer is required to lead a team of big data engineers, working closely with clients and team members to understand their requirements and develop architectures that meet their needs.


  • Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 40,00,000 - ₹ 50,00,000

    Job Title: Data Engineering Specialist">We are looking for a highly skilled data engineering specialist to join our team. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts,...


  • Erode, Tamil Nadu, India beBeeInformatica Full time ₹ 1,20,00,000 - ₹ 2,51,40,000

    Senior Informatica DeveloperThis is a full-time role for an ETL Specialist based in Bengaluru for one of our esteemed overseas clients. The position involves understanding requirements, designing, developing, and testing of scalable ETL architecture, transformation jobs, and workflow schedules.Key ResponsibilitiesDesign and develop complex ETL workflows...

  • Senior Data Expert

    2 days ago


    Erode, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    **Job Title:** Data SpecialistOverviewWe are seeking a highly skilled Data Specialist to join our team in a mission-critical banking project. This is an opportunity to work on cutting-edge data pipelines, streaming platforms, and cloud-based infrastructures—building scalable, high-performance solutions for a leading financial services environment.Key...


  • Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data EngineerAt our organization, we are seeking a seasoned Senior Data Engineer with expertise in Python and Pyspark. This individual will play a pivotal role in designing, developing, and implementing an application for a large retailer.Required Skills & QualificationsWe are looking for a candidate with 5+ years of experience as a Data Engineer,...


  • Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data EngineerWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, including experience with designing and developing robust data pipelines and ETL processes.


  • Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 12,00,000

    Data Engineering SpecialistAttractive job opportunities exist for highly skilled Data Engineering Specialists to create and maintain large-scale data processing systems.Main Responsibilities:We are looking for a professional who can design and develop efficient data pipelines using Azure Data Factory and associated tools.The ideal candidate will have...