Senior Data Processing Specialist

4 days ago

Surat, Gujarat, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000
Job Description

We are seeking an experienced Software Engineer to join our team and contribute to the development of large-scale data processing systems for LLM research. As a key member of our infrastructure team, you will design, build, and operate scalable, fault-tolerant data infrastructure to support distributed computing and data orchestration.

You will work closely with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data assets. This role requires a deep understanding of distributed computing frameworks, cloud infrastructure, data storage architectures, and batch + streaming pipelines.

  • Design and develop high-throughput systems for data ingestion, processing, and transformation.
  • Collaborate with research teams to deliver critical data assets for model development and evaluation.
  • Implement and maintain monitoring and alerting to support platform reliability and performance.
  • Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards.
Required Skills and Qualifications
  • 5+ years of experience in data infrastructure, preferably supporting high-scale applications or research platforms.
  • Fluent in distributed computing frameworks, including Kubernetes and Apache Spark.
  • Deep understanding of cloud infrastructure, data storage architectures, and batch + streaming pipelines.
  • Experience with specialized hardware (GPUs, TPUs) computing and GPU clusters.
  • Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale.
  • Familiarity with microservices architectures, containerization, and orchestration.
Benefits

This role is fully remote, India-based. You will have the opportunity to work with a compact team responsible for both architecture and scaling of Incept's data and model development infrastructure.

The successful candidate will be proactive about documentation, automation, testing, and empowering their teammates with good tooling. They will also be committed to continuous learning and staying up-to-date with the latest technologies and trends in the field.

  • Large Scale Data Processing Specialist

    2 days ago

    Surat, Gujarat, India beBeeDataEngineering Full time ₹ 15,50,000 - ₹ 21,50,000

    Data Engineering SpecialistAs a Data Engineering Specialist, you will be responsible for designing, building, and deploying large-scale data processing systems using Azure Databricks. Your primary objective will be to develop and maintain efficient data pipelines that integrate seamlessly with existing applications.You will collaborate closely with...

  • Big Data Specialist

    1 week ago

    Surat, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Infrastructure SpecialistJob Overview:We are seeking a highly skilled Senior Data Infrastructure Specialist to design, develop, and maintain the infrastructure that enables data collection, storage, processing, and analysis. The ideal candidate will have experience in designing, developing, and maintaining ETL/ELT data pipelines, as well as...

  • Large Scale Data Architect

    6 days ago

    Surat, Gujarat, India beBeeData Full time ₹ 80,00,000 - ₹ 2,00,00,000

    Senior Data Specialist">Steps AI is developing AIDE, the world's most advanced AI web widget and Chat Platform. The platform ingests and processes massive datasets across multiple sources to deliver real-time insights.The Role:We seek a Senior Data Specialist with experience in building production-grade pipelines at scale (terabytes of data). Key...

  • Senior Tax Compliance Specialist

    1 week ago

    Surat, Gujarat, India beBeeCompliance Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Senior Tax Compliance Specialist">We are seeking an experienced and skilled Senior Tax Compliance Specialist to coordinate and oversee tax audit activities for our clients. The responsibilities of this role include developing and implementing policies, managing junior auditors, and recording results.A key responsibility of this role is handling...

  • Senior Data Analyst Specialist

    1 week ago

    Surat, Gujarat, India beBeeDataIntegrity Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Description">">​As a Senior Data Integrity Specialist, you will play a critical role in ensuring the accuracy and reliability of our data.">​You will work closely with cross-functional teams to identify opportunities for process improvement and implement scalable solutions.">">Required Skills and Qualifications">">​Ability to analyze complex data...

  • Data Validation Engineer

    16 hours ago

    Surat, Gujarat, India beBeeAutomation Full time ₹ 12,00,000 - ₹ 18,00,000

    Senior Data Automation SpecialistThe successful candidate will work as a Senior Data Automation Specialist, focusing on developing Golden Model simulations using Python, creating and validating synthetic test data, and ensuring high-quality data delivery in a CI/CD environment.

  • Image Processing Specialist

    11 hours ago

    Surat, Gujarat, India beBeeImageProcessing Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    About the Role:We are seeking a skilled Image Processing Specialist to join our team. This individual will be responsible for developing and optimizing algorithms for key image processing stages, including radiometric and geometric correction, atmospheric correction, image enhancement, mosaicking, and orthorectification.Key Responsibilities:To apply...

  • Automotive Process Improvement Specialist

    6 days ago

    Surat, Gujarat, India beBeeProcessImprovement Full time ₹ 6,00,000 - ₹ 12,00,000

    Job Title: Automotive Process Improvement SpecialistWe are seeking an Automotive Process Improvement Specialist to join our team. This is a key role within the organization, responsible for driving process improvements and ensuring excellence in automotive manufacturing.This position will focus on identifying areas for improvement, analyzing data, and...

  • Data Insights Specialist

    11 hours ago

    Surat, Gujarat, India beBeeInsights Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Insights SpecialistA leading organization is seeking an experienced Data Insights Specialist to contribute to its data-driven decision making process. This role involves gathering, analyzing, and interpreting large datasets to deliver actionable business insights that inform strategic planning and drive business growth.Key...

  • Data Engineering Specialist

    2 hours ago

    Surat, Gujarat, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistAs a Data Engineering Specialist, you will be responsible for designing and implementing end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.Your primary goal will be to build and maintain scalable data solutions that meet the analytics and...