Senior Large Scale Data Processing Specialist

24 hours ago

Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 13,66,500 - ₹ 25,26,250
Software Engineer for Large Scale Data Processing

We are seeking a highly skilled Software Engineer with expertise in large-scale data processing to join our team. The ideal candidate will have deep knowledge of distributed computing frameworks and experience with cloud infrastructure, data storage architectures, and batch + streaming pipelines.

This role is fully remote and requires the ability to work independently with minimal supervision. The successful candidate will be responsible for designing, building, and operating scalable, fault-tolerant data infrastructure to support distributed computing and data orchestration for LLM Research.

The key responsibilities of this position include:

  • Designing and implementing high-throughput systems for data ingestion, processing, and transformation to support LLM model development;
  • Developing synthetic datasets using state-of-the-art solutions;
  • Collaborating with research teams to deliver critical data assets for model development and evaluation;
  • Implementing and maintaining monitoring and alerting to support platform reliability and performance;
  • Building systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards;

The successful candidate will have:

  • A minimum of 5 years of experience in data infrastructure, ideally supporting high-scale applications or research platforms;
  • Fluency in distributed computing frameworks;
  • Deep familiarity with cloud infrastructure, data storage architectures, and batch + streaming pipelines;
  • Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster;
  • Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale;
  • Familiarity with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing;
  • Extensive experience with performance optimization and memory management in high-volume data systems;
  • Proactive about documentation, automation, testing, and empowering your teammates with good tooling.

This is a fantastic opportunity to work on cutting-edge projects and contribute to the development of AI solutions. If you are passionate about data engineering and want to take your skills to the next level, we encourage you to apply.

  • Candidate ProfileExperienced Data Engineer with 5+ years of experience in designing, developing, and maintaining large-scale data pipelines.

    4 days ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 15,00,000

    Data Engineering SpecialistWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in designing, developing, and maintaining large-scale data pipelines.Key Responsibilities:Design and implement data pipelines for ingestion, transformation, and storage of large-scale...

  • Senior Data Processing Specialist

    1 day ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 2,00,00,000

    Big Data DeveloperWe are seeking a skilled professional to spearhead the design, development, and maintenance of large-scale data processing systems.Key Responsibilities:Design and implement scalable data pipelines using Big Data technologies such as Hadoop, Spark, and NoSQL databases.Develop and execute ETL processes to extract, transform, and load data...

  • Senior Data Infrastructure Specialist

    6 days ago

    Agra, Uttar Pradesh, India beBeeData Full time US$ 80,000 - US$ 1,20,000

    Job Title: Senior Data Infrastructure SpecialistJob Description:The successful candidate will be responsible for designing, developing and maintaining large-scale data pipelines using Python and AWS technologies. They will collaborate with cross-functional teams to identify business needs and develop innovative solutions to drive business outcomes.Required...

  • Large Scale System Tester

    6 days ago

    Agra, Uttar Pradesh, India beBeePerformance Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    **Job Title:** Performance Engineer We are seeking a skilled Performance Engineer to conduct performance and load testing on our large-scale ServiceNow instance. The role will focus on evaluating system behavior under heavy usage and ensuring scalability, stability, and responsiveness.The position involves conducting performance and load testing on a...

  • Senior Data Processing Specialist

    6 days ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 12,00,000

    Data Engineering ExpertAs a seasoned professional, you will play a pivotal role in crafting large-scale data processing systems. Your expertise in data engineering principles, tools, and technologies will empower the organization to make informed decisions and drive growth.Key Responsibilities:Design and Develop Data Pipelines: Utilize Azure Data Factory,...

  • Chief Data Architecture Specialist

    24 hours ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Architect PositionAs a Senior Data Architect, you will be responsible for leading the design and implementation of data architectures for large-scale distributed systems.The ideal candidate will have extensive experience in customer-facing consulting, interacting with large-scale distributed data/computing solutions. A strong business...

  • Senior Data Infrastructure Engineer

    3 days ago

    Agra, Uttar Pradesh, India beBeeDataInfrastructureEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Infrastructure EngineerJob Description", "We are seeking a highly skilled Senior Data Infrastructure Engineer to design, build and maintain large-scale data infrastructure platforms. This is an exciting opportunity to work with cutting-edge technologies and collaborate with a talented team of engineers and data scientists.", "The ideal...

  • Chief Data Strategist

    1 day ago

    Agra, Uttar Pradesh, India beBeeDataInsights Full time ₹ 12,50,000 - ₹ 14,12,500

    Senior Business Intelligence Specialist\ \Job Overview\ We seek a skilled Senior Business Intelligence Specialist to analyze large datasets, uncover trends, and deliver actionable insights that drive business growth. The role involves generating data-driven recommendations from historic and current data, automating reporting processes, and collaborating with...

  • Scalable Data Specialist

    5 days ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Opportunity: Scalable Data SpecialistOverview of the Role:We are seeking a highly skilled and motivated data specialist to design, develop, and maintain large-scale data architectures. The ideal candidate will have a strong background in data engineering, cloud technologies, and data architecture.Key Responsibilities:Design and implement scalable data...

  • Cloud Data Specialist

    5 days ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,10,000

    Senior Cloud Data EngineerWe are seeking a highly skilled and experienced Senior Cloud Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems on the Google Cloud Platform (GCP).Key Responsibilities:Design and develop scalable data pipelines using GCP services...