Large Scale Data Specialist

2 days ago

Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Summary

We're seeking an experienced Data Engineer to join our team and play a key role in accelerating experiments, developing new datasets, and improving infrastructure efficiency.

This is an exciting opportunity for a skilled professional with deep expertise in large-scale data processing to work directly with researchers and contribute to the development of next-generation AI solutions.

Main Responsibilities:

  • Data Infrastructure Design and Development: Design, build, and operate scalable, fault-tolerant data infrastructure to support distributed computing and data orchestration for LLM Research.
  • Data Ingestion and Processing: Develop and maintain high-throughput systems for data ingestion, processing, and transformation to support LLM model development.
  • Synthetic Datasets: Develop synthetic datasets using state-of-the-art solutions.
  • Collaboration and Delivery: Collaborate with research teams to deliver critical data assets for model development and evaluation.
  • Platform Reliability and Performance: Implement and maintain monitoring and alerting to support platform reliability and performance.
  • Quality Control: Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards.

Requirements:

  • Experience: 5+ years of experience in data infrastructure, ideally supporting high-scale applications or research platforms.
  • Distributed Computing Frameworks: Fluent in distributed computing frameworks.
  • Cloud Infrastructure: Deeply familiar with cloud infrastructure, data storage architectures, and batch + streaming pipelines.
  • Specialized Hardware: Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster.
  • Database Knowledge: Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale.
  • Microservices Architectures: Familiar with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing.
  • Performance Optimization: Extensive experience with performance optimization and memory management in high-volume data systems.
  • Documentation and Automation: Proactive about documentation, automation, testing, and empowering your teammates with good tooling.

This role is fully remote, India-based. Compensation and benefits will vary based on background, skills, and experience levels.

  • Data Engineering Specialist

    8 hours ago

    Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistWe are seeking a highly experienced professional to lead the development and maintenance of our large-scale data platforms.

  • Experienced Python Developer for Large-Scale Web Scraping Solutions

    7 days ago

    Nashik, Maharashtra, India beBeeScraping Full time ₹ 15,00,000 - ₹ 20,00,000

    About UsWe are seeking a highly skilled Python Developer to join our team.The ideal candidate will have strong expertise in Scrapy, web scraping and automation. This role involves designing, developing and maintaining large-scale scraping solutions that power data-driven decision-making.

  • Cloud Data Specialist

    9 hours ago

    Nashik, Maharashtra, India beBeeCloudData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data SpecialistThis is a challenging opportunity to contribute to our organization as a skilled data engineer with expertise in cloud-based technologies.The ideal candidate will have extensive experience in designing, building, and maintaining large-scale data processing systems using Google Cloud Platform (GCP) services. They should also be...

  • Large-Scale Solar Project Manager

    4 days ago

    Nashik, Maharashtra, India beBeeProject Full time ₹ 1,74,39,000 - ₹ 2,49,79,000

    Job RoleWe are seeking a seasoned project management professional to lead and manage large-scale solar power projects. The role requires complete ownership of project planning, execution, and delivery while ensuring adherence to safety protocols, quality standards, and timelines.Key ResponsibilitiesProject Planning & StrategyDevelop detailed project plans...

  • Data Scientist Specialist

    2 days ago

    Nashik, Maharashtra, India beBeeDataScience Full time ₹ 50,00,000 - ₹ 2,50,00,000

    Job Title: Data Scientist SpecialistWe are seeking an experienced professional to join our analytics and AI team as a data modeling expert.The ideal candidate will design, develop, and deploy scalable machine learning models at scale, working with large datasets and leveraging modern frameworks such as PySpark and MLflow.This is an exciting opportunity to...

  • Large Language Model Developer

    2 days ago

    Nashik, Maharashtra, India beBeeGenerative Full time ₹ 7,50,000 - ₹ 12,00,000

    Job Title: Large Language Model DeveloperThis is a temporary contract position with extensions, where you will support various teams in the AI Center of Excellence.The successful candidate will have expertise in Generative AI development and strong experience in developing Generative AI based solutions using frameworks such as Langchain, Llamaindex,...

  • Cloud Data Specialist

    2 days ago

    Nashik, Maharashtra, India beBeeDataMigration Full time ₹ 18,00,000 - ₹ 22,00,000

    Job OverviewWe are seeking a skilled Data Migration Specialist with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem.The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.Key Responsibilities:Lead...

  • Cloud Data Engineer Specialist

    4 days ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Description: We are seeking a skilled and experienced data engineer to design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP). Create and implement efficient data pipelines that enable seamless data flow across systems. Develop and maintain large-scale data warehouse solutions to support business intelligence and...

  • Big Data Processing Specialist

    5 days ago

    Nashik, Maharashtra, India beBeeClustering Full time ₹ 15,00,000 - ₹ 19,99,999

    Job DescriptionThis role involves administering and maintaining large-scale data processing systems using Cloudera technology.Key Responsibilities:Build and maintain Cloudera clusters for big data processing.Migrate data from one platform to another while ensuring minimal downtime.Tune system performance to ensure optimal output.Provide pre- and...

  • Cloud-Based Data Engineer Specialist

    2 days ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a seasoned professional to design and implement large-scale data engineering solutions on Google Cloud Platform (GCP). As a key member of our team, you will have the opportunity to work on exciting projects leveraging advanced cloud-based technologies.Key Responsibilities:Data Pipeline Design and Implementation: Utilize BigQuery, Dataflow,...