Big Data Pipeline Specialist

1 day ago


Kolhapur, India beBeeDataEngineer Full time

About the RoleWe are seeking a skilled Data Pipeline Specialist to design, build, and manage large-scale data pipelines that support both batch and real-time analytics.This role requires hands-on experience in cloud-based technologies, distributed data processing frameworks, and data warehousing solutions.The ideal candidate will have expertise in cloud platforms, big data tools, and modern ETL/data integration practices.Key Responsibilities:Design and implement scalable data pipelines using cloud-based technologies and distributed data processing frameworks.Develop and optimize Spark jobs for large-volume data processing and transformation.Manage and integrate data from diverse sources including cloud storage, SQL databases, and streaming platforms.Implement real-time data streaming using Kafka, Spark Streaming, or Flink.Create and maintain ETL workflows, ensuring data quality, reliability, and consistency.Collaborate with data architects, analysts, and scientists to enable analytics, ML workflows, and business insights.Requirements:7–12 years of experience as a Data Engineer or Big Data Engineer.Expert-level proficiency in Apache Spark, Spark SQL, PySpark, or Scala.Experience with cloud platforms including Azure, AWS, or Google Cloud.Strong knowledge of data modeling, warehouse concepts, and distributed systems.Familiarity with NoSQL technologies (MongoDB, HBase, Cassandra, Cosmos DB).Benefits:Opportunity to work on challenging projects with a talented team.Professional growth and development opportunities.A competitive compensation package.



  • Kolhapur, India beBeeData Full time

    Key ResponsibilitiesWe are seeking an experienced Data Pipeline Engineer to design, build, and maintain scalable data pipelines within the Palantir Foundry ecosystem.The ideal candidate will develop and operationalize AI-powered workflows, copilots, and decision-support agents using Palantir AIP, implementing retrieval-augmented generation (RAG) and...


  • Kolhapur, India beBeeDataEngineer Full time

    Data Engineer - Cloud Data Pipeline SpecialistThis role is instrumental in building and maintaining a scalable data pipeline using machine learning models.Key responsibilities include designing, implementing and integrating batch processing pipelines within cloud-based environments (AWS), image processing workflows, and ML model deployment.A strong...


  • Kolhapur, India beBeeDataValidation Full time

    Enterprise Data Validation SpecialistExpert data validation specialists are required to ensure the accuracy, reliability, and performance of enterprise-level data pipelines, business intelligence reports, and analytics solutions.5–10+ years of experience: In data validation or QA, with strong SQL skills (joins, window functions, aggregations,...


  • Kolhapur, India beBeeDataEngineer Full time

    Senior Data Engineer RoleWe are seeking an experienced Senior Data Engineer to join our team and contribute to the design, development, and optimization of high-performance data pipelines and data systems.Key Responsibilities:Design and Develop Scalable ETL PipelinesBuild Data Models and WarehousesWork with Large-Scale DatasetsImplement Data Quality and...


  • Kolhapur, India beBeeData Full time

    Job Title:Azure Data Specialist: Designing Scalable Data ArchitecturesAbout the Role:We are seeking an experienced Azure data professional to lead the design and implementation of large-scale data architectures on the Microsoft Azure platform.Key Responsibilities:Design and implement robust Azure-based data solutions, ensuring seamless integration and...


  • Kolhapur, India beBeeDataScientist Full time

    Job RoleWe are a cutting-edge team focused on developing and managing advanced digital marketing platforms.The team operates in a highly collaborative environment with members across several countries, working on high-traffic systems and big data processing.As a Data Scientist, you will design and implement machine learning models and optimization algorithms...


  • Kolhapur, India beBeeDataInsights Full time

    Job SummaryWe are seeking an experienced Data Insights Specialist to join our team.Key ResponsibilitiesData Modelling and Design: Develop scalable and efficient data models that align with business objectives and growth requirements.Data Storage and Processing: Architect robust data storage and processing pipelines for structured and unstructured data,...


  • Kolhapur, India beBeeMLOps Full time

    MLOps Engineer Role OverviewAs a senior MLOps professional, you will contribute to the design, deployment, and maintenance of robust machine learning pipelines using AWS SageMaker and associated cloud services. This position requires strong experience in production-grade MLOps, automation, and cloud engineering.You will be responsible for:Building,...


  • Kolhapur, India beBeeDataEngineering Full time

    Data Engineering PositionThe role of Data Engineer is pivotal in driving innovation within our microservices architecture.

  • Data Scientist

    5 days ago


    kolhapur, India beBeeDataDriven Full time

    Unlock Data PotentialWe're on a mission to transform data into actionable insights that drive business growth. Our ideal candidate will take ownership of our machine learning pipeline, from raw data to deployment.