Scalable Data Solutions Developer

1 day ago

Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 2,59,20,000
Data Engineering Role

We are seeking an accomplished Data Engineer to develop, deploy and maintain scalable data pipelines using Python and GCP.

Key Responsibilities:
  • Data Pipeline Development
    • Create high-throughput, low-latency pipelines to process massive datasets efficiently.
    • Ensure pipelines can handle 5–10 TB of structured and unstructured data at scale.
  • Data Ingestion & Transformation
    • Optimize data ingestion and transformation for downstream models.
    • Implement intelligent scanning mechanisms to filter out relevant data for AI/ML models.
  • AI/ML Model Integration
    • Leverage GenAI models (e.g., Gemini Pro, OpenAI, GPT) under the Vertex AI umbrella.
    • Build and fine-tune custom models when LLMs are cost-prohibitive or less effective.
    • Design multi-layered model pipelines balancing accuracy, cost, and performance.
  • Cloud Infrastructure Design
    • Architect scalable solutions primarily on GCP (Vertex AI, BigQuery, GKE, Cloud run, PostgreSQL, Dataflow, Pub/Sub).
    • Azure knowledge is a plus but not mandatory.
    • Experienced in building robust monitoring systems.
  • Performance Optimization
    • Ensure real-time, low-latency processing for high-volume workloads.
    • Optimize GPU/CPU-intensive environments to manage cost and efficiency.
  • Collaboration & Ownership
    • Work closely with data scientists, ML engineers, and solution architects.
    • Take end-to-end ownership of assigned tasks and deliverables, working independently where needed.
    • Collaborate with global teams and manage timezone overlap when required.

  • Designing Scalable Data Solutions

    3 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000

    Job Title:Data Solutions ArchitectWe are seeking a highly skilled data solutions architect to join our team. The ideal candidate will have extensive experience in designing, building, and maintaining robust and scalable data solutions.Collaborate with Data and ETL teams to review code, understand current architecture, and improve it based on the latest best...

  • Building Scalable Data Solutions

    1 day ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to design and implement scalable data solutions.Develops and implements comprehensive data architectures, ensuring scalability and maintainability.Designs and optimizes large-scale data pipelines with strong communication skills.Collaborates with cross-functional teams to deliver...

  • Expert Leader

    5 days ago

    Pune, Maharashtra, India beBeeDataSystems Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Lead Advanced Data SystemsThe Team Lead for Advanced Data Systems Delivery will lead a team responsible for delivering high-performance, scalable data solutions.Lead the end-to-end delivery of advanced data systems for mission-critical Tier 1 applications.Ensure solutions meet NFRs (e.g., scalability, performance, availability, security) and SLAs.This role...

  • AWS Data Engineer – Scalable Solutions

    7 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 18,59,415 - ₹ 25,12,088

    Unlock Data Engineering Excellence in Oil & GasA leading organization is seeking an experienced AWS Data Engineer to design, build, and optimize scalable data pipelines and cloud solutions for the Oil & Gas industry.Key Responsibilities:Design, develop, and maintain large-scale data pipelines and ETL/ELT solutions using AWS cloud services.Ingest, process,...

  • Azure Data Engineer: Scalable Solutions Expert

    5 days ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 30,00,000

    Data Engineering OpportunityJob Description :Design and implement scalable data solutions using Azure Databricks.We seek a skilled Data Engineer to work with large datasets, apply ETL methodologies, and extract, transform, and load data from various sources.The ideal candidate will ensure high performance, scalability, security, and availability of data...

  • Transforming Business with Scalable Data Solutions

    7 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Cloud Data Engineer PositionAs a cloud data engineer, you will play a crucial role in transforming raw data into actionable insights. You will design and develop robust data solutions for clients, leveraging advanced technologies and techniques to drive business growth.Responsibilities:Design, build, and maintain scalable data pipelines on cloud platforms...

  • Senior Snowflake Data Engineer

    7 days ago

    Pune, Maharashtra, India beBeeDataWarehouseArchitect Full time ₹ 2,14,88,000 - ₹ 2,41,33,000

    About the JobWe are seeking a highly skilled Data Warehouse Architect to lead our team in designing, implementing, and optimizing scalable data solutions using Snowflake.The ideal candidate will have hands-on experience with Snowflake Data Cloud and a deep understanding of data warehousing concepts, including structured, semi-structured, and unstructured...

  • Building Scalable Solutions

    1 day ago

    Pune, Maharashtra, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Lead Data EngineerWe are seeking a passionate and driven professional to join our team at the forefront of data engineering. As we build our platform from scratch, you will have the opportunity to shape our technology vision, architecture, and engineering culture.This role is ideal for someone who thrives on early-stage challenges and loves building...

  • Senior Data Solutions Developer

    2 days ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    Job Title: Databricks EngineerLocation: RemoteJob Type: Full-TimeShift Timings: Flexible HoursWe are seeking a seasoned data engineering expert to develop and enhance scalable, high-performance data solutions on Databricks. The ideal candidate has extensive experience in Databricks production environments and a thorough understanding of modern data...

  • Innovative Data Solutions Developer

    1 day ago

    Pune, Maharashtra, India beBeeInnovative Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Innovative Data Solutions DeveloperWe are seeking a skilled professional to develop robust data solutions from the ground up.Key Responsibilities:Design and build scalable Python and PySpark frameworks.Write complex SQL queries for data transformation, validation, and analysis.Develop innovative code solutions with clean, well-documented...