Senior Cloud Data Architect

6 days ago

Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 19,32,000 - ₹ 25,15,000
Job Overview:

We are seeking a highly skilled Senior Data Engineer to join our team. In this role, you will be responsible for designing and developing scalable data pipelines to process massive datasets efficiently.


Key Responsibilities:
  • Design & Develop Scalable Data Pipelines
    • Build high-throughput, low-latency pipelines to process large volumes of structured and unstructured data.
    • Ensure pipelines can handle 5–10 TB of data at scale.
  • Data Filtering & Curation
    • Optimize data ingestion and transformation for downstream applications.
    • Implement intelligent scanning mechanisms to filter out relevant data for AI/ML models.
  • AI/ML Integration
    • Leverage GenAI models under the Vertex AI umbrella.
    • Build and fine-tune custom models when LLMs are cost-prohibitive or less effective.
    • Design multi-layered model pipelines balancing accuracy, cost, and performance.
  • Cloud Infrastructure
    • Architect scalable solutions on GCP (Vertex AI, BigQuery, GKE, Cloud Run, PostgreSQL, Dataflow, Pub/Sub).
    • Azure knowledge is a plus but not mandatory.
    • Experienced in building robust monitoring systems.
  • Performance Optimization
    • Ensure real-time, low-latency processing for high-volume workloads.
    • Optimize GPU/CPU-intensive environments to manage cost and efficiency.
  • Collaboration & Ownership
    • Work closely with data scientists, ML engineers, and solution architects.
    • Take end-to-end ownership of assigned tasks and deliverables, working independently where needed.
    • Collaborate with global teams and manage time zone overlap when required.

    Required Skills & Qualifications:
    • Programming
      • Expert-level Python programming skills.
    • Data Engineering
      • Hands-on experience with streaming pipelines and large-scale data ingestion frameworks.
    • AI/ML Expertise
      • Experience integrating and fine-tuning LLMs and GenAI models.
      • Comfortable working with custom model development when LLMs cannot be applied.
      • Familiarity with OpenAI, Gemini, Vertex AI, or equivalent platforms.
    • Cloud
      • GCP experience (mandatory) - architecture on Vertex AI, BigQuery, GKE, Cloud Run, PostgreSQL, Dataflow, Pub/Sub.
      • Azure experience is a plus.
    • Scalability & Low Latency
      • Proven ability to design and implement high-performance, distributed data solutions.
    • High-Volume Data Processing
      • Experience processing massive datasets efficiently within strict timeframes.

Good to Have:

  • Experience with MLOps and deploying models at scale.
  • Knowledge of data governance and compliance when working with sensitive data.
  • Hands-on exposure to event-driven architectures and microservices.

  • Cloud Data Architect

    3 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data ArchitectAre you a seasoned data professional looking for a new challenge? We are seeking a skilled cloud data architect to design, deploy and manage scalable data pipelines using GCP services.Key Responsibilities:

  • Cloud Data Architect

    1 day ago

    Ellore, Andhra Pradesh, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Summary:We are seeking a skilled Cloud Data Architect to help design and deploy large-scale data engineering solutions using Python, Pyspark, and SQL. The ideal candidate will have hands-on experience with big data platforms, particularly Google Cloud Platform (GCP). Key Responsibilities:Design and develop scalable data architectures using cloud-based...

  • Cloud Data Architect

    5 days ago

    Ellore, Andhra Pradesh, India beBeeDataArchitect Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data ArchitectData is the lifeblood of any organization, and as a seasoned cloud data architect, you will be instrumental in designing and implementing scalable data pipelines that drive business growth.Lead the development of big data architectures using Apache Airflow and Apache Spark to deliver real-time insights and enhance...

  • Chief Cloud Data Architect

    1 week ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Data Architect PositionJob Overview:A key position has opened up for a Cloud Data Architect with extensive knowledge of Salesforce Data Cloud.This role is ideal for a skilled professional looking to spearhead the implementation of large-scale data cloud initiatives and guide technical teams in designing scalable architectures.The ideal candidate will...

  • Senior Cloud Architect

    5 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Title:** Senior Data EngineerWe are seeking a highly experienced Data Engineering Lead with a strong focus on Databricks and cloud-based data engineering to lead our data engineering team.This leadership role requires a visionary who can design, develop, and manage scalable data infrastructure and pipelines, while mentoring and inspiring a team of data...

  • Cloud Data Architect

    5 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Description:As a seasoned Cloud Data Architect, you will be responsible for designing and implementing scalable, reliable, and secure data pipelines on the Google Cloud Platform (GCP). You will work closely with cross-functional teams to deliver high-quality solutions that meet our business needs.The ideal candidate has in-depth experience with GCP core...

  • Data Cloud Architect

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeDataCloud Full time ₹ 1,50,00,000 - ₹ 2,01,00,000

    Job Title: Data Cloud ArchitectWe are seeking a skilled IT professional with hands-on Snowflake Data Cloud experience to lead the design, implementation, and optimization of scalable data solutions.The ideal candidate will have a deep understanding of data warehousing concepts and work with structured, semi-structured, and unstructured...

  • Senior Big Data Solutions Architect

    7 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Big Data Solutions ArchitectWe are seeking a highly skilled and experienced Senior Big Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data architectures and solutions.About the Role:The ideal candidate will have a strong...

  • Chief Data Transformation Officer

    5 days ago

    Ellore, Andhra Pradesh, India beBeeData Architect Full time ₹ 25,00,000 - ₹ 30,00,000

    Lead Large-Scale Data Engineering ProjectsAs a seasoned data architect, you will spearhead the development and implementation of cutting-edge data solutions. Your expertise in data integration, warehousing, and API-based integrations will be instrumental in transforming raw data sources into actionable insights.You will work closely with cross-functional...

  • Cloud Solutions Architect

    5 days ago

    Ellore, Andhra Pradesh, India beBeeCloud Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Description:As a senior cloud solutions architect, you will lead the design and implementation of enterprise-level HCM systems. This involves leveraging technical expertise to streamline business processes and improve operational efficiency.Key Responsibilities:Design and implement HCM systems for large-scale organizationsDevelop customized reporting and...