Building Scalable Data Pipelines

1 week ago

Cochin, Kerala, India beBeeData Full time ₹ 10,00,000 - ₹ 20,00,000

Cloud Data Solutions Architect

Job Summary:

We are seeking an experienced Cloud Data Solutions Architect to design and develop scalable cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery.

Key Responsibilities:

  • Design, develop, and optimize robust data ingestion pipelines using GCP services such as Pub/Sub, Dataflow, and Cloud Storage.
  • Architect and manage scalable BigQuery data warehouses to support analytics, reporting, and business intelligence needs.
  • Collaborate with data scientists and ML engineers to support AI/ML workflows using Vertex AI, including model training and deployment.
  • Ensure data quality, reliability, and performance across all pipeline components.
  • Work closely with cross-functional teams to understand data requirements and deliver efficient solutions.
  • Maintain documentation and contribute to best practices in cloud data engineering.

Required Skills & Qualifications:

  • 3-6 years of experience in data engineering, with strong exposure to GCP.
  • Proficiency in GCP services: Pub/Sub, Dataflow, Cloud Storage, and BigQuery.
  • Solid understanding of data modeling, ETL/ELT processes, and performance optimization.
  • Experience with Python, SQL, and cloud-native development practices.
  • Familiarity with CI/CD pipelines and version control (e.g., Git).
  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.

Secondary Skills:

  • Basic understanding of AI/ML workflows and tools within Vertex AI.
  • Ability to discuss model lifecycle, deployment strategies, and integration with data pipelines.
  • Awareness of MLOps principles and cloud-based ML orchestration.

  • Scalable Data Architect

    1 week ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,20,00,000

    Key role of Data Platform Engineer is to design and build scalable data platforms using software engineering skills.This is a hands-on technical position requiring deep technical involvement in building, deploying, and maintaining the data platform.Expertise in programming with focus on Python and computer science fundamentals including data structures,...

  • Chief Data Pipeline Architect

    1 week ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerJob Description:We are seeking an experienced senior data engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation.The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for...

  • Expert Data Pipeline Developer

    1 week ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Key Data Engineer RoleWe are seeking a highly skilled data engineer to take on the challenge of building scalable and efficient data pipelines.Responsibilities:Design, develop, and maintain large-scale data pipelines using Python, PySpark, and SQL.Optimize existing data pipelines for improved performance and efficiency.Collaborate with cross-functional teams...

  • Data Pipeline Engineer

    1 week ago

    Cochin, Kerala, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About this Role:We're seeking a skilled Developer with expertise in building high-performance data pipelines, leveraging Go or Rust.This position is ideal for someone who enjoys working on low-level protocol implementations, understands blockchain mechanics, and can build robust data systems that power real-time analytics engines.Responsibilities...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Summary:We are seeking an experienced Python data engineer to join our organization. As a key member of our data initiatives, you will be responsible for designing and maintaining scalable, reliable data pipelines using Python and orchestration tools.Main Responsibilities:Create robust and scalable data pipelines using Python.Utilize orchestration and...

  • Building Scalable Cloud Systems

    2 weeks ago

    Cochin, Kerala, India beBeeCloudEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Senior Cloud EngineerWe're seeking a Senior Cloud Engineer to join our team.The ideal candidate will have expertise in cloud architecture, software development, and DevOps practices. This is a hands-on technical leadership role, perfect for someone who excels at building scalable, secure, and reliable cloud-native applications on AWS.Your Key...

  • ai - Senior Data Engineer - ETL Pipeline

    2 weeks ago

    Cochin, Kerala, India DBiz Full time

    Position : Senior Data EngineerWe are seeking an experienced Senior Data Engineer to design and implement high-performance data pipelines, ensuring the smooth flow of large datasets across systems.In this role, you will leverage your expertise in Databricks, Pyspark, and ETL design to build efficient data solutions.You will also contribute to optimizing...

  • Experienced Data Pipeline Architect Wanted

    1 week ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 19,32,000 - ₹ 26,16,000

    Seeking an experienced Data Engineer with expertise in designing, developing, and maintaining data pipelines using AWS services.About this opportunity:Collaborate with cross-functional teams to deliver high-quality data solutions.Design, develop, and maintain scalable data pipelines using AWS services such as S3, Lambda, Glue, Redshift, RDS, and EC2.Write...

  • Cloud Data Engineer

    2 weeks ago

    Cochin, Kerala, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data Engineer - Pipelines SpecialistThis is a senior role requiring experience in designing, developing and managing large-scale data pipelines using Oracle Data Flow or Apache Spark.Our ideal candidate will have extensive knowledge of data patterns, Python, and SQL, with a proven track record of successfully orchestrating data workflows and ensuring...

  • Scalable Data Solutions Architect

    1 week ago

    Cochin, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    AI Solutions Designer Role SummaryOur company is seeking a talented Data & AI Solutions Architect to lead the design and delivery of cutting-edge, scalable solutions for global clients.Solution ArchitectureThis role involves working closely with clients to understand their business goals and technical requirements. You will be responsible for designing...