Cloud Engineer for Large-Scale Data Projects

1 week ago

Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

Job Overview

We are seeking a skilled Cloud Engineer to design and implement large-scale data pipelines using Google Cloud services.

About the Role

  • Design and Develop: Build efficient data pipelines using GCP services such as Big Query, Dataflows, and Dataproc.
  • Workflows Orchestration: Utilize Apache Airflow to orchestrate complex workflows.
  • Data Processing: Process and transform data using ETL techniques.
  • Integration: Integrate with Restful or GraphQL APIs.
  • Collaboration: Work closely with cross-functional teams to design and deploy pipelines.

Requirements

  • 6+ years of experience in data engineering (not big data).
  • Experience creating, updating, and downloading jobs in Big Query.
  • Proficiency in Pyspark, Dataflows, and Dataproc.
  • Experience with Java or Python programming languages.
  • Previous financial or banking experience required.

What We Offer

  • A challenging opportunity to work on large-scale projects.
  • The chance to collaborate with experienced professionals in the field.
  • Ongoing training and development opportunities.

Preferred Qualifications

  • Experience with CI/CD pipelines, GitHub actions, Docker, and Jenkins builds.

About Us

We are a leading provider of workforce solutions. We offer a range of benefits and support to our employees, including flexible working arrangements, professional development opportunities, and a positive work environment.

  • Cloud-Ready Data Engineer for Large Scale Solutions

    1 week ago

    Bengaluru, Karnataka, India beBeeBigDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Title:** Big Data Engineer for Cloud Solutions**Job Summary:A prominent data engineer is required to design, develop, and maintain large-scale data systems on Azure.Experience in Azure Data Factory, Azure Databricks, Synapse Analytics, PySpark, Python, and PL/SQL programmingStrong experience in establishing cloud connectivity between different...

  • Data Engineer for Large-Scale Data Systems

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,12,000

    As a key member of our analytics team, we are seeking a seasoned professional to play a critical role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Develop efficient ETL pipelines as per business requirements, following development standards and best practices.Perform integration testing of different created pipelines...

  • Large Scale Cloud Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    AWS DevOps Engineer RoleAs a seasoned AWS DevOps engineer, you will be responsible for designing, implementing, and maintaining large-scale systems on the AWS platform.

  • Data Architect for Large-Scale Data Systems

    2 weeks ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a seasoned Data Engineer to develop and maintain large-scale data systems. This role involves designing, building, and deploying data architectures that enable business growth, analytics, and machine learning needs. The ideal candidate will have extensive experience working with big data technologies, including Spark, Java/Scala, and cloud...

  • Data Engineer for Large-Scale Data Pipelines

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 26,00,000

    Job Title: Senior Data EngineerDescription:We are seeking a highly skilled data engineer to design, develop, and maintain large-scale data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform, and then integrate it into Oracle EPM for financial planning, reporting, and analytics.Key...

  • Scala Developer for Large-Scale Data Engineering Solutions

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe're seeking a skilled Data Engineer to join our team. Our ideal candidate will have strong expertise in Scala & Spark, hands-on experience with HDFS, Hive, Oozie, and Yarn, and solid knowledge of Unit Testing frameworks.Main Responsibilities:Design and develop scalable data engineering solutions using Scala & SparkWork with large-scale...

  • Cloud Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeInfrastructure Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About Our Infrastructure TeamWe design, operate and scale a hybrid cloud architecture that meets the evolving needs of our business. As a member of this team, you will be working closely with cross-functional teams to deliver reliable, high-performance systems at scale.Our engineers focus on solving real-world challenges through scalable architecture,...

  • Large Scale Data Solutions Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:">The Data Engineering Lead is responsible for building and managing large-scale data pipelines and data warehousing solutions using Snowflake.">">Key Responsibilities:">">">Design, develop, and maintain scalable data pipelines using Snowflake.">Build and optimize data models, schemas, and data warehouses for performance and efficiency.">Perform...

  • Cyber Infrastructure Engineer

    7 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

    Data Pipeline SpecialistWe are seeking a skilled Data Pipeline Specialist to oversee the development, implementation, and maintenance of large-scale data pipeline platforms. The ideal candidate will have hands-on experience deploying and managing products like Cribl, Logstash, or Apache NiFi.Key responsibilities include collaborating with cross-functional...

  • Senior Cloud Engineer – Large Scale Distributed Systems

    6 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 55,00,000 - ₹ 85,00,000

    Big Data Architect SDE II Job Opening">Location: Bengaluru (Work From Office)Experience: 3–6 yearsSigmoid partners with start-ups and Fortune 500 companies to build world-class, large-scale Big Data architectures.We are looking for a detail-oriented and passionate Data Engineer (SDE II) to join our growing team.What You'll DoDesign & develop scalable data...