Cloud Computing Data Engineer

2 weeks ago

Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,51,40,000 - ₹ 2,01,10,000

Job Title: Data Engineer - Cloud Computing

Description:

We are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using Google Cloud technologies.

Your primary focus will be on developing and implementing data acquisition pipelines that can handle structured and unstructured data in real-time. You will work closely with stakeholders and business clients to identify opportunities for data acquisition and translate business needs into technical requirements.

You will leverage various tools in the Google Cloud Ecosystem, including Python, Data Flow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, and Cloud Storage, to integrate systems and data pipelines. Additionally, you will use logs and alerts to effectively monitor pipelines and ensure their reliability and scalability.

Other key responsibilities include:

  • Designing and building an ingestion pipeline using Rest API
  • Partitioning and clustering data in Big Query
  • Securing data access using IAM roles and Policy Tags
  • Developing JSON messaging structure for integrating with various applications
  • Leveraging DevOps and CI/CD practices to ensure the reliability and scalability of data pipelines

Requirements:

To be successful in this role, you will need:

  • 5-7 years of experience in a data engineering role, with core GCP experience of 3-4 years
  • Excellent communication skills
  • Strong problem-solving skills
  • Able to work independently and collaboratively as part of a team

Benefits:

This is a long-term contract opportunity with immediate availability. The working hours will be in US CST time zone, with occasional flexibility to adjust work hours by 1-2 hours per month. You will have the opportunity to work on complex projects, develop your skills, and contribute to the growth of the company.

  • Senior Data Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering LeadWe are seeking a highly skilled Data Engineering Lead to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines for batch and real-time processing using GCP tools.In this role, you will construct large datasets to meet diverse business...

  • Cloud Data Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title:Data Integration SpecialistJob Description:In a fast-paced and innovative work environment, we seek an experienced Data Integration Specialist to collaborate with our team in developing robust data pipelines for processing channel activity data from multiple sources. This role requires strong expertise in AWS cloud infrastructure, big data...

  • Cloud Data Engineering Opportunities

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineer RoleAbout Us :Our organization empowers clients to achieve success and unlock growth opportunities through deep engineering expertise, innovative solutions, and collaboration.Job Description:You will play a crucial role in driving our clients' success by designing, implementing, and maintaining large-scale data processing systems on...

  • Cloud Computing Specialist

    1 week ago

    Hubli, Karnataka, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Computing ProfessionalWe are seeking a highly skilled Cloud Computing professional to join our team. As a key member of our organization, you will be responsible for designing and implementing cloud-based solutions that meet the needs of our clients.Key Responsibilities:Design and implement cloud-based solutions using Google Cloud Platform...

  • Cloud Data Solutions Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a highly skilled Cloud Data Solutions Engineer with strong expertise in Python development and cloud-based data solutions. The ideal candidate will have a solid background in data migration, API ecosystem development, and modern data warehousing practices.This role involves building, optimizing, and maintaining scalable data...

  • Cloud Computing Specialist with Big Data Analytics

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About Blue Cloud Softech Solutions LimitedWe believe that data and analytics are strategic drivers for future success. Our advanced analytics team will solve complex problems, deliver topline growth, and operational efficiencies across our business.About the RoleAs a Cloud Data Engineer, you will manage our cloud data platform, make it more scalable,...

  • Cloud Data Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Cloud Data EngineerKey ResponsibilitiesDesign, develop and maintain large-scale data processing systems on cloud platforms.Develop and implement data pipelines using cloud services such as BigQuery, Dataflow and Cloud Composer.Collaborate with cross-functional teams to integrate data solutions with business requirements.Ensure high-quality data...

  • Data Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineer Full time US$ 1,80,000 - US$ 2,50,000

    Job OverviewWe are seeking a seasoned Data Engineer to design, develop, and maintain scalable data platforms. The ideal candidate will have extensive experience in data engineering, cloud infrastructure, and strong DevOps/SRE skills.The successful candidate will be responsible for:Designing and implementing efficient data pipelines to extract, transform, and...

  • Principal Cloud Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeSolution Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    Cloud Solution ArchitectJob Summary:We are seeking a highly skilled Cloud Solution Architect to design and develop cloud-based solutions using AWS, Azure, and GCP.Key Responsibilities:Design and develop scalable cloud architectures for our clients' applications.Work with big data technologies such as Spark, Scala, Hadoop, and NoSQL databases to process and...

  • Cloud Data Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,70,88,000 - ₹ 2,41,12,000

    Job Title: Cloud Data EngineerWe are seeking a highly skilled data engineer to join our team.The ideal candidate will be responsible for designing, implementing and optimizing data pipelines on our data platform.Data Pipeline Development: Design, develop and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data...