Cloud Data Engineer

2 days ago

Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000
Job Description">

About the Role:

The ideal candidate will possess experience in data engineering with a focus on cloud-based solutions, and be able to develop, construct, test, and maintain complex data acquisition pipelines for large volumes of structured and unstructured data.

Key Responsibilities:

  • Develop and implement data pipelines using cloud services such as Cloud Data Fusion, Cloud Functions, Cloud Run, Pub Sub, BigQuery, and Cloud Storage
  • Build large and complex datasets based on business requirements
  • Construct scalable 'big data' pipeline architecture
  • Identify opportunities for data acquisition via collaboration with stakeholders and business clients
  • Translate business needs to technical requirements
  • Leverage various tools within the Google Cloud Ecosystem
  • Use logs & alerts to effectively monitor pipelines
  • Develop JSON messaging structure for integrating with multiple applications
  • Leverage DevOps and CI/CD practices to ensure the reliability and scalability of data pipelines
  • Partition/Cluster and retrieve content in Big Query, utilizing IAM roles & Policy Tags to secure data
  • Design and build an ingestion pipeline using Rest API
  • Recommends ways to improve data quality, reliability, and efficiency

Required Skills and Qualifications

  • Requires 5-7 years of experience in a data engineering role – with core GCP experience of 3-4 years
  • Ability to work flexible hours, including occasional extended work periods

  • Cloud Data Engineer

    1 week ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data EngineerThe role of a Cloud Data Engineer is to design, build, and maintain large-scale data processing systems in the cloud.

  • Cloud Data Engineer

    2 hours ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Engineering Specialist RoleWe are seeking a skilled professional to support our cloud-based data engineering platform. The ideal candidate will have expertise in maintaining and monitoring complex data pipelines, implementing continuous integration and deployment (CI/CD) pipelines, and conducting regular system health checks.Key...

  • Cloud Data Engineering Leader

    4 days ago

    Madurai, Tamil Nadu, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Data Engineering LeaderAbout the Role:We are seeking a highly experienced data engineering leader to spearhead our cloud-first initiatives. As a cloud data engineering leader, you will be responsible for designing and implementing scalable, high-performance data solutions that drive business growth and innovation.Key Responsibilities:Design...

  • Cloud Data Engineer

    5 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Cloud Data EngineerAbout the RoleWe are seeking a skilled data engineer to build and maintain scalable data pipelines that empower business decision-making through advanced analytics. This is an ideal role for those seeking career advancement in the field of data engineering.Key Responsibilities:Collaborate with data science teams to implement...

  • Cloud Data Engineer

    2 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Cloud Data Engineering SpecialistThis is an exciting opportunity to work on a project with a focus on integrating and processing channel activity data from multiple sources.Key Responsibilities:Design, build, and maintain robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data.Work on...

  • Cloud Data Engineering Lead

    5 days ago

    Madurai, Tamil Nadu, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 17,50,000

    Job Title: Cloud Data Engineering Lead\The role involves overseeing the design, development and configuration of cloud-based data systems to drive business growth.\This position requires a technical leader with expertise in cloud data warehousing, data modeling and ETL processes. The ideal candidate will have at least 5 years of experience in designing and...

  • Leading Cloud Data Engineer

    2 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Cloud Systems EngineerOverview:We are seeking a skilled Cloud Systems Engineer to design and deploy scalable cloud-based systems.Responsibilities:- Design and implement cloud infrastructure using AWS, Azure, or GCP platforms- Develop and deploy cloud-based applications using Spark, Scala, and big data technologies- Collaborate with cross-functional...

  • Cloud Data Engineer

    2 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a skilled Data Engineering professional to design, build and maintain scalable data pipelines and ETL solutions in a cloud environment. The ideal candidate will have hands-on experience with AWS EMR, Glue, PySpark, Airflow and Python, working closely with data analysts, scientists and other engineering teams to support business-driven...

  • Cloud-Based Data Engineer

    5 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Remote Work Freelance Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Cloud-Based Data Engineer Job Description:We are seeking a highly skilled Data Engineer to join our company. The ideal candidate will have a good understanding of cloud-based solutions, data integration, and data cleanup.The successful candidate will design and implement cloud-based solutions using Azure and Google Cloud platforms, automate data pipelines to...

  • Cloud Data Engineer

    2 hours ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Architect - Cloud Engineering RoleKey Responsibilities:We are looking for a skilled data architect to lead the design, development and maintenance of scalable data pipelines and ETL/ELT solutions using cloud services.The ideal candidate will have experience in ingesting, processing, and storing structured and unstructured data from various sources such...