Cloud Data Engineering Specialist

2 days ago

Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,20,48,000 - ₹ 1,41,60,000
Cloud Data Engineering Expert

Job Description:

The ideal candidate will have at least 6 years of experience in data engineering, with a strong background in designing and deploying scalable data pipelines, orchestrating complex workflows, and integrating with APIs and continuous integration/continuous deployment (CI/CD) pipelines. They will also have experience working with tools such as Pyspark, Dataflows, Dataproc, Big Query, Apache Airflow, and Java or Python.

Responsibilities:

  1. Design and deploy high-quality data pipelines using Google Cloud services
  2. Orchestrate workflows using Apache Airflow to ensure efficient and reliable data processing
  3. Integrate with various APIs and CI/CD pipelines to streamline data flow
  4. Manage and process large datasets using Pyspark, Dataflows, and Dataproc to meet business needs
  5. Troubleshoot and document data components, including data architecture, logical and physical data models, database objects, and database administration

Required Skills and Qualifications:

  • At least 6+ years of experience in data engineering with a focus on cloud-based solutions
  • Experience creating, updating, and downloading jobs in Big Query
  • Experience with Pyspark, Dataflows, and Dataproc
  • Experience with Apache Airflow
  • Experience building out data pipelines and utilizing Big Query
  • Experience with Restful or GraphQL APIs
  • Experience designing and deploying pipelines, as well as experience with CI/CD pipelines, GitHub actions, Docker, and Jenkins builds
  • Experience with Java or Python
  • MUST have previous financial or banking industry experience

Preferred Skills:

  • Strong understanding of cloud-based data engineering principles
  • Experience with GCP services such as Big Query, Cloud Storage, and Cloud Dataflow
  • Knowledge of programming languages such as Java, Python, and SQL
  • Experience with agile development methodologies

  • Cloud Data Engineer

    4 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Engineering Specialist RoleWe are seeking a skilled professional to support our cloud-based data engineering platform. The ideal candidate will have expertise in maintaining and monitoring complex data pipelines, implementing continuous integration and deployment (CI/CD) pipelines, and conducting regular system health checks.Key...

  • Cloud Data Engineer

    6 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Cloud Data Engineering SpecialistThis is an exciting opportunity to work on a project with a focus on integrating and processing channel activity data from multiple sources.Key Responsibilities:Design, build, and maintain robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data.Work on...

  • Advanced Cloud Data Specialist

    3 days ago

    Madurai, Tamil Nadu, India beBeeCloud Full time ₹ 17,34,000 - ₹ 25,12,000

    Job Title: Advanced Cloud Data Specialist Job Description:As a leading-edge Cloud Data Specialist, you will be responsible for leveraging your expertise in cloud-based technologies to drive business growth and innovation.With a strong background in data engineering, you will work closely with cross-functional teams to design, implement, and maintain...

  • Cloud Data Engineer

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data EngineerThe role of a Cloud Data Engineer is to design, build, and maintain large-scale data processing systems in the cloud.

  • Cloud Data Engineer

    3 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Cloud Data EngineerWe are seeking an experienced Cloud Data Engineer to design, build, and optimize scalable data pipelines and architectures on Google Cloud Platform.The ideal candidate has hands-on experience with Google Cloud Storage (GCS), BigQuery (BQ), Apache Airflow, and Python programming language.Key Responsibilities:Design and implement...

  • Cloud Data Engineer Position

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title:Big Data SpecialistKey Responsibilities:This role involves designing and implementing scalable data pipelines, ensuring high-quality data processing, and integrating governance metrics into data workflows.The ideal candidate will have hands-on experience with data engineering, strong expertise in Azure Databricks and data storage solutions, and...

  • Cloud Data Engineer

    6 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description">About the Role:The ideal candidate will possess experience in data engineering with a focus on cloud-based solutions, and be able to develop, construct, test, and maintain complex data acquisition pipelines for large volumes of structured and unstructured data.Key Responsibilities:Develop and implement data pipelines using cloud services...

  • Data Engineering Specialist

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering SpecialistDesign, build, and maintain large-scale data pipelines using Spark and SQL. This role involves managing big data flows, collaborating with cross-functional teams, and driving business growth through data insights.About the Role:Create scalable data architectures using cloud-based platforms (AWS, Azure, GCP, Databricks).Analyze and...

  • Cloud Data Engineering Leader

    1 week ago

    Madurai, Tamil Nadu, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Data Engineering LeaderAbout the Role:We are seeking a highly experienced data engineering leader to spearhead our cloud-first initiatives. As a cloud data engineering leader, you will be responsible for designing and implementing scalable, high-performance data solutions that drive business growth and innovation.Key Responsibilities:Design...

  • Cloud Engineer Position

    1 week ago

    Madurai, Tamil Nadu, India beBeeCloud Full time ₹ 67,89,000 - ₹ 1,03,98,700

    Cloud Infrastructure SpecialistAbout Us:We guide customers from what's now to what's next by unlocking the value of their data and applications.Key focus areas include Digital Transformation, Enterprise AI, Data & Analytics, and Product Engineering—reflecting our strategic commitment to driving innovation and value for clients across industries.Job...