Cloud Data Engineer

4 days ago

Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000
Cloud Data Engineering Specialist

This is an exciting opportunity to work on a project with a focus on integrating and processing channel activity data from multiple sources.

Key Responsibilities:

  • Design, build, and maintain robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data.
  • Work on AWS cloud infrastructure (including services like Pyspark, Glue, EMR, lambda, Redshift, Athena, and other services like Iceberg) and orchestration tools like Airflow to ensure high availability, scalability, and performance.
  • Leverage Python for building automated data engineering solutions and data transformations.
  • Collaborate with cross-functional teams to ensure data from various digital channels is effectively ingested and processed.
  • Contribute to architecture decisions related to data lakes, data warehouses, and big data ecosystems.
  • Ensure data quality, governance, and integrity across all data systems.
  • Engage in continuous learning and adapting of new technologies and industry best practices to improve data processes.

Required Skills and Qualifications:

  • AWS: Strong hands-on experience with AWS technologies such as Pyspark, Glue, EMR, lambda, Redshift, Athena, EC2, and S3.
  • Python: Proficiency in Python for data processing, automation, and pipeline development.
  • Big Data Platforms: Experience with big data technologies like Hadoop and Terradata.
  • Strong Analytical Skills: Ability to analyse and interpret data from different digital channels.
  • Collaboration: Ability to work closely with cross-functional teams, including business analysts, data scientists, and stakeholders.
  • Problem Solving: Strong problem-solving skills and ability to handle complex data-related challenges.
  • Communication: Excellent communication skills, both written and verbal, for documentation and collaboration.

Desirable Qualifications:

  • A degree in Computer Science, Engineering, or a related field.
  • Certifications or experience in AWS Cloud or relevant data engineering tools would be beneficial.
  • Experience in working on snowflake would be good to have.
  • Knowledge of ingesting real-time data (Apache Kafka) would be advantageous.

  • Cloud Data Engineer

    1 week ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data EngineerThe role of a Cloud Data Engineer is to design, build, and maintain large-scale data processing systems in the cloud.

  • Cloud Data Engineer

    1 day ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Cloud Data EngineerWe are seeking an experienced Cloud Data Engineer to design, build, and optimize scalable data pipelines and architectures on Google Cloud Platform.The ideal candidate has hands-on experience with Google Cloud Storage (GCS), BigQuery (BQ), Apache Airflow, and Python programming language.Key Responsibilities:Design and implement...

  • Cloud Data Engineer

    4 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description">About the Role:The ideal candidate will possess experience in data engineering with a focus on cloud-based solutions, and be able to develop, construct, test, and maintain complex data acquisition pipelines for large volumes of structured and unstructured data.Key Responsibilities:Develop and implement data pipelines using cloud services...

  • Cloud Data Engineer

    2 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Engineering Specialist RoleWe are seeking a skilled professional to support our cloud-based data engineering platform. The ideal candidate will have expertise in maintaining and monitoring complex data pipelines, implementing continuous integration and deployment (CI/CD) pipelines, and conducting regular system health checks.Key...

  • Cloud Data Engineering Leader

    6 days ago

    Madurai, Tamil Nadu, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Data Engineering LeaderAbout the Role:We are seeking a highly experienced data engineering leader to spearhead our cloud-first initiatives. As a cloud data engineering leader, you will be responsible for designing and implementing scalable, high-performance data solutions that drive business growth and innovation.Key Responsibilities:Design...

  • Cloud Data Engineer

    7 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Cloud Data EngineerAbout the RoleWe are seeking a skilled data engineer to build and maintain scalable data pipelines that empower business decision-making through advanced analytics. This is an ideal role for those seeking career advancement in the field of data engineering.Key Responsibilities:Collaborate with data science teams to implement...

  • Cloud Data Engineering Lead

    7 days ago

    Madurai, Tamil Nadu, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 17,50,000

    Job Title: Cloud Data Engineering Lead\The role involves overseeing the design, development and configuration of cloud-based data systems to drive business growth.\This position requires a technical leader with expertise in cloud data warehousing, data modeling and ETL processes. The ideal candidate will have at least 5 years of experience in designing and...

  • Leading Cloud Data Engineer

    4 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Cloud Systems EngineerOverview:We are seeking a skilled Cloud Systems Engineer to design and deploy scalable cloud-based systems.Responsibilities:- Design and implement cloud infrastructure using AWS, Azure, or GCP platforms- Develop and deploy cloud-based applications using Spark, Scala, and big data technologies- Collaborate with cross-functional...

  • Cloud Data Engineer

    4 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a skilled Data Engineering professional to design, build and maintain scalable data pipelines and ETL solutions in a cloud environment. The ideal candidate will have hands-on experience with AWS EMR, Glue, PySpark, Airflow and Python, working closely with data analysts, scientists and other engineering teams to support business-driven...

  • Cloud-Based Data Engineer

    7 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Remote Work Freelance Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Cloud-Based Data Engineer Job Description:We are seeking a highly skilled Data Engineer to join our company. The ideal candidate will have a good understanding of cloud-based solutions, data integration, and data cleanup.The successful candidate will design and implement cloud-based solutions using Azure and Google Cloud platforms, automate data pipelines to...