Cloud Data Engineer

5 days ago

chennai, India beBeeData Full time

Cloud Data Engineer - BigQueryWe are seeking a highly skilled Cloud Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and optimizing data pipelines and solutions for large-scale data processing and analytics.Key Responsibilities:Design and develop data pipelines using cloud services such as Dataflow, Dataproc, Pub/Sub, and Cloud SQL.Implement and optimize BigQuery for large-scale data analytics.Build and maintain ETL workflows using Apache Airflow.Develop scripts and automation using Python, Pandas, and NumPy.Ensure data quality, security, and compliance across all processes.Collaborate with data scientists, analysts, and business stakeholders to deliver robust data solutions.Required Skills and Qualifications:Strong experience in Google Cloud Platform (GCP).Expertise in BigQuery, Dataflow, Dataproc, Cloud SQL, Cloud Spanner, and Pub/Sub.Proficiency in ETL development and workflow orchestration using Apache Airflow.Advanced programming skills in Python, with experience in Pandas and NumPy.Solid understanding of data modeling, data warehousing, and distributed systems.Benefits:Experience with streaming data pipelines.Knowledge of machine learning workflows on GCP.Familiarity with CI/CD for data engineering.Others:Bachelor's or master's degree in computer science, Data Engineering, or related field.

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time

    Senior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - 8+ years Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.

  • Data Engineer

    13 hours ago

    Chennai, Tamil Nadu, India CX Data Labs Full time

    HiRole - Azure Data engineerLocation - Chennai, GurugramWork from officeFull timeImmediate joiner Only (15days Notice period only)Candidates with Certification in Databricks is good to haveTechnical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o...

  • Cloud Data Engineer

    7 days ago

    Chennai, India Giggso Full time

    Key Responsibilities: • Design, develop, and maintain cloud-based solutions on Azure or AWS. • Implement and manage real-time data streaming and messaging systems using Kafka. • Develop scalable applications and services using Java and Python. • Deploy, manage, and monitor containerized applications using Kubernetes. • Build and optimize big data...

  • Cloud Data Engineer

    7 days ago

    Chennai, India Giggso Full time

    Key Responsibilities:• Design, develop, and maintain cloud-based solutions on Azure or AWS.• Implement and manage real-time data streaming and messaging systems using Kafka.• Develop scalable applications and services using Java and Python.• Deploy, manage, and monitor containerized applications using Kubernetes.• Build and optimize big data...

  • Cloud Data Engineer

    7 days ago

    Chennai, India Giggso Full time

    Key Responsibilities:• Design, develop, and maintain cloud-based solutions on Azure or AWS.• Implement and manage real-time data streaming and messaging systems using Kafka.• Develop scalable applications and services using Java and Python.• Deploy, manage, and monitor containerized applications using Kubernetes.• Build and optimize big data...

  • Cloud Data Engineer

    7 days ago

    Chennai, India Giggso Full time

    Key Responsibilities: • Design, develop, and maintain cloud-based solutions on Azure or AWS. • Implement and manage real-time data streaming and messaging systems using Kafka. • Develop scalable applications and services using Java and Python. • Deploy, manage, and monitor containerized applications using Kubernetes. • Build and optimize big data...

  • Cloud Data Engineer

    7 days ago

    Chennai, India Giggso Full time

    Key Responsibilities:• Design, develop, and maintain cloud-based solutions on Azure or AWS.• Implement and manage real-time data streaming and messaging systems using Kafka.• Develop scalable applications and services using Java and Python.• Deploy, manage, and monitor containerized applications using Kubernetes.• Build and optimize big data...

  • Cloud Data Engineer

    6 days ago

    Chennai, India Giggso Full time

    Key Responsibilities:• Design, develop, and maintain cloud-based solutions on Azure or AWS.• Implement and manage real-time data streaming and messaging systems using Kafka.• Develop scalable applications and services using Java and Python.• Deploy, manage, and monitor containerized applications using Kubernetes.• Build and optimize big data...

  • Cloud Data Engineer

    6 days ago

    Chennai, India Giggso Full time

    Key Responsibilities: - Design, develop, and maintain cloud-based solutions on Azure or AWS.- Implement and manage real-time data streaming and messaging systems using Kafka.- Develop scalable applications and services using Java and Python.- Deploy, manage, and monitor containerized applications using Kubernetes.- Build and optimize big data processing...

  • Cloud Data Engineer

    5 days ago

    Chennai, India Giggso Full time

    Key Responsibilities: • Design, develop, and maintain cloud-based solutions on Azure or AWS. • Implement and manage real-time data streaming and messaging systems using Kafka. • Develop scalable applications and services using Java and Python. • Deploy, manage, and monitor containerized applications using Kubernetes. • Build and optimize big data...