GCP with PySpark

1 week ago

Cochin, Kerala, India UST Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Role Description
UST is looking for a talented GCP Data Engineer with 5 to 10 years of experience to join our team and play a crucial role in designing and implementing efficient data solutions on the Google Cloud Platform (GCP). The ideal candidate should possess strong data engineering skills, expertise in GCP services, and proficiency in data processing technologies, particularly PySpark.

Responsibilities
Data Pipeline Development:

  • Design, implement, and optimize end-to-end data pipelines on GCP, focusing on scalability and performance.
  • Develop and maintain ETL workflows for seamless data processing.

GCP Cloud Expertise

  • Utilize GCP services such as BigQuery, Cloud Storage, and Dataflow for effective data engineering.
  • Implement and manage data storage solutions on GCP.

Data Transformation With PySpark

  • Leverage PySpark for advanced data transformations, ensuring high-quality and well-structured output.
  • Implement data cleansing, enrichment, and validation processes using PySpark.

Requirements

  • Proven experience as a Data Engineer, with a strong emphasis on GCP.
  • Proficiency in GCP services such as BigQuery, Cloud Storage, and Dataflow.
  • Expertise in PySpark for data processing and analytics is a must.
  • Experience with data modeling, ETL processes, and data warehousing.
  • Proficiency in programming languages such as Python, SQL, or Scala for data processing.
  • Relevant certifications in GCP or data engineering are plus.

Skills
GCP, PySpark

  • Data Engineer

    5 days ago

    Cochin, Kerala, India ChiSquarelabs Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    We are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.IMMEDIATE JOINERS PREFERREDResponsibilitiesBuild & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks.Data Architecture & Engineering: Work on...

  • Senior Python Developer

    3 days ago

    Cochin, Kerala, India EMVIGO TECHNOLOGIES PVT LTD Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Kochi/HybridFull time5+ years ExperienceWe are looking for an experienced Senior Python Developer with a solid foundation in mathematics to join our innovative team. In this role, you will tackle complex challenges, design robust algorithms, and build scalable software solutions that drive impactful results. We value a commitment to clean code, mathematical...

  • MLOPS Engineer

    1 week ago

    India, Cochin / Kochi / Ernakulam Cognizant Full time

    Job Description Role: MLOps Engineer Exp: 5 to 13 years Location: Kochi (AIA Kochi) Key Words -Skillset - AWS SageMaker, Azure ML Studio, GCP Vertex AI - PySpark, Azure Databricks - MLFlow, KubeFlow, AirFlow, Github Actions, AWS CodePipeline - Kubernetes, AKS, Terraform, Fast API Responsibilities - Model Deployment, Model Monitoring, Model Retraining -...

  • Data Science Lead

    6 days ago

    India, Cochin / Kochi / Ernakulam Alight Solutions Full time

    Job Description Our story At Alight, we believe a company's success starts with its people. At our core, we Champion People, help our colleagues Grow with Purpose and true to our name we encourage colleagues to Be Alight. Our Values: Champion People be empathetic and help create a place where everyone belongs. Grow with purpose Be inspired by our higher...