Cloud Data Engineer

1 day ago

Mohali, Punjab, India beBeeDataEngineering Full time US$ 90,000 - US$ 1,20,000

Job Title : Data Engineering Specialist

Location : Nationwide

Experience : 3+ years of experience in data engineering with hands-on knowledge of Google Cloud Platform (GCP)

Job Description :

We are seeking a skilled and passionate data engineering specialist to join our team. The ideal candidate will have expertise in building and maintaining scalable data pipelines, utilizing GCP services such as Google Cloud Storage (GCS), PubSub, Dataflow or DataProc, BigQuery, and Airflow/Composer.

Key Responsibilities :

GCP Services :
- Design, develop, and manage data pipelines leveraging GCP services for efficient data ingestion, storage, and processing.
- Work on Python (preferred) or Java-based solutions to build robust, scalable, and efficient data pipelines.

ETL on GCP Cloud :
- Develop and maintain ETL pipelines using Python/Java, ensuring data is processed efficiently and accurately.
- Write efficient scripts, adhere to best practices for data ingestion, transformation, and storage on GCP.
- Troubleshoot and solve data pipeline challenges, ensuring high performance and reliability.

Data Ingestion (Batch and Streaming) :
- Implement batch and streaming data ingestion workflows on GCP.
- Design, optimize, and monitor data pipelines for both batch processing and real-time streaming, ensuring smooth and seamless data flow.

Database Expertise :
- Knowledge of relational (SQL) and non-relational (NoSQL) databases both on-premise and in the cloud.
- Understanding the differences between SQL and NoSQL databases and experience working with at least two types of NoSQL databases.
- Expertise in working with databases on GCP, including BigQuery and others.

Data Warehouse Concepts :
- Apply your knowledge of data warehouse concepts to assist in designing efficient storage and processing solutions for large datasets.
- Familiarity with the principles of data warehousing, from data modeling to ETL processes, is required at a beginner to intermediate level.

Technical Skills Required :

  • GCP Services : GCS, PubSub, Dataflow, DataProc, BigQuery, Airflow/Composer
  • Programming : Python, Java
  • ETL Development : Data pipelines, Scripting
  • Data Ingestion : Batch, Streaming
  • Databases : SQL, NoSQL
  • Data Warehousing : Data Warehouse Concepts


What We Offer :
- Opportunity to work on challenging projects and collaborate with experienced professionals.
- Flexible work environment with opportunities for growth and development.
- Competitive compensation package with benefits.

  • Data Engineer

    1 week ago

    Mohali, Punjab, India True North Marine an Accelleron Company Full time

    The Digital Customer Solutions department at Accelleron is developing performance and condition-based maintenance solutions. We are looking for a dedicated, motivated, and highly skilled Data Engineer with strong Python skills and extensive experience in building from scratch, maintaining and automating data pipelines. The candidate will be part of an agile...

  • Data Engineer

    4 days ago

    Mohali, Punjab, India True North Marine an Accelleron Company Full time

    The Digital Customer Solutions department at Accelleron is developing performance and condition-based maintenance solutions. We are looking for a dedicated, motivated, and highly skilled Data Engineer with strong Python skills and extensive experience in building from scratch, maintaining and automating data pipelines. The candidate will be part of an agile...

  • Data Engineer

    13 hours ago

    Mohali, Punjab, India HRS Group Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Hrs As a CompanyHRS, a pioneer in business travel, aims to elevate every stay through innovative technology. With over 50 years of experience, their digital platform, driven by ProcureTech, TravelTech, and FinTech, transforms how companies and travelers Stay, Work, and Pay.ProcureTech digitally revolutionizes lodging procurement, connecting corporations and...

  • Data Engineer

    14 hours ago

    Mohali, Punjab, India DataCouch Full time US$ 90,000 - US$ 1,20,000 per year

    Technologies We Work With At Data Couch, you'll gain exposure to a wide range of modern tools and technologies, including: ● Big Data: Apache Spark, Hadoop, Hive, HBase, Pig ● Cloud Platforms: AWS, GCP, Microsoft Azure ● Programming: Python, Scala, SQL, PySpark ● DevOps & Orchestration: Kubernetes, Docker, Jenkins, Terraform...

  • Senior Data Scientist

    3 weeks ago

    Mohali, Punjab, India Harmony Data Integration Technologies Pvt. Ltd. Full time

    Key Responsibilities :- End-to-End ML Pipeline Development : Design, code, test, and deploy robust machine learning pipelines-from data collection and preprocessing to model training and production deployment.- Computer Vision & Object Detection : Develop and fine-tune algorithms for computer vision applications using tools like Ultralytics YOLO and OpenCV,...

  • Cloud Engineer

    4 weeks ago

    Mohali, Punjab, India Americana Restaurants Full time

    SRE:Azure KubernetesAzure Certified Administrator –Ecommerce Large scale cloud projectsAzure Frontdoor , WAF, APIMSRE IAC Terrafarm – Automations, MonitoringDatabase - mongo, sqlB Tech Engineering Computers

  • Azure Cloud Engineer

    2 weeks ago

    Mohali, Punjab, India RevClerx Pvt Ltd Full time

    Location: MohaliExperience: 3+ years Shift : 9PM to 6 AM ISTAbout Us:We're looking for a talented Azure Cloud Engineer to design, build, and deploy cutting-edge cloud solutions for our clients. If you're passionate about Azure development, automation, AI/ML, and delivering client-centric solutions, we'd love to have you on our teamKey Responsibilities- ...

  • Azure Cloud Engineer

    2 weeks ago

    Mohali, Punjab, India RevClerx Pvt Ltd Full time

     Location: Mohali Experience: 3+ years Shift : 9PM to 6 AM ISTAbout Us: We're looking for a talented Azure Cloud Engineer to design, build, and deploy cutting-edge cloud solutions for our clients. If you're passionate about Azure development, automation, AI/ML, and delivering client-centric solutions, we'd love to have you on our team Key Responsibilities...

  • Azure Cloud Engineer

    14 hours ago

    Mohali, Punjab, India Revclerx Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking an Azure Cloud Engineer with Cloud development expertise to design, build, and deploy cloud solutions for our clients. This role combines Azure development, and client consulting.Key Responsibilities •Cloud Development: Build scalable Azure applications using App Services, Functions, and Container Services •AI Integration: Implement AI...

  • IT Director, Cloud Engineering

    13 hours ago

    Mohali, Punjab, India TaskUs Full time ₹ 2,00,00,000 - ₹ 2,50,00,000 per year

    About TaskUs: TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies, helping its clients represent, protect and grow their brands. Leveraging a cloud-based infrastructure, TaskUs serves clients in the fastest-growing sectors, including social media, e-commerce, gaming, streaming...