Data Engineer

1 day ago

Bangalore, India IntraEdge Full time

Job Title: GCP Data Engineer

Location: Bangalore/ Chennai-Hybrid

Experience: 5+ Years

Employment Type: Full-time

Job Summary

We are seeking a skilled GCP Data Engineer to design, build, and optimize data pipelines and architectures on Google Cloud Platform (GCP). The ideal candidate will have expertise in cloud-based data engineering, large-scale data processing, and hands-on experience with GCP services.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL processes on GCP.
  • Build and optimize data lake and data warehouse solutions using BigQuery, Cloud Storage, and related services.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver reliable, high-quality data solutions.
  • Implement data quality, governance, and security best practices.
  • Work with real-time streaming data pipelines using Pub/Sub, Dataflow, or Kafka.
  • Automate workflows with Cloud Composer (Airflow) or similar orchestration tools.
  • Monitor, troubleshoot, and optimize system performance and data reliability.
  • Support migration of legacy systems to cloud-native GCP architectures .

Required Skills & Qualifications

  • Bachelor’s/Master’s degree in Computer Science, Information Technology, or related field.
  • 3+ years of experience in Data Engineering (with at least 2 years on GCP ).
  • Strong expertise with GCP services :
  • BigQuery, Pub/Sub, Dataflow, Cloud Storage, Cloud Composer, Dataproc.
  • Proficiency in SQL and Python (PySpark or Pandas experience preferred).
  • Strong experience in building and managing ETL/ELT pipelines .
  • Hands-on knowledge of data modeling, schema design, and partitioning strategies .
  • Familiarity with DevOps/CI-CD for data pipelines (Cloud Build, Git, Terraform).
  • Experience with streaming and batch data processing frameworks (Apache Beam, Spark).
  • Understanding of data security, IAM roles, and compliance practices in GCP.

Preferred Skills

  • Experience with machine learning pipelines on GCP (AI/ML APIs, Vertex AI).
  • Exposure to other cloud platforms (AWS, Azure) is a plus.
  • Knowledge of Kubernetes (GKE) and containerization (Docker).
  • Familiarity with business intelligence tools (Looker, Tableau, Power BI).

Soft Skills

  • Strong problem-solving and analytical skills.
  • Ability to communicate technical solutions clearly to non-technical stakeholders.
  • Team player with a collaborative mindset.
  • Self-motivated and able to work in a fast-paced environment.

  • Data Engineer

    12 hours ago

    bangalore, India Bahwan CyberTek Full time

    Job Title: Data Engineer – Google Cloud Platform (GCP) Job Summary We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a...

  • Data Engineer

    1 day ago

    Bangalore, India Synechron Full time

    Good-day, We have immediate opportunity for Data Engineer. Job Role: Data Engineer Job Location: Synechron ( Bengaluru) Experience- 7 to 12 years Notice : Only immediate joiner . About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity...

  • Data Engineer

    10 hours ago

    bangalore, India Synechron Full time

    Good-day,We have immediate opportunity for Data Engineer.Job Role: Data EngineerJob Location: Synechron ( Bengaluru)Experience- 7 to 12 yearsNotice : Only immediate joiner .About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver...

  • Data Engineer

    1 day ago

    Bangalore, India Alp Consulting Ltd. Full time

    Role: Data Engineer Location : Bangalore Experience: 3 to 8Years SKILLS & CERTIFICATIONS Strong interest and acumen for solving large-scale data engineering problems. Hands-on technical and functional experience in building large scale data engineering capabilities in diverse big-data environments Strong hands-on expertise in data...

  • Data Engineer

    9 hours ago

    bangalore, India Alp Consulting Ltd. Full time

    Role: Data EngineerLocation : BangaloreExperience: 3 to 8YearsSKILLS & CERTIFICATIONSStrong interest and acumen for solving large-scale data engineering problems.Hands-on technical and functional experience in building large scale data engineering capabilities in diverse big-data environmentsStrong hands-on expertise in data engineering:Enterprise grade ETL...

  • Data Engineer

    12 hours ago

    bangalore, India Insight Global Full time

    100% Remote Data Engineer Required Skills & Experience5+ years of experience as a Data EngineerExpertise in Python, Pyspark and SQLHands-on Python/PySpark coding experienceStrong Big Data experience, GCP preferredTelemetry experienceStreaming experience with analytics and data processingBusiness analytics experience and working directly with business...

  • Data Engineer

    1 day ago

    Bangalore, India Recro Full time

    Role - Data Engineer Location - Bangalore Experience - 2-4 Yrs Key Responsibilities Design, build, and optimize scalable data pipelines for batch and real-time data processing. Develop and maintain ETL (Extract, Transform, Load) processes to integrate data from multiple sources. Manage and optimize data storage solutions (data warehouses,...

  • Data Engineer

    10 hours ago

    bangalore, India Recro Full time

    Role - Data EngineerLocation - BangaloreExperience - 2-4 YrsKey ResponsibilitiesDesign, build, and optimize scalable data pipelines for batch and real-time data processing.Develop and maintain ETL (Extract, Transform, Load) processes to integrate data from multiple sources.Manage and optimize data storage solutions (data warehouses, data lakes, relational...

  • Data Engineer

    11 hours ago

    bangalore, India VAANTECH Full time

    We’re Hiring: Data EngineerPosition: Data EngineerExperience Required: 3+ YearsNotice Period: Immediate Joiner (or within 15 days)Location: Chennai (Remote)Shift: Includes Night Shifts (US Shift)Preferred Candidates: From Chennai, Andhra Pradesh, Kerala & BangaloreSkills We’re Looking For:SQL, Python, ETLApache AirflowData Pipeline Optimization &...

  • Data Engineer

    10 hours ago

    bangalore, India R Systems Full time

    Job Title: Data EngineerContract Period: 12 MonthsLocation: Offshore candidates accepted (Singapore Based Company)Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)ExperienceMinimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)Proven experience in Python, Spark, and PySpark...