GCP Data Engineer

2 days ago

Bengaluru, India Move Forward Technologies Pvt. Ltd. Full time

GCP Data Engineer (5-8 Years Experience)

Are you passionate about leveraging cutting-edge technologies to build scalable, transformative data solutions? We are seeking an experienced and dynamic GCP Data Engineer to join our innovative team in Bangalore. In this role, you will work on both real-time and batch data systems, ensuring the delivery of high-performance, reliable, and impactful solutions. If you thrive in a fast-paced environment and have a flair for solving complex data challenges, this opportunity is for you

About the Role :

As a GCP Data Engineer, you will play a pivotal role in designing, developing, and implementing advanced data engineering frameworks. Using Google Cloud Platform (GCP) services and big data tools, you will create scalable solutions to process and analyze large volumes of data. Your work will empower our organization to make data-driven decisions, drive innovation, and achieve strategic objectives.

Key Responsibilities :

1. Data Engineering & Framework Development :

- Design and deploy robust data ingestion and transformation pipelines using GCP tools like DataProc, Cloud Composer, and BigQuery.

- Develop solutions for real-time and batch data processing using tools such as Apache Spark, PySpark, and Hadoop.

- Build efficient data storage and retrieval mechanisms that meet performance and scalability requirements.

2. Workflow Orchestration :

- Leverage orchestration tools such as Apache Airflow and Oozie to manage and automate complex workflows.

- Implement monitoring and alerting mechanisms to ensure the seamless execution of data pipelines.

3. Programming & Data Processing :

- Utilize Python and SQL to develop data transformation scripts and optimize queries.

- Integrate data streams in real time using platforms like Apache Kafka, ensuring data consistency and low latency.

4. Data Governance & Open Source Integration :

- Operationalize open-source tools and frameworks while adhering to stringent data governance, compliance, and security policies.

- Ensure data accuracy, quality, and reliability through effective validation processes.

5. Collaboration & Stakeholder Engagement :

- Partner with data analysts, data scientists, and business stakeholders to understand data requirements and deliver solutions aligned with business objectives.

- Provide technical guidance and share best practices with team members to foster a culture of continuous learning.

Key Skills and Expertise :

1. GCP Expertise : In-depth experience with DataProc, Cloud Composer, and BigQuery for managing large-scale data projects in a cloud environment.

2. Big Data Tools : Strong proficiency in big data technologies like Apache Spark, PySpark, Hadoop, and Hive for data processing and analysis.

3. Workflow Orchestration : Hands-on experience with tools like Apache Airflow or Oozie to streamline workflows effectively.

4. Advanced Programming : Expertise in Python, SQL, and real-time data streaming platforms like Kafka.

5. Enterprise-Level SDLC : Proven track record of implementing Software Development Life Cycle (SDLC) in enterprise-level projects over 5-7 years.

Qualifications :

Education : Bachelor's degree in Computer Science, Information Technology, or a related field.

Experience : 5-8 years of experience in data engineering, with a strong focus on GCP services and big data ecosystems.

What We Offer :

- Work on cutting-edge technologies with a forward-thinking team.

- A collaborative and inclusive work culture in the heart of Bangalore.

- Opportunities for professional growth, training, and development.

- Competitive salary and comprehensive benefits package.

Why Join Us?

At our company, we believe in the transformative power of data. As a GCP Data Engineer, you will contribute to shaping our data strategy and play a critical role in driving innovation and business success. Join us to make a real impact while growing your career in a supportive and dynamic environment.

Ready to transform data into actionable insights?

(ref:hirist.tech)

  • Gcp Data Science

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Statistical Modeling**: Strong understanding of statistical techniques and experience leveraging BigQuery ML and Vertex AI for model development. **Machine Learning Algorithms**: Experience with GCP's pre-built ML APIs (e.g., Vision AI, Natural Language API) and custom model building using Vertex AI. **Feature Engineering**: Ability to create meaningful...

  • GCP Lead Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled GCP Lead Engineer to join our team at NTT DATA. This role is ideal for someone with expertise in designing and implementing Google Cloud Platform (GCP) solutions.Key ResponsibilitiesAssess, design, and implement GCP solutions, including compute, network, storage, identity, security, and disaster recovery.Develop and...

  • Gcp data engineer

    6 days ago

    Bengaluru, India Apptad Inc. Full time

    Job Title: GCP Data Engineer - Teradata, ETLJob Location: BangaloreJob Type: PermanentKey Responsibilities:Data Engineering on Google Cloud Platform (GCP):Design, develop, and maintain data pipelines using GCP services such as Big Query, Cloud Storage, Cloud Dataflow, and Pub/Sub.Implement and optimize ETL processes to ensure efficient data transformation...

  • GCP Data Engineer

    1 week ago

    Bengaluru, India Apptad Inc. Full time

    Job Title: GCP Data Engineer - Teradata, ETLJob Location: BangaloreJob Type: PermanentKey Responsibilities:Data Engineering on Google Cloud Platform (GCP):Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub.Implement and optimize ETL processes to ensure efficient data transformation and...

  • GCP Data Engineer

    7 days ago

    Bengaluru, India Apptad Inc. Full time

    Job Title: GCP Data Engineer - Teradata, ETL Job Location: Bangalore Job Type: Permanent Key Responsibilities: Data Engineering on Google Cloud Platform (GCP): Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub. Implement and optimize ETL processes to ensure efficient data...

  • GCP Lead Engineer

    1 month ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 298250 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a GCP Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Mandatory...

  • GCP Data Engineer

    6 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Role - GCP Data EngineerExperience - 5 to 12 yrsLocation - Chennai,Hyderabad,Bangalore,Pune,GurgaonMust Have -Big query, Dataflow , Cloud SQL , Cloud composer , Python , Vertex and Data flowMust-Have· Google Data Engineer (Overall 5+ Years with 2 years relevant experience)· Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging...

  • GCP Data Engineer

    5 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Role - GCP Data Engineer Experience - 5 to 12 yrs Location - Chennai,Hyderabad,Bangalore,Pune,Gurgaon Must Have - Big query, Dataflow , Cloud SQL , Cloud composer , Python , Vertex and Data flow Must-Have · Google Data Engineer (Overall 5+ Years with 2 years relevant experience) · Experience working in GCP based Big Data deployments (Batch/Realtime)...

  • GCP Data Engineers

    3 months ago

    Bengaluru, India Torry Harris Full time

    We are looking for candidates with experience in Cloud Technologies especially GCP. The requirement is for the candidates to be able to independently work on and assist in GCP projects across the organisation wherein on-premise applications would be migrated onto Google Cloud platform and work as an individual contributor. Manage communication with client,...

  • GCP Data Engineer

    3 weeks ago

    Bengaluru / Bangalore, Kolkata, India Zenfinet Solutions Opc Private Limited Full time

    Please find the below JD:Job Title: Data EngineerJob Type: Permanent RoleLocation:Bangalore/Hyderabad/Kolkata/Pune/Noida Inviting applications for the role of Principal / Senior Principal Consultant Google Cloud Platform (GCP) Data Engineer Experience Required - 8 yrs to 12 yrs. In this role, As a GCP Data Engineer a, you will be a key player in...

  • GCP Lead Engineer

    2 months ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 298250 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a GCP Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Mandatory Skills:Technical...

  • GCP Data Engineer

    3 weeks ago

    Bengaluru, India Arting Digital Private Limited Full time

    Position: GCP Data Engineer and DevOps SpecialistExperience: 6-9 YrsLocation: BangaloreNotice Period: Immediate - 60 DaysPrimary Skills: GCP, Devops, Python, GCP Certification is mandatoryRequired Skills and Qualifications:Strong experience with Google Cloud Platform (GCP) services, including BigQuery, Cloud Run, Cloud Functions, Pub/Sub, Dataflow, and Cloud...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as GCP Data Engineer.Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaResponsibilities:BigQuery Development & Optimization:Write and optimize complex SQL queries for efficient data processing and retrieval in BigQuery.Analyze query performance and implement optimization techniques...

  • GCP Data Engineer

    1 month ago

    Greater Bengaluru Area, India Tech Mahindra Full time

    Responsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...

  • GCP Data Engineer

    1 month ago

    Greater Bengaluru Area, India Tech Mahindra Full time

    Responsibilities: • Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. • Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. • Use Pub/Sub for real-time data ingestion and streaming analytics. • Provision and manage GCP infrastructure...

  • Gcp data engineer

    2 weeks ago

    Bengaluru, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as GCP Data Engineer.Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaResponsibilities:Big Query Development & Optimization:Write and optimize complex SQL queries for efficient data processing and retrieval in Big Query.Analyze query performance and implement optimization...

  • GCP Data Stream

    3 weeks ago

    Bengaluru, India Tekgence Inc Full time

    Mandatory Skills: Azure CI/CD pipeline, GCP Cloud, Terraform, Kubernetes, Dataflow, Big Query , GCP DataStream.Azure Devops (CI/CD pipelines), GCP Cloud, Terraform, Docker, Kubernetes, GitHub actions, scriptingADO, Jenkins, GitHubLocation- Pan India, hybrid mode 3 days in a weekEXP range- 7-12Job Role: Senior Cloud Infrastructure Engineer (GCP & Terraform...

  • GCP Data Stream

    3 weeks ago

    Bengaluru, India Tekgence Inc Full time

    Mandatory Skills: Azure CI/CD pipeline, GCP Cloud, Terraform, Kubernetes, Dataflow, Big Query , GCP DataStream. Azure Devops (CI/CD pipelines), GCP Cloud, Terraform, Docker, Kubernetes, GitHub actions, scripting ADO, Jenkins, GitHub Location- Pan India, hybrid mode 3 days in a week EXP range- 7-12 Job Role: Senior Cloud Infrastructure Engineer (GCP &...

  • GCP Data Stream

    3 weeks ago

    Bengaluru, India Tekgence Inc Full time

    Mandatory Skills: Azure CI/CD pipeline, GCP Cloud, Terraform, Kubernetes, Dataflow, Big Query, GCP DataStream.Azure Devops (CI/CD pipelines), GCP Cloud, Terraform, Docker, Kubernetes, GitHub actions, scripting ADO, Jenkins, GitHubLocation- Pan India, hybrid mode 3 days in a weekEXP range- 7-12 Job Role: Senior Cloud Infrastructure Engineer (GCP & Terraform)...

  • GCP Data Stream

    3 weeks ago

    Bengaluru, India Tekgence Inc Full time

    Mandatory Skills: Azure CI/CD pipeline, GCP Cloud, Terraform, Kubernetes, Dataflow, Big Query, GCP DataStream.Azure Devops (CI/CD pipelines), GCP Cloud, Terraform, Docker, Kubernetes, GitHub actions, scripting ADO, Jenkins, GitHubLocation- Pan India, hybrid mode 3 days in a weekEXP range- 7-12 Job Role: Senior Cloud Infrastructure Engineer (GCP & Terraform)...