Current jobs related to GCP Data Stream - Bangalore - Tekgence Inc
-
GCP Data Engineer
2 months ago
bangalore, India Tech Mahindra Full timeResponsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...
-
GCP Data Engineer
2 months ago
bangalore, India Tech Mahindra Full timeResponsibilities: • Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. • Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. • Use Pub/Sub for real-time data ingestion and streaming analytics. • Provision and manage GCP infrastructure...
-
GCP Data Engineer
2 months ago
Bangalore Metropolitan Area, India Tech Mahindra Full timeResponsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...
-
bangalore, India Live Connections Full timeLocation: Bangalore \ Hyderabad \ ChennaiJob Type: Hybrid ModelShift timing: 12:00 PM -9:00 PM6+ years experience in data engineering. Including performance optimization of large OLPExpertise in Google Cloud Platform Databases (SQL, Spanner, PostgreSQL)Solid knowledge of relational/NoSQL databasesExperience with data streaming technology(i.e. Kafka,...
-
Senior data engineer
2 weeks ago
Bangalore, India Quantiphi Full timeJob Role: Senior Data Engineer Experience: 4-8 years Location: Mumbai/Pune/Bangalore/Trivandrum/Remote As a Senior Data Engineer at Quantiphi, you will lead our ingenious data engineering teams in creating transformational solutions involving cloud migration and advanced data engineering workloads. Required Skills: ● Experience: 4+ years...
-
Gcp data engineer
2 months ago
Bangalore, India Tata Consultancy Services Full timeGreetings from TCS!! TCS is hiring for GCP Data Engineer Desired Experience Range: 5+ Years Job Location: Gurgaon / Bangalore / Pune/ Chennai / Mumbai Key responsibilities: As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and...
-
bangalore, India Live Connections Full timeLocation: Bangalore \ Hyderabad \ Chennai Job Type: Hybrid Model Shift timing: 12:00 PM -9:00 PM 6+ years experience in data engineering. Including performance optimization of large OLP Expertise in Google Cloud Platform Databases (SQL, Spanner, PostgreSQL) Solid knowledge of relational/NoSQL databases Experience with data streaming technology(i.e....
-
Gcp data engineer
3 weeks ago
Bangalore, India Deloitte Full timeHi, We are looking for Candidates who are having experience as GCP Data Engineer. Experience Required: 5+ years. Location: Bengaluru, Karnataka, India Responsibilities: Big Query Development & Optimization: Write and optimize complex SQL queries for efficient data processing and retrieval in Big Query. Analyze query performance and implement...
-
Gcp Architect
2 weeks ago
Bangalore Urban District, Karnataka, India Appsierra Full timeJob Location : Bangalore, Chennai, Kolkata, Gurugram, Pune **Primary Roles and Responsibilities**: - Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities - Develop and maintain data pipelines implementing ETL process, monitoring performance and advising any necessary infrastructure changes - Translate...
-
Data engineer
2 months ago
Bangalore, India Tech Mahindra Full timeis for GCP Data Engineer. If you're an experienced professional looking for an exciting new challenge. We want to hear from you! Please apply to with your resume explaining your experience and qualifications. Location : Pan India GCP Data Engineer : U2 – up to 3 years Primary Skill : Big Querry, Data flow, Data Composer, SQL,...
-
Lead engineer | webrtc
2 weeks ago
Bangalore, India FyndBridge Consultants & Advisors Full timeLead Engineer, Web RTC & Streaming Location: Bangalore Job Type: Full-time ________________________________________________________________________________ Company Overview ---------------- Our Client is a groundbreaking ed-tech start-up redefining the after-school learning space through AI-powered, personalized learning solutions. Since launching...
-
Data Inc | Data Architect
2 weeks ago
bangalore, India Data Inc Full timeKey accountabilities include:Subject matter expert on the Data Value Stream Enabler which contains data architecture current state, future state, and roadmap for the transition.Collaborate with stakeholders across various value streams to understand their requirements, data architecture plans and ensure alignment with Data Value StreamLead and own the...
-
Senior Data Engineer
3 weeks ago
Bangalore, India Quantiphi Full timeJob Role: Senior Data Engineer Experience: 4-8 years Location: Mumbai/Pune/Bangalore/Trivandrum/Remote As a Senior Data Engineer at Quantiphi, you will lead our ingenious data engineering teams in creating transformational solutions involving cloud migration and advanced data engineering workloads. Required Skills: ● Experience: 4+ years...
-
Quantiphi | Senior Data Engineer
3 weeks ago
bangalore, India Quantiphi Full timeJob Role: Senior Data EngineerExperience: 4-8 yearsLocation: Mumbai/Pune/Bangalore/Trivandrum/RemoteAs a Senior Data Engineer at Quantiphi, you will lead our ingenious data engineering teams increating transformational solutions involving cloud migration and advanced data engineeringworkloads.Required Skills:● Experience: 4+ years of relevant experience in...
-
Data Engineer
1 month ago
bangalore, India Tech Mahindra Full timeTech Mahindra is #hiring for GCP Data Engineer .If you're an experienced professional looking for an exciting new challenge.We want to hear from you! Please apply to with your resume explaining your experience and qualifications.Location : Pan IndiaGCP Data Engineer : U2 – up to 3 yearsPrimary Skill : Big Querry, Data flow, Data Composer, SQL,...
-
Data Architect
2 weeks ago
Bangalore, India Data Inc Full timeKey accountabilities include : Subject matter expert on the Data Value Stream Enabler which contains data architecture current state, future state, and roadmap for the transition. Collaborate with stakeholders across various value streams to understand their requirements, data architecture plans and ensure alignment with Data Value Stream Lead and...
-
Data architect
2 weeks ago
Bangalore, India Data Inc Full timeJob Title: Data Architect Location: Pune/Hyderabad/Bangalore Vacancy Type: Fixed Term contract (6 Months initial) Pay rate:- - Role purpose (overall high-level summary of the role) Data & Analytics Office (DAO) promotes a data-driven culture across bank through our strategy of: Fix The Back Book: To protect our data we need robust policies...
-
Data Engineer
1 month ago
Bangalore, India Tech Mahindra Full timeis for GCP Data Engineer . If you're an experienced professional looking for an exciting new challenge. We want to hear from you! Please apply to with your resume explaining your experience and qualifications. Location : Pan India GCP Data Engineer : U2 – up to 3 years Primary Skill : Big Querry, Data flow, Data Composer, SQL,...
-
Data Engineer
1 month ago
bangalore, India Tech Mahindra Full timeTech Mahindra is #hiring for GCP Data Engineer .If you're an experienced professional looking for an exciting new challenge.We want to hear from you! Please apply to BA00858299@TechMahindra.com with your resume explaining your experience and qualifications.Location: Pan IndiaGCP Data Engineer : U2 – up to 3 yearsPrimary Skill : Big Querry, Data flow, Data...
-
Data Engineer
2 months ago
Bangalore, India Tech Mahindra Full timeis for GCP Data Engineer . If you're an experienced professional looking for an exciting new challenge. We want to hear from you! Please apply to with your resume explaining your experience and qualifications. Location : Pan India GCP Data Engineer : U2 – up to 3 years Primary Skill : Big Querry, Data flow, Data Composer, SQL,...
GCP Data Stream
1 month ago
Mandatory Skills: Azure CI/CD pipeline, GCP Cloud, Terraform, Kubernetes, Dataflow, Big Query , GCP DataStream.
Azure Devops (CI/CD pipelines), GCP Cloud, Terraform, Docker, Kubernetes, GitHub actions, scripting
ADO, Jenkins, GitHub
Location- Pan India, hybrid mode 3 days in a week
EXP range- 7-12
Job Role: Senior Cloud Infrastructure Engineer (GCP & Terraform )
Job Overview:
We are seeking a skilled Senior Cloud Infrastructure Engineer to automate infrastructure creation on Google Cloud Platform (GCP) using Terraform. The candidate will be responsible for provisioning and setting up GCP projects and environments for the entire GCP data engineering stack, including services such as Big Query, Data Flow, Pub/Sub, and GCP DataStream. The role also requires expertise in configuring pipelines using Azure DevOps to automate and manage the infrastructure provisioning process.
Key Responsibilities:
- Automate GCP Infrastructure: Design and implement Terraform scripts to provision and automate GCP projects, environments, and data engineering services.
- -Set Up Infrastructure for GCP DataStream: Configure and deploy the infrastructure for GCP DataStream to support real-time data replication and Change Data Capture (CDC) from on-prem databases like Oracle and *DB2* to BigQuery*.
- -Provision and Manage the GCP Data Engineering Stack: Set up and optimize infrastructure for *BigQuery, *Dataflow*, Pub/Sub, Cloud Storage, and other data engineering tools on GCP.
- Automate Infrastructure Pipelines with Azure DevOps*: Design, develop, and maintain CI/CD pipelines using Azure DevOps to automate the deployment of Terraform scripts and manage infrastructure changes.
- -Optimize Cloud Infrastructure*: Ensure high availability, scalability, and security for cloud resources and data pipelines.
- Security and Compliance*: Implement best practices for security and compliance across GCP environments, including IAM policies, encryption, and network security.
- Collaboration: Work closely with data engineers and DevOps teams to align infrastructure with data pipelines and operational requirements.
Required Skills and Experience:
- -*5+ years of experience in GCP infrastructure automation using Terraform to provision cloud resources and environments.
- Experience with GCP DataStream*: Proven ability to set up and configure GCP DataStream for real-time data replication and CDC from on-prem databases (Oracle, DB2) to BigQuery.
- Strong expertise in GCP data engineering services: Hands-on experience with BigQuery, Dataflow*, Pub/Sub, Cloud Storage, and related GCP services.
- Infrastructure Automation: Proficiency in creating reusable Terraform modules and automating cloud infrastructure using Terraform.
- Experience with Azure DevOps: Expertise in configuring and maintaining CI/CD pipelines for infrastructure provisioning using Azure DevOps*.
- Networking and Security*: Strong understanding of GCP networking, IAM, VPCs, firewall configurations, and security best practices.
- Familiarity with on-prem databases such as Oracle and *DB2*.
- Scripting and Automation*: Proficiency in scripting (e.g., Bash, Python) for cloud automation and troubleshooting.
