Gcp data engineer
3 days ago
Job Location: Bangalore
Job Type: Permanent
Key Responsibilities:
Data Engineering on Google Cloud Platform (GCP):
Design, develop, and maintain data pipelines using GCP services such as Big Query, Cloud Storage, Cloud Dataflow, and Pub/Sub.
Implement and optimize ETL processes to ensure efficient data transformation and loading within GCP.
Integrate and manage structured and unstructured data within GCP ecosystem.
Implement GCP best practices for data security, performance, and scalability.
Teradata Expertise:
Design and manage data solutions using Teradata for large-scale data processing.
Integrate Teradata with GCP-based data systems for seamless data migration and transformation.
Optimize and tune Teradata queries and data models to ensure high-performance data processing.
Collaborate with other teams to implement data warehousing solutions on Teradata.
ETL Process Development:
Develop, maintain, and enhance ETL processes using tools like Apache Ni Fi, Talend, or custom scripts.
Ensure data consistency and quality throughout the ETL pipeline.
Monitor and resolve ETL issues to ensure seamless data flow.
Collaboration and Support:
Work closely with business analysts, data scientists, and other stakeholders to understand data needs and deliver solutions.
Troubleshoot and resolve data-related issues across GCP and Teradata environments.
Provide support and documentation for the data solutions deployed.
Skills and Qualifications:
Strong experience with Google Cloud Platform (GCP) , particularly with Big Query, Cloud Storage, Cloud Dataflow, and Pub/Sub.
Solid experience in Teradata data architecture, development, and performance optimization.
Proficiency in ETL processes and tools like Apache Ni Fi, Talend, or custom Python/SQL scripts.
Strong hands-on experience in SQL , including Teradata SQL and Big Query SQL.
Knowledge of cloud data migration and integration strategies between GCP and Teradata.
Experience in developing scalable and efficient data pipelines and transforming data for analytics and reporting.
Familiarity with data modeling, data warehousing, and building data lakes.
Strong problem-solving and analytical skills.
Preferred Skills:
Experience with data orchestration tools like Apache Airflow or similar.
Knowledge of data governance and data security best practices.
Experience with Data Lake architectures and Big Data technologies.
Education and Experience:
Bachelor’s degree in Computer Science, Information Technology, or a related field.
years of experience in data engineering, working with GCP , Teradata , and ETL processes.
-
Gcp Data Science
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full time**Statistical Modeling**: Strong understanding of statistical techniques and experience leveraging BigQuery ML and Vertex AI for model development. **Machine Learning Algorithms**: Experience with GCP's pre-built ML APIs (e.g., Vision AI, Natural Language API) and custom model building using Vertex AI. **Feature Engineering**: Ability to create meaningful...
-
GCP Lead Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a skilled GCP Lead Engineer to join our team at NTT DATA. This role is ideal for someone with expertise in designing and implementing Google Cloud Platform (GCP) solutions.Key ResponsibilitiesAssess, design, and implement GCP solutions, including compute, network, storage, identity, security, and disaster recovery.Develop and...
-
GCP Data Engineer
5 days ago
Bengaluru, India Apptad Inc. Full timeJob Title: GCP Data Engineer - Teradata, ETLJob Location: BangaloreJob Type: PermanentKey Responsibilities:Data Engineering on Google Cloud Platform (GCP):Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub.Implement and optimize ETL processes to ensure efficient data transformation and...
-
GCP Data Engineer
4 days ago
Bengaluru, India Apptad Inc. Full timeJob Title: GCP Data Engineer - Teradata, ETL Job Location: Bangalore Job Type: Permanent Key Responsibilities: Data Engineering on Google Cloud Platform (GCP): Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub. Implement and optimize ETL processes to ensure efficient data...
-
GCP Lead Engineer
1 month ago
Bengaluru, India NTT DATA Full timeJob Description Req ID: 298270 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a GCP Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Primary Skill:...
-
GCP Lead Engineer
1 month ago
Bengaluru, India NTT DATA Full timeJob Description Req ID: 298250 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a GCP Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Mandatory...
-
GCP Data Engineer
3 days ago
Bengaluru, India Tata Consultancy Services Full timeRole - GCP Data EngineerExperience - 5 to 12 yrsLocation - Chennai,Hyderabad,Bangalore,Pune,GurgaonMust Have -Big query, Dataflow , Cloud SQL , Cloud composer , Python , Vertex and Data flowMust-Have· Google Data Engineer (Overall 5+ Years with 2 years relevant experience)· Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging...
-
GCP Data Engineer
3 days ago
Bengaluru, India Tata Consultancy Services Full timeRole - GCP Data Engineer Experience - 5 to 12 yrs Location - Chennai,Hyderabad,Bangalore,Pune,Gurgaon Must Have - Big query, Dataflow , Cloud SQL , Cloud composer , Python , Vertex and Data flow Must-Have · Google Data Engineer (Overall 5+ Years with 2 years relevant experience) · Experience working in GCP based Big Data deployments (Batch/Realtime)...
-
GCP Data Engineers
3 months ago
Bengaluru, India Torry Harris Full timeWe are looking for candidates with experience in Cloud Technologies especially GCP. The requirement is for the candidates to be able to independently work on and assist in GCP projects across the organisation wherein on-premise applications would be migrated onto Google Cloud platform and work as an individual contributor. Manage communication with client,...
-
GCP Data Engineer
2 weeks ago
Bengaluru / Bangalore, Kolkata, India Zenfinet Solutions Opc Private Limited Full timePlease find the below JD:Job Title: Data EngineerJob Type: Permanent RoleLocation:Bangalore/Hyderabad/Kolkata/Pune/Noida Inviting applications for the role of Principal / Senior Principal Consultant Google Cloud Platform (GCP) Data Engineer Experience Required - 8 yrs to 12 yrs. In this role, As a GCP Data Engineer a, you will be a key player in...
-
GCP Lead Engineer
2 months ago
Bengaluru, India NTT DATA Services Full timeReq ID: 298250 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a GCP Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Mandatory Skills:Technical...
-
GCP Data Engineer
3 weeks ago
Bengaluru, India Arting Digital Private Limited Full timePosition: GCP Data Engineer and DevOps SpecialistExperience: 6-9 YrsLocation: BangaloreNotice Period: Immediate - 60 DaysPrimary Skills: GCP, Devops, Python, GCP Certification is mandatoryRequired Skills and Qualifications:Strong experience with Google Cloud Platform (GCP) services, including BigQuery, Cloud Run, Cloud Functions, Pub/Sub, Dataflow, and Cloud...
-
GCP Data Engineer
1 week ago
Bengaluru, India Deloitte Full timeHi, We are looking for Candidates who are having experience as GCP Data Engineer.Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaResponsibilities:BigQuery Development & Optimization:Write and optimize complex SQL queries for efficient data processing and retrieval in BigQuery.Analyze query performance and implement optimization techniques...
-
GCP Data Engineer
4 weeks ago
Greater Bengaluru Area, India Tech Mahindra Full timeResponsibilities: • Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. • Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. • Use Pub/Sub for real-time data ingestion and streaming analytics. • Provision and manage GCP infrastructure...
-
GCP Data Engineer
4 weeks ago
Greater Bengaluru Area, India Tech Mahindra Full timeResponsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...
-
GCP Lead Engineer
1 month ago
Bengaluru, India NTT DATA Services Full timeReq ID: 298270 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a GCP Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Primary Skill:...
-
Gcp data engineer
1 week ago
Bengaluru, India Deloitte Full timeHi, We are looking for Candidates who are having experience as GCP Data Engineer.Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaResponsibilities:Big Query Development & Optimization:Write and optimize complex SQL queries for efficient data processing and retrieval in Big Query.Analyze query performance and implement optimization...
-
GCP Data Stream
3 weeks ago
Bengaluru, India Tekgence Inc Full timeMandatory Skills: Azure CI/CD pipeline, GCP Cloud, Terraform, Kubernetes, Dataflow, Big Query , GCP DataStream.Azure Devops (CI/CD pipelines), GCP Cloud, Terraform, Docker, Kubernetes, GitHub actions, scriptingADO, Jenkins, GitHubLocation- Pan India, hybrid mode 3 days in a weekEXP range- 7-12Job Role: Senior Cloud Infrastructure Engineer (GCP & Terraform...
-
GCP Data Stream
3 weeks ago
Bengaluru, India Tekgence Inc Full timeMandatory Skills: Azure CI/CD pipeline, GCP Cloud, Terraform, Kubernetes, Dataflow, Big Query, GCP DataStream.Azure Devops (CI/CD pipelines), GCP Cloud, Terraform, Docker, Kubernetes, GitHub actions, scripting ADO, Jenkins, GitHubLocation- Pan India, hybrid mode 3 days in a weekEXP range- 7-12 Job Role: Senior Cloud Infrastructure Engineer (GCP & Terraform)...
-
GCP Data Stream
3 weeks ago
Bengaluru, India Tekgence Inc Full timeMandatory Skills: Azure CI/CD pipeline, GCP Cloud, Terraform, Kubernetes, Dataflow, Big Query, GCP DataStream.Azure Devops (CI/CD pipelines), GCP Cloud, Terraform, Docker, Kubernetes, GitHub actions, scripting ADO, Jenkins, GitHubLocation- Pan India, hybrid mode 3 days in a weekEXP range- 7-12 Job Role: Senior Cloud Infrastructure Engineer (GCP & Terraform)...