Pipeline Engineer
1 month ago
JOB DESCRIPTION
Skill: GCP Enginee
Role / Tier: Tier 2
Roles and Responsibilities
ipeline Engineer - Google BigQuery, Administration and Development of On-prem or Cloud Databases, Warehouses and Lakes
Responsibilities:
Administer and optimize Google BigQuery instances, ensuring high availability, performance, and security of data.
Develop and maintain on-premises or cloud-based databases, warehouses, and data lakes to support various data processing and analytics needs.
Design and implement database schemas, tables, indexes, and views for efficient data storage and retrieval.
Develop and optimize ETL processes to extract, transform, and load data into database systems from diverse sources.
Monitor database performance metrics and proactively identify and resolve performance bottlenecks and issues.
Implement and enforce data governance policies and security measures to protect sensitive information and ensure compliance with regulatory standards.
Collaborate with cross-functional teams to gather requirements and design data solutions that meet business needs.
Stay updated with the latest advancements in database technologies and best practices to continuously improve data infrastructure and processes.
Provide technical support and troubleshooting assistance to resolve database-related issues and incidents.
Requirements:
Bachelor's degree in Computer Science, Information Technology, or related field.
Proven experience in administering Google BigQuery or other cloud-based data warehouse platforms.
Experience with the administration and development of on-premises or cloud-based databases, warehouses, and data lakes (, MySQL, PostgreSQL, Amazon Redshift, Azure SQL Data Warehouse).
Proficiency in SQL and database query optimization techniques for efficient data retrieval and analysis.
Strong understanding of data modeling principles and database design best practices.
Experience with ETL tools and processes for data integration and transformation.
Knowledge of data governance principles, data security standards, and regulatory requirements.
Excellent problem-solving and analytical skills with the ability to troubleshoot complex database issues.
Effective communication and collaboration skills, with the ability to work well in a team environment.
Familiarity with programming languages such as Python or Java is a plus.
Qualifications
BTech/Any Graduate
Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills BigQuery Years of Experience 5 QualificationJOB DESCRIPTION
Skill: GCP Enginee
Role / Tier: Tier 2
Roles and Responsibilities
ipeline Engineer - Google BigQuery, Administration and Development of On-prem or Cloud Databases, Warehouses and Lakes
Responsibilities:
Administer and optimize Google BigQuery instances, ensuring high availability, performance, and security of data.
Develop and maintain on-premises or cloud-based databases, warehouses, and data lakes to support various data processing and analytics needs.
Design and implement database schemas, tables, indexes, and views for efficient data storage and retrieval.
Develop and optimize ETL processes to extract, transform, and load data into database systems from diverse sources.
Monitor database performance metrics and proactively identify and resolve performance bottlenecks and issues.
Implement and enforce data governance policies and security measures to protect sensitive information and ensure compliance with regulatory standards.
Collaborate with cross-functional teams to gather requirements and design data solutions that meet business needs.
Stay updated with the latest advancements in database technologies and best practices to continuously improve data infrastructure and processes.
Provide technical support and troubleshooting assistance to resolve database-related issues and incidents.
Requirements:
Bachelor's degree in Computer Science, Information Technology, or related field.
Proven experience in administering Google BigQuery or other cloud-based data warehouse platforms.
Experience with the administration and development of on-premises or cloud-based databases, warehouses, and data lakes (, MySQL, PostgreSQL, Amazon Redshift, Azure SQL Data Warehouse).
Proficiency in SQL and database query optimization techniques for efficient data retrieval and analysis.
Strong understanding of data modeling principles and database design best practices.
Experience with ETL tools and processes for data integration and transformation.
Knowledge of data governance principles, data security standards, and regulatory requirements.
Excellent problem-solving and analytical skills with the ability to troubleshoot complex database issues.
Effective communication and collaboration skills, with the ability to work well in a team environment.
Familiarity with programming languages such as Python or Java is a plus.
Qualifications
BTech/Any Graduate
Travel NoWe have other current jobs related to this field that you can find below
-
Pipeline Engineer
2 weeks ago
Pune, Maharashtra, India BP Energy Full timeEntity: Production & OperationsJob Family Group: Engineering GroupJob Summary: bp Technical Solutions India (TSI) center in Pune, aims to enhance bp's current engineering and technical capabilities to provide top-notch services to its hydrocarbons and new energy businesses worldwide. TSI brings together a diverse engineering team to offer technical services...
-
Pipeline Engineer
4 weeks ago
Pune, MH, IN BP Energy Full timeEntity: Production & OperationsJob Family Group: Engineering GroupJob Summary: bp Technical Solutions India (TSI) center in Pune, aims to build on bp’s existing engineering and technical strengths to deliver high quality services to its hydrocarbons and new energy businesses worldwide! TSI brings together diverse engineering capability to provide technical...
-
Pipeline Engineer
4 weeks ago
Pune, India Virtusa Full timePipeline Engineer - CREQ188847 DescriptionJOB DESCRIPTIONSkill: GCP EngineeRole / Tier: Tier 2Roles and Responsibilitiesipeline Engineer - Google BigQuery, Administration and Development of On-prem or Cloud Databases, Warehouses and LakesResponsibilities:Administer and optimize Google BigQuery instances, ensuring high availability, performance, and security...
-
Pipeline Engineer
2 weeks ago
Pune, Maharashtra, India Virtusa Full timePipeline Engineer - CREQ188847 Description JOB DESCRIPTION Skill: GCP Enginee Role / Tier: Tier 2 Roles and Responsibilities ipeline Engineer - Google BigQuery, Administration and Development of On-prem or Cloud Databases, Warehouses and Lakes Responsibilities: Administer and optimize Google BigQuery instances, ensuring high...
-
Pipeline Engineer
4 weeks ago
pune, India Virtusa Full timePipeline Engineer - CREQ188847 Description JOB DESCRIPTION Skill: GCP Enginee Role / Tier: Tier 2 Roles and Responsibilities ipeline Engineer - Google BigQuery, Administration and Development of On-prem or Cloud Databases, Warehouses and Lakes Responsibilities: Administer and optimize Google BigQuery instances, ensuring...
-
Pipeline Welder
4 weeks ago
Pune, India TECHNO ENGINEERING AND SOLUTIONS Full timePerforms all kinds of welding, ARC, TIG, MIG and cutting on any type or metal using tools commonly used in welding work. - Plans layouts, constructs, installs, repairs and maintains all types of pipelines, fittings and fixtures. - Cutting materials into the required shapes, checking dimensions and thicknesses. - Welding or joining metal and other materials...
-
DevOps Engineer
4 weeks ago
Pune, India Nurturing Interns Private Limited Full timeRole Summary: A DevOps Engineer with 5-8 years of experience who is responsible for creating and managing CI/CD pipelines using tools such as Jenkins, GitHub Actions, or GitLabEE pipelines. They should have a strong understanding of CD tools like Argo CD/Jenkins and experience with cloud technologies, preferably AWS. The engineer should also possess hands-on...
-
DevOps Engineer
4 weeks ago
Pune, India Nurturing Interns Private Limited Full timeRole Summary: A DevOps Engineer with 5-8 years of experience who is responsible for creating and managing CI/CD pipelines using tools such as Jenkins, GitHub Actions, or GitLabEE pipelines. They should have a strong understanding of CD tools like Argo CD/Jenkins and experience with cloud technologies, preferably AWS. The engineer should also possess...
-
DevOps Engineer
4 weeks ago
Pune, Maharashtra, India Nurturing Interns Private Limited Full timeRole Summary: A DevOps Engineer with 5-8 years of experience who is responsible for creating and managing CI/CD pipelines using tools such as Jenkins, GitHub Actions, or GitLabEE pipelines. They should have a strong understanding of CD tools like Argo CD/Jenkins and experience with cloud technologies, preferably AWS. The engineer should also possess hands-on...
-
Senior Software Engineer
4 weeks ago
Pune, India Antal International Full timeRole : As a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep learning curve, and build products...
-
Pipeline Fitter
4 weeks ago
Pune, India TECHNO ENGINEERING AND SOLUTIONS Full timePerforms all kinds of FITTING and cutting on any type or metal using tools commonly used in welding work. - Plans layouts, constructs, installs, repairs and maintains all types of pipelines, fittings and fixtures. - Cutting materials into the required shapes, checking dimensions and thicknesses. - Welding or joining metal and other materials into a wide...
-
DevOps Engineer
6 days ago
Pune, India Intraedge Technologies Ltd. Full timeRole : Senior DevOps Engineer. Experience : 6+yrs. Location : Pune (Hybrid). We are seeking a skilled Senior DevOps Engineer to join our dynamic DevOps team. As a Senior DevOps Engineer, you will be responsible for implementing, maintaining, and enhancing our continuous integration and delivery (CI/CD) pipelines, infrastructure automation, and deployment...
-
DevOps Engineer
4 days ago
Pune, India Intraedge Technologies Ltd. Full timeRole : Senior DevOps Engineer. Experience : 6+yrs. Location : Pune (Hybrid). We are seeking a skilled Senior DevOps Engineer to join our dynamic DevOps team. As a Senior DevOps Engineer, you will be responsible for implementing, maintaining, and enhancing our continuous integration and delivery (CI/CD) pipelines, infrastructure automation, and deployment...
-
DevOps Engineer
5 days ago
pune, India Intraedge Technologies Ltd. Full timeRole : Senior DevOps Engineer. Experience : 6+yrs. Location : Pune (Hybrid). We are seeking a skilled Senior DevOps Engineer to join our dynamic DevOps team. As a Senior DevOps Engineer, you will be responsible for implementing, maintaining, and enhancing our continuous integration and delivery (CI/CD) pipelines, infrastructure automation, and deployment...
-
DevOps Engineer
5 days ago
Pune, Maharashtra, India Intraedge Technologies Ltd. Full timeRole : Senior DevOps Engineer. Experience : 6+yrs. Location : Pune (Hybrid). We are seeking a skilled Senior DevOps Engineer to join our dynamic DevOps team. As a Senior DevOps Engineer, you will be responsible for implementing, maintaining, and enhancing our continuous integration and delivery (CI/CD) pipelines, infrastructure automation, and deployment...
-
DevOps Engineer
4 weeks ago
Pune, India Deqode Full timeCompany Description :At Deqode, we are a Pune-based technology consultancy firm that specializes in helping clients build their technical workforce. With deep industry knowledge and technical expertise, we optimize business processes, maximize impact, and foster business growth. Our goal is to decode business problems with quality solutions in a timely...
-
DevOps Engineer
4 weeks ago
Pune, Maharashtra, India Deqode Full timeCompany Description :At Deqode, we are a Pune-based technology consultancy firm that specializes in helping clients build their technical workforce. With deep industry knowledge and technical expertise, we optimize business processes, maximize impact, and foster business growth. Our goal is to decode business problems with quality solutions in a timely...
-
DevOps Engineer
4 weeks ago
Pune, India Deqode Full timeCompany Description : At Deqode, we are a Pune-based technology consultancy firm that specializes in helping clients build their technical workforce. With deep industry knowledge and technical expertise, we optimize business processes, maximize impact, and foster business growth. Our goal is to decode business problems with quality solutions in a timely...
-
AWS DevOps Engineer
4 weeks ago
Pune, India Prometteur Solutions Pvt. Ltd. Full timeRoles and Responsibilities :- Design, implement, and manage robust code pipelines for seamless software delivery and deployment on AWS infrastructure.- Strong experience with serverless architectures, particularly using AWS Lambda.- Configure and optimize CI/CD processes to automate software builds, testing, and deployments.- Familiarity with API development...
-
Lead Data Engineer
4 weeks ago
Bangalore/Pune/Hyderabad/Chennai, India Nilasu consulting Full timeWe are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...