Pipeline Engineer

4 weeks ago

Pune, India Virtusa Full time
Pipeline Engineer - CREQ188847 Description

JOB DESCRIPTION

Skill: GCP Enginee

Role / Tier: Tier 2

Roles and Responsibilities

ipeline Engineer - Google BigQuery, Administration and Development of On-prem or Cloud Databases, Warehouses and Lakes

Responsibilities:

Administer and optimize Google BigQuery instances, ensuring high availability, performance, and security of data.

Develop and maintain on-premises or cloud-based databases, warehouses, and data lakes to support various data processing and analytics needs.

Design and implement database schemas, tables, indexes, and views for efficient data storage and retrieval.

Develop and optimize ETL processes to extract, transform, and load data into database systems from diverse sources.

Monitor database performance metrics and proactively identify and resolve performance bottlenecks and issues.

Implement and enforce data governance policies and security measures to protect sensitive information and ensure compliance with regulatory standards.

Collaborate with cross-functional teams to gather requirements and design data solutions that meet business needs.

Stay updated with the latest advancements in database technologies and best practices to continuously improve data infrastructure and processes.

Provide technical support and troubleshooting assistance to resolve database-related issues and incidents.

Requirements:

Bachelor's degree in Computer Science, Information Technology, or related field.

Proven experience in administering Google BigQuery or other cloud-based data warehouse platforms.

Experience with the administration and development of on-premises or cloud-based databases, warehouses, and data lakes (, MySQL, PostgreSQL, Amazon Redshift, Azure SQL Data Warehouse).

Proficiency in SQL and database query optimization techniques for efficient data retrieval and analysis.

Strong understanding of data modeling principles and database design best practices.

Experience with ETL tools and processes for data integration and transformation.

Knowledge of data governance principles, data security standards, and regulatory requirements.

Excellent problem-solving and analytical skills with the ability to troubleshoot complex database issues.

Effective communication and collaboration skills, with the ability to work well in a team environment.

Familiarity with programming languages such as Python or Java is a plus.

Qualifications

BTech/Any Graduate

Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills BigQuery Years of Experience 5 Qualification

JOB DESCRIPTION

Skill: GCP Enginee

Role / Tier: Tier 2

Roles and Responsibilities

ipeline Engineer - Google BigQuery, Administration and Development of On-prem or Cloud Databases, Warehouses and Lakes

Responsibilities:

Administer and optimize Google BigQuery instances, ensuring high availability, performance, and security of data.

Develop and maintain on-premises or cloud-based databases, warehouses, and data lakes to support various data processing and analytics needs.

Design and implement database schemas, tables, indexes, and views for efficient data storage and retrieval.

Develop and optimize ETL processes to extract, transform, and load data into database systems from diverse sources.

Monitor database performance metrics and proactively identify and resolve performance bottlenecks and issues.

Implement and enforce data governance policies and security measures to protect sensitive information and ensure compliance with regulatory standards.

Collaborate with cross-functional teams to gather requirements and design data solutions that meet business needs.

Stay updated with the latest advancements in database technologies and best practices to continuously improve data infrastructure and processes.

Provide technical support and troubleshooting assistance to resolve database-related issues and incidents.

Requirements:

Bachelor's degree in Computer Science, Information Technology, or related field.

Proven experience in administering Google BigQuery or other cloud-based data warehouse platforms.

Experience with the administration and development of on-premises or cloud-based databases, warehouses, and data lakes (, MySQL, PostgreSQL, Amazon Redshift, Azure SQL Data Warehouse).

Proficiency in SQL and database query optimization techniques for efficient data retrieval and analysis.

Strong understanding of data modeling principles and database design best practices.

Experience with ETL tools and processes for data integration and transformation.

Knowledge of data governance principles, data security standards, and regulatory requirements.

Excellent problem-solving and analytical skills with the ability to troubleshoot complex database issues.

Effective communication and collaboration skills, with the ability to work well in a team environment.

Familiarity with programming languages such as Python or Java is a plus.

Qualifications

BTech/Any Graduate

Travel No

  • Pipeline Engineer

    2 weeks ago

    Pune, Maharashtra, India BP Energy Full time

    Entity: Production & OperationsJob Family Group: Engineering GroupJob Summary: bp Technical Solutions India (TSI) center in Pune, aims to enhance bp's current engineering and technical capabilities to provide top-notch services to its hydrocarbons and new energy businesses worldwide. TSI brings together a diverse engineering team to offer technical services...

  • Pipeline Engineer

    4 weeks ago

    Pune, MH, IN BP Energy Full time

    Entity: Production & OperationsJob Family Group: Engineering GroupJob Summary: bp Technical Solutions India (TSI) center in Pune, aims to build on bp’s existing engineering and technical strengths to deliver high quality services to its hydrocarbons and new energy businesses worldwide! TSI brings together diverse engineering capability to provide technical...

  • Pipeline Engineer

    1 month ago

    Pune, MH, IN BP Energy Full time

    Entity: Production & OperationsJob Family Group: Engineering GroupJob Summary: bp Technical Solutions India (TSI) center in Pune, aims to build on bp’s existing engineering and technical strengths to deliver high quality services to its hydrocarbons and new energy businesses worldwide! TSI brings together diverse engineering capability to provide technical...

  • Pipeline Engineer

    4 weeks ago

    Pune, India Virtusa Full time

    Pipeline Engineer - CREQ188847 DescriptionJOB DESCRIPTIONSkill: GCP EngineeRole / Tier: Tier 2Roles and Responsibilitiesipeline Engineer - Google BigQuery, Administration and Development of On-prem or Cloud Databases, Warehouses and LakesResponsibilities:Administer and optimize Google BigQuery instances, ensuring high availability, performance, and security...

  • Pipeline Engineer

    4 weeks ago

    pune, India Virtusa Full time

    Pipeline Engineer - CREQ188847 Description JOB DESCRIPTION Skill: GCP Enginee Role / Tier: Tier 2 Roles and Responsibilities ipeline Engineer - Google BigQuery, Administration and Development of On-prem or Cloud Databases, Warehouses and Lakes Responsibilities: Administer and optimize Google BigQuery instances, ensuring...

  • Pipeline Engineer

    2 weeks ago

    Pune, Maharashtra, India Virtusa Full time

    Pipeline Engineer - CREQ188847 Description JOB DESCRIPTION Skill: GCP Enginee Role / Tier: Tier 2 Roles and Responsibilities ipeline Engineer - Google BigQuery, Administration and Development of On-prem or Cloud Databases, Warehouses and Lakes Responsibilities: Administer and optimize Google BigQuery instances, ensuring high...

  • Pipeline Welder

    4 weeks ago

    Pune, India TECHNO ENGINEERING AND SOLUTIONS Full time

    Performs all kinds of welding, ARC, TIG, MIG and cutting on any type or metal using tools commonly used in welding work. - Plans layouts, constructs, installs, repairs and maintains all types of pipelines, fittings and fixtures. - Cutting materials into the required shapes, checking dimensions and thicknesses. - Welding or joining metal and other materials...

  • DevOps Engineer

    1 month ago

    Pune, Maharashtra, India Nurturing Interns Private Limited Full time

    Role Summary: A DevOps Engineer with 5-8 years of experience who is responsible for creating and managing CI/CD pipelines using tools such as Jenkins, GitHub Actions, or GitLabEE pipelines. They should have a strong understanding of CD tools like Argo CD/Jenkins and experience with cloud technologies, preferably AWS. The engineer should also possess hands-on...

  • DevOps Engineer

    4 weeks ago

    Pune, India Nurturing Interns Private Limited Full time

    Role Summary: A DevOps Engineer with 5-8 years of experience who is responsible for creating and managing CI/CD pipelines using tools such as Jenkins, GitHub Actions, or GitLabEE pipelines. They should have a strong understanding of CD tools like Argo CD/Jenkins and experience with cloud technologies, preferably AWS. The engineer should also possess hands-on...

  • DevOps Engineer

    4 weeks ago

    Pune, India Nurturing Interns Private Limited Full time

    Role Summary: A DevOps Engineer with 5-8 years of experience who is responsible for creating and managing CI/CD pipelines using tools such as Jenkins, GitHub Actions, or GitLabEE pipelines. They should have a strong understanding of CD tools like Argo CD/Jenkins and experience with cloud technologies, preferably AWS. The engineer should also possess...

  • DevOps Engineer

    4 weeks ago

    Pune, Maharashtra, India Nurturing Interns Private Limited Full time

    Role Summary: A DevOps Engineer with 5-8 years of experience who is responsible for creating and managing CI/CD pipelines using tools such as Jenkins, GitHub Actions, or GitLabEE pipelines. They should have a strong understanding of CD tools like Argo CD/Jenkins and experience with cloud technologies, preferably AWS. The engineer should also possess hands-on...

  • Senior Software Engineer

    4 weeks ago

    Pune, India Antal International Full time

    Role : As a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep learning curve, and build products...

  • Pipeline Fitter

    4 weeks ago

    Pune, India TECHNO ENGINEERING AND SOLUTIONS Full time

    Performs all kinds of FITTING and cutting on any type or metal using tools commonly used in welding work. - Plans layouts, constructs, installs, repairs and maintains all types of pipelines, fittings and fixtures. - Cutting materials into the required shapes, checking dimensions and thicknesses. - Welding or joining metal and other materials into a wide...

  • DevOps Engineer

    4 days ago

    Pune, India Intraedge Technologies Ltd. Full time

    Role : Senior DevOps Engineer. Experience : 6+yrs. Location : Pune (Hybrid). We are seeking a skilled Senior DevOps Engineer to join our dynamic DevOps team. As a Senior DevOps Engineer, you will be responsible for implementing, maintaining, and enhancing our continuous integration and delivery (CI/CD) pipelines, infrastructure automation, and deployment...

  • DevOps Engineer

    5 days ago

    pune, India Intraedge Technologies Ltd. Full time

    Role : Senior DevOps Engineer. Experience : 6+yrs. Location : Pune (Hybrid). We are seeking a skilled Senior DevOps Engineer to join our dynamic DevOps team. As a Senior DevOps Engineer, you will be responsible for implementing, maintaining, and enhancing our continuous integration and delivery (CI/CD) pipelines, infrastructure automation, and deployment...

  • DevOps Engineer

    5 days ago

    Pune, India Intraedge Technologies Ltd. Full time

    Role : Senior DevOps Engineer. Experience : 6+yrs. Location : Pune (Hybrid). We are seeking a skilled Senior DevOps Engineer to join our dynamic DevOps team. As a Senior DevOps Engineer, you will be responsible for implementing, maintaining, and enhancing our continuous integration and delivery (CI/CD) pipelines, infrastructure automation, and deployment...

  • DevOps Engineer

    5 days ago

    Pune, Maharashtra, India Intraedge Technologies Ltd. Full time

    Role : Senior DevOps Engineer. Experience : 6+yrs. Location : Pune (Hybrid). We are seeking a skilled Senior DevOps Engineer to join our dynamic DevOps team. As a Senior DevOps Engineer, you will be responsible for implementing, maintaining, and enhancing our continuous integration and delivery (CI/CD) pipelines, infrastructure automation, and deployment...

  • DevOps Engineer

    2 months ago

    Pune, India Deqode Full time

    Company Description :At Deqode, we are a Pune-based technology consultancy firm that specializes in helping clients build their technical workforce. With deep industry knowledge and technical expertise, we optimize business processes, maximize impact, and foster business growth. Our goal is to decode business problems with quality solutions in a timely...

  • DevOps Engineer

    4 weeks ago

    Pune, Maharashtra, India Deqode Full time

    Company Description :At Deqode, we are a Pune-based technology consultancy firm that specializes in helping clients build their technical workforce. With deep industry knowledge and technical expertise, we optimize business processes, maximize impact, and foster business growth. Our goal is to decode business problems with quality solutions in a timely...

  • DevOps Engineer

    2 months ago

    Pune, Maharashtra, India Deqode Full time

    Company Description :At Deqode, we are a Pune-based technology consultancy firm that specializes in helping clients build their technical workforce. With deep industry knowledge and technical expertise, we optimize business processes, maximize impact, and foster business growth. Our goal is to decode business problems with quality solutions in a timely...