Capco - GCP Data Engineer - ETL/Data Warehousing

3 days ago

Bengaluru, Karnataka, India Capco Technologies Pvt Ltd Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Position Overview : We are seeking a mid-level GCP Data Engineer with 9 years of experience in ETL, Data Warehousing, and Data Engineering. The ideal candidate will have hands-on experience with GCP tools, solid data analysis skills, and a strong understanding of Data Warehousing principles. Qualifications :

  • 9 years experience in ETL & Data Warehousing.
  • Should have excellent leadership & communication skills.
  • Should have experience in developing Data Engineering solutions Airflow, GCP BigQuery, Cloud Storage, Dataflow, Cloud Functions, Pub/Sub, Cloud Run, etc.
  • Should have built solution automations in any of the above ETL tools.
  • Should have executed at least 2 GCP Cloud Data Warehousing projects.
  • Should have worked at least 2 projects using Agile/SAFe methodology.
  • Should

Have mid level experience in Pyspark and Teradata.

  • Should have working experience on any DevOps tools like GitHub, Jenkins, Cloud Native, etc & on semi-structured data formats like JSON, Parquet and/or XML files & written complex SQL queries for data analysis and extraction.
  • Should have in depth understanding on Data Warehousing, Data Analysis, Data Profiling, Data Quality & Data Mapping.

Responsibilities :

  • Analyze the different source systems, profile data, understand, document & fix Data Quality issues.
  • Gather requirements and business process knowledge in order to transform the data in a way that is geared towards the needs of end users.
  • Write complex SQLs to extract & format source data for ETL/data pipeline.
  • Create design documents, Source to Target Mapping documents and any supporting documents needed for deployment/migration.
  • Design, Develop and Test ETL/Data pipelines.
  • Design & build metadata-based frameworks needs for data pipelines.
  • Write Unit Test cases, execute Unit Testing and document Unit Test results.
  • Deploy ETL/Data pipelines.
  • Use DevOps tools to version, push/pull code and deploy across environments.
  • Support team during troubleshooting & debugging defects & bug fixes, business requests, environment migrations & other adhoc requests.
  • Do production support, enhancements and bug fixes.
  • Work with business and technology stakeholders to communicate EDW incidents/problems and manage their expectations.
  • Leverage ITIL concepts to circumvent incidents, manage problems and document knowledge.
  • Perform data cleaning, transformation, and validation to ensure accuracy and consistency across various data sources.
  • Stay current on industry best practices and emerging technologies in data analysis and cloud computing, particularly within the GCP ecosystem.

)

  • GCP Data Architect

    1 week ago

    Bengaluru, Karnataka, India Capco Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy...

  • GCP Data Architect

    2 days ago

    Bengaluru, Karnataka, India Capco Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We...

  • Data Engineering- GCP

    1 week ago

    Bengaluru, Karnataka, India Capco Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job Title: Data EngineerAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking,...

  • Capco - GCP Data Architect - Big Data Technologies

    5 days ago

    Bengaluru, Karnataka, India Capco Technologies Pvt Ltd Full time

    Job Title : GCP Data ArchitectLocation : BangaloreJob Summary : We are seeking a highly skilled GCP Data Architect with extensive experience in architecting and implementing large-scale, cloud-native data solutions. The ideal candidate will have strong expertise in Google Cloud Platform (GCP), data modeling, data governance, ETL/ELT pipelines, and advanced...

  • Capco - Data Engineer - Google Cloud Platform

    5 days ago

    Bengaluru, Karnataka, India Capco Technologies Pvt Ltd Full time

    Job Title : GCP Data EngineerLocation : Bangalore, PuneExperience : 6-9 yearsTechnology Stack :- Data engineer with experience in working with Big data technologies e.g. spark/hadoop- Design and implement scalable cloud infrastructure solutions using Google Cloud Platform services such Cloud Storage, BigQuery, Cloud Data flow, Cloud run etc- Strong scripting...

  • Sr. ETL Test Automation Engineer

    4 days ago

    Bengaluru, Karnataka, India Capco Full time US$ 90,000 - US$ 1,20,000 per year

    About UsCapco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We...

  • Data Warehousing Specialist

    4 days ago

    Bengaluru, Karnataka, India beBeeSnowflakeDeveloper Full time ₹ 15,00,000 - ₹ 25,00,000

    About Data Warehousing RoleOur organization is seeking a seasoned Snowflake Developer to join its data engineering team.This position requires expertise in designing, developing, and maintaining scalable data pipelines and ETL workflows on Snowflake.Design and build data models and data warehousing solutions to support business intelligence and...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Fractal Full time

    We are seeking an experienced GCP Data Engineer with 6+ years of experience to design, develop, and manage cloud-based data solutions on Google Cloud Platform (GCP). The ideal candidate will have expertise in BigQuery, Dataflow, Pub/Sub, Cloud Composer (Apache Airflow), and Terraform, along with strong experience in ETL/ELT pipelines, data modeling, and...

  • GCP Data Engineer

    1 day ago

    Bengaluru, Karnataka, India Infogain Pte Ltd Full time

    Core SkillsExp: 5-10 yearsMust have - Python, Java, Bigquery, PySpark- Extensive experience with Google Cloud Platform (GCP) data services such as BigQuery, Cloud Storage, and Dataflow.- Expertise in ETL (Extract, Transform, Load) processes and data integration on GCP.- Strong SQL and database querying optimization skills on GCP.- Experience with data...

  • GCP Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Fractal Full time

    We are seeking an experienced GCP Data Engineer with 6+ years of experience to design, develop, and manage cloud-based data solutions on Google Cloud Platform (GCP). The ideal candidate will have expertise in BigQuery, Dataflow, Pub/Sub, Cloud Composer (Apache Airflow), and Terraform, along with strong experience in ETL/ELT pipelines, data modeling, and...