GCP Data Engineering

4 weeks ago

Hyderabad, India BILVANTIS TECHNOLOGIES Full time

We are looking for a skilled and experienced GCP Data Lead Engineer to join our Data team in Hyderabad location.


About the job


Position: GCP Data Engineering - Lead Programmer Analyst

Total Experience: Minimum 5 yrs to 7 yrs of experience.

Notice Period: Immediate -15 days

Must have skills: GCP Cloud, GCS, BigQuery, Python, PySpark, DWH Architecture, ETL, SQL


Job Description: GCP Data Engineering - Lead Programmer Analyst


We are seeking a highly skilled and knowledgeable Data Engineer to join our Data Management team on a transformative Move to Cloud (M2C) project. The ideal candidate will have a strong background in creating robust data ingestion pipelines and a deep understanding of ETL processes, particularly within the Google Cloud Platform ecosystem and using tools such as dbt Labs over BigQuery.


Responsibilities:

  • Develop and maintain scalable and reliable data pipelines using PySpark and SQL to support the migration from Oracle's on-premises data warehouse (structured data source) and unstructured data sources to BigQuery.
  • Design and implement bulletproof data ingestion and integration processes that ensure data quality and consistency.
  • Use the dbt tool to create and manage ETL processes that transform and load data efficiently from/into BigQuery.
  • Ensure the resilience and efficiency of data transformation jobs that can handle large volumes of data within a cloud-based architecture.
  • Work closely with our Data Engineers to gather requirements for the currently developed data pipelines.
  • Provide expertise in GCP services like DataProc, DataFlow, Cloud Functions, Workflows, Cloud Composer, and BigQuery, advocating for best practices in cloud-based data management.
  • Collaborate with data architects and other stakeholders to optimize data models and warehouse design for the cloud environment.
  • Develop and implement monitoring, quality, and validation processes to ensure the integrity of data pipelines and data.
  • Document all data engineering processes and create clear specifications for future reference and compliance.


Requirements:

  • Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.
  • Minimum of 5 years of experience as a Data Engineer with a focus on cloud-based solutions.
  • Proficient in GCP services, with a strong emphasis on data-related products such as DataProc, DataFlow, Cloud Functions, Workflows, Cloud Composer, and BigQuery.
  • Extensive experience with ETL tools, particularly dbt Labs, and a clear understanding of ETL best practices.
  • Experience in building and optimizing data pipelines, architectures, and data sets from structured/unstructured data sources.
  • Strong analytical skills with the ability to understand complex requirements and translate them into technical solutions.
  • Excellent problem-solving abilities and a commitment to quality.
  • Strong communication skills, with the ability to work collaboratively in a team environment.
  • Relevant certifications in the Google Cloud Platform or other data engineering credentials are desirable.
  • Proficiency in SQL and Python with knowledge of Spark.
  • Fluent in English, with strong written and verbal communication skills.

  • GCP Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    GCP Data Engineer Job DescriptionWe are seeking a highly skilled GCP Data Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Google Cloud Platform (GCP).Key Responsibilities:Design and implement data pipelines using...

  • Gcp data engineer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Job Title : GCP Data Engineer Job Location – Chennai, Hyderabad, Bangalore, Pune, Gurgaon Experience: 5 to 12 Years Requirement: Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of Big Data and Hadoop Ecosystems. Strong experience required in GCP. Must have done multiple large projects with GCP Big Query...

  • GCP Data Engineer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Job Title : GCP Data Engineer Job Location – Chennai, Hyderabad, Bangalore, Pune, Gurgaon Experience: 5 to 12 Years Requirement: Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems. Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and...

  • Data Engineer- GCP

    6 days ago

    Hyderabad, India NucleusTeq Full time

    Experience- 6 Year + Location- Indore/Bangalore/Hyderabad/Raipur Role Description This is a full-time hybrid role for a Data Engineer GCP at NucleusTeq . The Data Engineer will be responsible for tasks such as GCP cloud Migration ,data engineering, data modeling, ETL processes, data warehousing to...

  • GCP Data Engineer

    7 days ago

    hyderabad, India Tekgence Inc Full time

    1 of our MNC client is looking for GCP Data Engineers on an urgent basis. Kindly find below the details for your reference.Role: GCP Data EngineerExperience: 5 - 11 YearsNotice Period: Immediate - 30 days maxBudget: 20 - 32 LPA maxLocation: Pune/Chennai/HyderabadMandate Skills:GCP BigQuery, SQL Scripting & Python coding experience.GCP...

  • GCP Data Engineer

    6 days ago

    hyderabad, India Tekgence Inc Full time

    1 of our MNC client is looking for GCP Data Engineers on an urgent basis. Kindly find below the details for your reference. Role: GCP Data Engineer Experience: 5 - 11 Years Notice Period: Immediate - 30 days max Budget: 20 - 32 LPA max Location: Pune/Chennai/Hyderabad Mandate Skills: GCP BigQuery, SQL Scripting & Python coding experience. GCP...

  • GCP Data Engineer

    3 weeks ago

    hyderabad, India Tata Consultancy Services Full time

    Job Title : GCP Data EngineerJob Location – Chennai, Hyderabad, Bangalore, Pune, GurgaonExperience: 5 to 12 YearsRequirement:Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems.Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and ETLExperience...

  • GCP Data Engineer

    2 months ago

    Hyderabad, India Tata Consultancy Services Full time

    Job Title : GCP Data EngineerJob Location – Chennai, Hyderabad, Bangalore, Pune, GurgaonExperience: 5 to 12 YearsRequirement:Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems.Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and ETLExperience...

  • GCP Data Engineer

    3 weeks ago

    Hyderabad, India Tekgence Inc Full time

    Hello Connections.. Greetings from Tekgence Inc, We have immediate openings for one of our reputed Clients, Job Description: Role :GCP Data Engineer Location : Hyderabad/Pune Primary : Linux Shell Script, SQL, GCP BigQuery, Python Secondary: CloudRun, Cloud Functions, GC Storage Interested candidates can share cvs to the mail:haneesha.b@tekgence.com

  • Gcp data engineer

    2 weeks ago

    Hyderabad, India Tekgence Inc Full time

    Hello Connections.. Greetings from Tekgence Inc, We have immediate openings for one of our reputed Clients, Job Description: Role : GCP Data Engineer Location : Hyderabad/Pune Primary : Linux Shell Script, SQL, GCP Big Query, Python Secondary: Cloud Run, Cloud Functions, GC Storage Interested candidates can share cvs to the mail:

  • Gcp data engineer

    3 weeks ago

    Hyderabad, India Tekgence Inc Full time

    Hello Connections.. Greetings from Tekgence Inc, We have immediate openings for one of our reputed Clients, Job Description: Role : GCP Data Engineer Location : Hyderabad/Pune Primary : Linux Shell Script, SQL, GCP Big Query, Python Secondary: Cloud Run, Cloud Functions, GC Storage Interested candidates can share cvs to the...

  • GCP Lead Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    GCP Lead Data EngineerWe are seeking a highly skilled GCP Lead Data Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for leading the development, deployment, and operations of our cloud-based data systems.Key Responsibilities:Technical leadership for a team of engineers that focus on development,...

  • GCP Data Engineer Position

    1 week ago

    Hyderabad, Telangana, India Tekgence Inc Full time

    Are you a data engineer looking for a new challenge?At Tekgence Inc, we have an exciting opportunity for a GCP Data Engineer to join our team!We are seeking a highly skilled and motivated individual to work on our cloud-based data infrastructure.The ideal candidate will have experience with Linux Shell Script, SQL, GCP BigQuery, and Python, as well as...

  • GCP Data Engineer

    3 weeks ago

    Hyderabad, India Tekgence Inc Full time

    Hello Connections.. Greetings from Tekgence Inc, We have immediate openings for one of our reputed Clients, Job Description: Role :GCP Data Engineer Location : Hyderabad/Pune Primary : Linux Shell Script, SQL, GCP BigQuery, Python Secondary: CloudRun, Cloud Functions, GC Storage Interested candidates can share cvs to the mail:

  • GCP Data Engineer

    3 weeks ago

    Hyderabad, India Tekgence Inc Full time

    Hello Connections..Greetings from Tekgence Inc,We have immediate openings for one of our reputed Clients,Job Description:Role :GCP Data EngineerLocation : Hyderabad/PunePrimary : Linux Shell Script, SQL, GCP BigQuery, Python Secondary: CloudRun, Cloud Functions, GC StorageInterested candidates can share cvs to the mail:haneesha.b@tekgence.com

  • GCP Data Engineer

    3 weeks ago

    hyderabad, India Tekgence Inc Full time

    Hello Connections..Greetings from Tekgence Inc,We have immediate openings for one of our reputed Clients,Job Description:Role :GCP Data EngineerLocation : Hyderabad/PunePrimary : Linux Shell Script, SQL, GCP BigQuery, Python Secondary: CloudRun, Cloud Functions, GC StorageInterested candidates can share cvs to the mail:haneesha.b@tekgence.com

  • GCP Data Engineer

    3 weeks ago

    Hyderabad, India Tekgence Inc Full time

    Hello Connections..Greetings from Tekgence Inc,We have immediate openings for one of our reputed Clients,Job Description:Role :GCP Data EngineerLocation : Hyderabad/PunePrimary : Linux Shell Script, SQL, GCP BigQuery, Python Secondary: CloudRun, Cloud Functions, GC StorageInterested candidates can share cvs to the mail:haneesha.b@tekgence.com

  • GCP Data Engineer

    2 weeks ago

    hyderabad, India Tekgence Inc Full time

    Hello Connections.. Greetings from Tekgence Inc, We have immediate openings for one of our reputed Clients, Job Description: Role :GCP Data Engineer Location : Hyderabad/Pune Primary : Linux Shell Script, SQL, GCP BigQuery, Python Secondary: CloudRun, Cloud Functions, GC Storage Interested candidates can share cvs to the mail:

  • GCP Data Engineer

    2 weeks ago

    Hyderabad, India AruGuru Tech Full time

    Role: Lead GCP Data EngineerExperience: 6 to 12 YearsJob Location : Hyderabad/BangalorePosition: PermanentWhat's the opportunity?In this role, you would be primarily responsible for developing, designing, and implementing high-quality dynamic websites and internal and external applications by understanding our customer's business requirements.Mandatory...

  • GCP Data Engineer

    2 weeks ago

    Hyderabad/Chennai/Bangalore/Delhi/Kolkata/Mumbai/Pune, India MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Data EngineerWe are looking for a skilled Data Engineer to join our team at MLOPS SOLUTIONS PRIVATE LIMITED. As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data engineering solutions using Google Cloud Platform (GCP).Key Responsibilities :Develop and implement data engineering solutions using standards,...