GCP Data Engineer

4 days ago

Bengaluru, India Kognivera It Solutions Private Limited Full time

Job Description About the Role: We are seeking a Lead GCP Data Engineer who can demonstrate a broad range of technical skills across Google Cloud Platform (GCP) and third-party technologies. As a pivotal member of our team, you will be responsible for designing robust data architectures, developing efficient data pipelines, and optimizing data processing workflows on GCP. Your expertise will be instrumental in driving our data engineering initiatives forward, ensuring scalability, reliability, and performance. Key Responsibilities - Data Architecture Design: Design scalable and efficient data architectures on GCP that meet the organization's data processing and analysis requirements. Collaborate closely with data scientists, business analysts, and stakeholders to define effective data models and structures. - Data Pipeline Development: Develop and implement data pipelines using GCP services such as Google Cloud Storage, Big Query, Dataflow, and Pub/Sub. Ensure data quality, reliability, and governance throughout the data lifecycle. - Data Transformation and Integration: Utilize technologies like Apache Beam, Apache Spark, and Cloud Dataproc to transform and integrate data from diverse sources. Perform data cleansing, aggregation, enrichment, and normalization to support downstream applications and analytics. - Performance Optimization: Optimize data processing workflows to enhance performance and efficiency. Monitor pipelines, identify bottlenecks, and implement optimizations such as improved data partitioning, sharding, and leveraging GCP's autoscaling capabilities. - Continuous Improvement: Stay abreast of advancements in data engineering and cloud technologies. Explore and implement new GCP features and services to enhance data processing capabilities and drive innovation within the team. - Research and Innovation: Conduct research on emerging data engineering technologies, tools, and best practices. Evaluate new methodologies to improve data engineering processes and bring innovative solutions to the organization. - Task Automation: Automate data engineering tasks using scripting, workflows, or tools like Cloud Composer and Cloud Functions. Streamline data ingestion, transformation, monitoring, and other operational processes to improve efficiency and reduce manual effort. - Attributes & Competencies - Education: BE/BTech, MTech, or MCA. - Experience: Minimum 5+ years in development/migration projects, with at least 3 years focused on GCP. Experience in GCP-based Big Data deployments (batch/real-time) using Big Query, Big Table, Google Cloud Storage, Pub/Sub, Data Fusion, Dataflow, Dataproc, and Airflow. Technical Skills - Google Certified Professional Cloud Architect with experience automating and orchestrating workloads on GCP or other public clouds. - Proficiency in at least one configuration management system (Chef, Puppet, Ansible, Salt, etc.). - Strong programming skills in Python, Go, with expertise in Git and Git workflows. - Demonstrated proficiency in CI/CD tools such as Jenkins, TeamCity, or Spinnaker.

  • GCP Data Engineer

    1 day ago

    Bengaluru, India Evnek Technologies Pvt Ltd Full time

    Job Description Job Title: GCP Data Engineer Experience: 5+   Years Location: Chennai, Bangalore, Hyderabad, Pune (Hybrid) Notice Period: Immediate Joiners Only Job Description: We are looking for an experienced GCP Data Engineer to join our dynamic team. The ideal candidate will have strong hands-on experience in Google Cloud Platform (GCP) technologies,...

  • GCP Data Engineer

    2 days ago

    Bengaluru, India Evnek Technologies Pvt Ltd Full time

    Job Title: GCP Data Engineer Experience: 5+   Years Location: Chennai, Bangalore, Hyderabad, Pune (Hybrid) Notice Period: Immediate Joiners Only Job Description: We are looking for an experienced GCP Data Engineer to join our dynamic team. The ideal candidate will have strong hands-on experience in Google Cloud Platform (GCP) technologies, particularly...

  • GCP Data Engineer

    2 days ago

    Bengaluru, India @ Six Sigma Full time

    Job Details Requirement Type Permanent Job Title GCP Data Engineer Job Level Senior Management Job Description No. of Openings 5 Job Domain IT Experience - Minimum - Maximum / Science, Economics, Computers, Electronics/Telecommunications Skills GCP Data Engineer Expected Date Of Joining Joining Time 30 Days Work Locations Bangalore Required skills GCP Data...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, India Impetus Full time

    Location: Gurgaon and BangaloreExperience: 4-7 yearsDescription:We are looking for talented GCP Data Engineer having minimum experience of 2 year in GCP Cloud, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer experience.Qualifications:Must...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India InfoVision Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Role: GCP Data Engineer (Mid-Level)Position Overview:We are seeking a mid-level GCP Data Engineer with 4+ years of experience in ETL, Data Warehousing, and Data Engineering. The ideal candidate will have hands-on experience with GCP tools, solid data analysis skills, and a strong understanding of Data Warehousing principles.Qualifications:· years of...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, India Impetus Full time

    Location: Gurgaon and Bangalore Experience: 4-7 years Description: We are looking for talented GCP Data Engineer having minimum experience of 2 year in GCP Cloud, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer experience. Qualifications:...

  • GCP Data Engineer

    3 weeks ago

    Bengaluru, India Impetus Full time

    Job Title: GCP Data Engineer Experience: 4–7 Years Location: Bangalore / Gurgaon Employment Type: Full-Time About the Role We are looking for an experienced GCP Data Engineer with a strong background in Big Data, PySpark, and Python , and hands-on experience with core Google Cloud Platform (GCP) services. The ideal candidate will be responsible for...

  • GCP Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Evnek Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title:GCP Data EngineerExperience:5+ YearsLocation:Chennai, Bangalore, Hyderabad, Pune (Hybrid)Notice Period:Immediate Joiners OnlyJob DescriptionWe are looking for an experiencedGCP Data Engineerto join our dynamic team. The ideal candidate will have strong hands-on experience in Google Cloud Platform (GCP) technologies, particularlyBigQueryandDataProc...

  • GCP Data Engineer

    1 week ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Job descriptionDesign & Develop data pipelines, ETL & data integration workflows using GCP services like Dataflow, Pub/Sub, BigQuery, Cloud StorageBuild and manage data storage systems, including databases, data lakes, and data warehouses, leveraging GCP servicesRequired Candidate profile3+ yrs exp. in GCP, ETL, & DWH concepts.Exp. with version control...

  • Gcp data engineer

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS!!!!TCS is looking for GCP Data Engineer Job Location : Chennai, Hyderabad, Bangalore, Pune, GurgaonExperience : 5to 10 Years Required technical skills: GCP Big query, Python, SQL , ETL Requirements:Proficiency in programming languages: Python, JavaExpertise in data processing frameworks: Apache Beam (Data Flow)Active...