GCP Big Data Engineer

2 weeks ago


Jamnagar, Gujarat, India People Prime Worldwide Full time

About Company: Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide. Our Engineering First approach ensures we can execute all ideas and creatively solve pressing business challenges. With industry expertise and empowered agile teams, we prioritize execution early in the process for impactful results. We combine logic, creativity and curiosity to build, solve, and create. Every day, we help clients engage with new technology paradigms, creatively building solutions that solve their most pressing business challenges and move them to the forefront of their industry.

Job Title : GCP Big Data Engineer

Key Skills : PySpark , Airflow , SQL , GCP

Job Locations : Gurugram

Experience : 5-10 years

Education Qualification : Any Degree Graduation

Work Mode : Hybird

Employment Type : Contract

Notice Period : Immediate - 10 Days

Job description:

Job Summary

We are seeking a seasoned GCP Data Analytics professional with extensive experience in Big Data technologies and Google Cloud Platform services to design and implement scalable data solutions

Job Description

Design develop and optimize data pipelines using GCP BigQuery Dataflow and Apache Airflow to support largescale data analytics Utilize the Big Data Hadoop ecosystem to manage and process vast datasets efficiently Collaborate with crossfunctional teams to gather requirements and deliver reliable data solutions Ensure data quality consistency and integrity across multiple data sources Monitor and troubleshoot data workflows to maintain high system availability and performance Stay updated with emerging trends and best practices in GCP data analytics and big data technologies

Roles and Responsibilities

Implement and manage ETL processes leveraging GCP services such as BigQuery Dataflow and Airflow Develop scalable maintainable and reusable data pipelines to support business intelligence and analytics needs Optimize SQL queries and data models for performance and cost efficiency in BigQuery Integrate Hadoop ecosystem components with GCP services to enhance data processing capabilities Automate workflow orchestration using Apache Airflow for seamless data operations Collaborate with data engineers analysts and stakeholders to ensure alignment of data solutions with organizational goals Participate in code reviews testing and deployment activities adhering to best practices Mentor junior team members and contribute to continuous improvement initiatives within the data engineering team

Skills

Mandatory Skills : GCP Storage,GCP BigQuery,GCP DataProc,GCP Cloud Composer,GCP DMS,Apache airflow,Java,Python,Scala,GCP Datastream,Google Analytics Hub,GCP Workflows,GCP Dataform,GCP Datafusion,GCP Pub/Sub,ANSI-SQL,GCP Dataflow,GCP Data Flow,GCP Cloud Pub/Sub,Big Data Hadoop Ecosystem



  • Jamnagar, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    About our organization: We prioritize execution, creativity and curiosity to build innovative solutions.We combine logic and expertise to help clients navigate new technology paradigms, creating impactful results.Key Skills:PySparkAirflowSQLGCPData Pipeline Engineer Roles and Responsibilities:Design, develop and optimize data pipelines using GCP services...


  • Jamnagar, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Pipeline Architect - Join a dynamic team as a Senior GCP Data Engineer and unleash your expertise in building robust data pipelines on the Google Cloud Platform. About the RoleWe are seeking a seasoned professional with 10+ years of experience to work on challenging projects for industries like Energy, Oil & Gas, Healthcare, and Finance. As a remote...


  • Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Engineer for Scalable SolutionsWe are seeking an experienced Big Data Engineer to join our organization. This role offers a unique opportunity for professionals passionate about designing and implementing scalable data engineering solutions using Google Cloud Platform (GCP) services and Big Data Analytics.Key Responsibilities:Design, build, and...

  • Data Engineer

    2 weeks ago


    Jamnagar, Gujarat, India HCLTech Full time

    Role: Data EngineerTotal years of experience: 9+ YearsLocation: PAN India (Any HCL office)Relevant experience for engagement: 5 YearsNote: - We are conducting a virtual discussion on this coming Saturday, 13th of Sep 25 from 9:30 am to 6:30 pm, if interested please feel free to share your profilesJob Description:Relevant Skills:Maintain architecture...


  • Jamnagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Opportunity OverviewWe are seeking a skilled Big Data Specialist to join our team. The ideal candidate will have expertise in designing and developing scalable data pipelines using Big Data technologies.Key Skills We're Looking For:6-12 years of experience in Big Data and related technologies.Strong understanding of data structures and algorithms.Experience...

  • GCP AI/ML Expert

    7 days ago


    Jamnagar, Gujarat, India beBeeMachineLearning Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: GCP AI/ML ExpertRole Overview:We are seeking a skilled GCP AI/ML Engineer to design and develop innovative AI/ML models using Google Cloud Platform technologies.Main Responsibilities:Design, develop, and deploy AI/ML models using Google Cloud Platform (GCP) services like Vertex AI.Implement data ingestion and ETL pipelines using GCP services like...


  • Jamnagar, Gujarat, India beBeeCloudDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Cloud Data Solutions EngineerTotal years of experience: 9+ YearsAbout the Role:We are seeking a skilled Cloud Data Solutions Engineer to join our team. As a seasoned professional, you will be responsible for designing and implementing cloud-based data solutions that meet the needs of our clients.Key Responsibilities:Design and develop scalable and...


  • Jamnagar, Gujarat, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    We are seeking an experienced Data Architect to lead our data engineering solutions. The ideal candidate will have a strong understanding of cloud-native data services, big data technologies, and data warehousing concepts.Job OverviewThis key role involves designing and developing robust data architectures, leading the implementation of data solutions on...


  • Jamnagar, Gujarat, India beBeeDataSolutions Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleWe are seeking a Data Solutions Architect to design and develop innovative data solutions on Google Cloud Platform (GCP). The ideal candidate will have a strong background in cloud data architecture, data warehousing, big data processing, and data integration.The successful candidate will be responsible for:Designing end-to-end data solutions on GCP...


  • Jamnagar, Gujarat, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Cloud Data Engineer PositionWe are seeking a seasoned Cloud Data Engineer with extensive experience in designing, developing, and maintaining robust data pipelines and scalable data lakes.Data Pipeline Development: Develop and optimize ETL pipelines using cloud-native tools like AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL...