GCP Big Data Engineer

2 weeks ago

Agra, Uttar Pradesh, India People Prime Worldwide Full time

About Company: Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide. Our Engineering First approach ensures we can execute all ideas and creatively solve pressing business challenges. With industry expertise and empowered agile teams, we prioritize execution early in the process for impactful results. We combine logic, creativity and curiosity to build, solve, and create. Every day, we help clients engage with new technology paradigms, creatively building solutions that solve their most pressing business challenges and move them to the forefront of their industry.

Job Title : GCP Big Data Engineer

Key Skills : PySpark , Airflow , SQL , GCP

Job Locations : Gurugram

Experience : 5-10 years

Education Qualification : Any Degree Graduation

Work Mode : Hybird

Employment Type : Contract

Notice Period : Immediate - 10 Days

Job description:

Job Summary

We are seeking a seasoned GCP Data Analytics professional with extensive experience in Big Data technologies and Google Cloud Platform services to design and implement scalable data solutions

Job Description

Design develop and optimize data pipelines using GCP BigQuery Dataflow and Apache Airflow to support largescale data analytics Utilize the Big Data Hadoop ecosystem to manage and process vast datasets efficiently Collaborate with crossfunctional teams to gather requirements and deliver reliable data solutions Ensure data quality consistency and integrity across multiple data sources Monitor and troubleshoot data workflows to maintain high system availability and performance Stay updated with emerging trends and best practices in GCP data analytics and big data technologies

Roles and Responsibilities

Implement and manage ETL processes leveraging GCP services such as BigQuery Dataflow and Airflow Develop scalable maintainable and reusable data pipelines to support business intelligence and analytics needs Optimize SQL queries and data models for performance and cost efficiency in BigQuery Integrate Hadoop ecosystem components with GCP services to enhance data processing capabilities Automate workflow orchestration using Apache Airflow for seamless data operations Collaborate with data engineers analysts and stakeholders to ensure alignment of data solutions with organizational goals Participate in code reviews testing and deployment activities adhering to best practices Mentor junior team members and contribute to continuous improvement initiatives within the data engineering team

Skills

Mandatory Skills : GCP Storage,GCP BigQuery,GCP DataProc,GCP Cloud Composer,GCP DMS,Apache airflow,Java,Python,Scala,GCP Datastream,Google Analytics Hub,GCP Workflows,GCP Dataform,GCP Datafusion,GCP Pub/Sub,ANSI-SQL,GCP Dataflow,GCP Data Flow,GCP Cloud Pub/Sub,Big Data Hadoop Ecosystem

  • Big Data Expert

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 35,00,000

    Big Data Engineer Role Overview We are seeking a skilled Big Data Engineer to join our team. The ideal candidate will have expertise in designing, developing, and optimizing data pipelines using GCP BigQuery, Dataflow, and Apache Airflow.Key Responsibilities:Design and develop scalable and maintainable data pipelines to support business intelligence and...

  • AWS Big Data Engineer

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    AWS Big Data EngineerWe are seeking a highly skilled professional to design, develop and optimize large-scale Big Data architectures leveraging AWS services. The ideal candidate will bring strong hands-on experience in designing and implementing scalable data engineering solutions.

  • Senior Big Data Engineer

    1 week ago

    Agra, Uttar Pradesh, India beBeeBigDataDeveloper Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Developer PositionThis is a challenging role that requires the development and implementation of scalable data-driven solutions. As a Big Data Developer, you will work on various projects, utilizing your expertise in Hadoop, Spark, Hive, HDFS, and Kafka to design, install, configure, and support Big Data clusters.The ideal candidate should have...

  • Established Data Engineering Expert Wanted

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionAs a seasoned Data Engineer, you will be responsible for maintaining architecture principles and standards, with expertise in data warehousing, big data, data analytics, and Google Cloud Platform services.The ideal candidate should have 9+ years of experience, with a minimum of 5 years relevant experience for this engagement. Proficiency in...

  • Cloud Data Engineering Expert

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 1,86,37,500 - ₹ 2,51,25,000

    Unlock Career Advancement in Cloud Data EngineeringTalentmatics seeks an experienced GCP Data Engineer with 5-10 years of experience in designing and implementing scalable data engineering solutions on cloud-based projects.Primary Responsibilities:Develop efficient large-scale data processing pipelines using BigQuery, Dataflow, DataProc, and Cloud...

  • Big Data Specialist

    1 week ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Job OverviewWe are seeking a skilled Data Engineer to join our global team. The successful candidate will be responsible for developing and maintaining large-scale data engineering pipelines.The ideal candidate will have a strong background in Big Data technologies, including Spark and Databricks. They will also possess excellent analytical skills, with the...

  • Senior Data Engineering Specialist with GCP

    1 week ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Are you looking for a challenging role as a Senior Data Engineer with expertise in Google Cloud Platform (GCP) and Extract, Transform, Load (ETL)?This is a fantastic opportunity to work on exciting projects that involve building pipelines using Python or Java, scripting, best practices, and overcoming challenges.The ideal candidate will have knowledge of...

  • Data Engineer

    1 week ago

    Agra, Uttar Pradesh, India beBeeCloudEngineering Full time ₹ 10,00,000 - ₹ 14,00,000

    Data Engineer - Big Data SolutionsAt Reveille Technologies Inc., we are seeking a highly skilled and experienced Data Engineer to join our team.The ideal candidate will have a strong background in designing, developing, and implementing large-scale data pipelines using AWS services such as S3, Glue, and Redshift.Key responsibilities include:Data Architecture...

  • Cloud Data Solutions Engineer

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 1,20,40,000 - ₹ 2,01,60,000

    Job Title: Cloud Data Solutions EngineerThis position involves maintaining architecture principles, guidelines and standards for cloud data solutions. The ideal candidate will have experience in designing and implementing large-scale data processing systems using Google Cloud Platform (GCP) Services.Key Responsibilities:Develop and maintain scalable data...

  • Big Data Architect

    1 week ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Opportunity: Data Engineering SpecialistWe are seeking a highly skilled data engineer to join our team as a Data Engineering Specialist. The ideal candidate will have expertise in big data engineering, cloud infrastructure, and data pipelines.This role requires a technical leader with the ability to design and implement scalable data architectures, work...