GCP Big Data Engineer

4 weeks ago

Lucknow, India People Prime Worldwide Full time

About Company: Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide. Our Engineering First approach ensures we can execute all ideas and creatively solve pressing business challenges. With industry expertise and empowered agile teams, we prioritize execution early in the process for impactful results. We combine logic, creativity and curiosity to build, solve, and create. Every day, we help clients engage with new technology paradigms, creatively building solutions that solve their most pressing business challenges and move them to the forefront of their industry.

Job Title : GCP Big Data Engineer

Key Skills : PySpark , Airflow , SQL , GCP , ETL, Python, Big Quarry

Job Locations : Gurugram ,Bangalore

Experience : 6-10 years

Education Qualification : Any Degree Graduation

Work Mode : Hybird

Employment Type : Contract

Notice Period : Immediate - 10 Days

Job description:


Job Summary

We are seeking a seasoned GCP Data Analytics professional with extensive experience in Big Data technologies and Google Cloud Platform services to design and implement scalable data solutions

Job Description

Design develop and optimize data pipelines using GCP BigQuery Dataflow and Apache Airflow to support largescale data analytics Utilize the Big Data Hadoop ecosystem to manage and process vast datasets efficiently Collaborate with crossfunctional teams to gather requirements and deliver reliable data solutions Ensure data quality consistency and integrity across multiple data sources Monitor and troubleshoot data workflows to maintain high system availability and performance Stay updated with emerging trends and best practices in GCP data analytics and big data technologies

Roles and Responsibilities

Implement and manage ETL processes leveraging GCP services such as BigQuery Dataflow and Airflow Develop scalable maintainable and reusable data pipelines to support business intelligence and analytics needs Optimize SQL queries and data models for performance and cost efficiency in BigQuery Integrate Hadoop ecosystem components with GCP services to enhance data processing capabilities Automate workflow orchestration using Apache Airflow for seamless data operations Collaborate with data engineers analysts and stakeholders to ensure alignment of data solutions with organizational goals Participate in code reviews testing and deployment activities adhering to best practices Mentor junior team members and contribute to continuous improvement initiatives within the data engineering team



Skills


Mandatory Skills : GCP Storage,GCP BigQuery,GCP DataProc,GCP Cloud Composer,GCP DMS,Apache airflow,Java,Python,Scala,GCP Datastream,Google Analytics Hub,GCP Workflows,GCP Dataform,GCP Datafusion,GCP Pub/Sub,ANSI-SQL,GCP Dataflow,GCP Data Flow,GCP Cloud Pub/Sub,Big Data Hadoop Ecosystem

  • Senior engineering manager-big data, generative ai

    3 weeks ago

    Lucknow, India Extreme Networks Full time

    Over 50,000 customers globally trust our end-to-end, cloud-driven networking solutions. They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver unprecedented progress. With double-digit growth year over year, no provider is better positioned to deliver scalable outcomes than Extreme.Inclusion is one of...

  • Data Quality Engineer

    2 weeks ago

    Lucknow, Uttar Pradesh, India Ditstek Innovation Pvt. Ltd. Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Job Title : Data Quality Engineer (Data QE) Job Description :We are seeking a skilled and experienced Data Quality Engineer (Data QE) to join our team. The ideal candidate will have a strong background in Quality Engineering, ETL and database testing, and hands-on expertise with Python, PySpark, SQL, and Databricks. You will be responsible for designing...

  • Data Engineer

    2 weeks ago

    Lucknow, Uttar Pradesh, India CloudKeeper Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    DescriptionAbout CLOUDKEEPER :CloudKeeper is a cloud cost optimization partner that combines the power of group buying & commitments management, expert cloud consulting & support, and an enhanced visibility & analytics platform to reduce cloud cost & help businesses maximize the value from AWS, Microsoft Azure, & Google Cloud. A certified AWS Premier...

  • Data pipeline engineer

    4 weeks ago

    Lucknow, India JRD Systems Full time

    The Role: Backend and Data Pipeline Engineer:The Team: We are investing in technology to develop new products that help our customers drive their growth and transformation agenda. These include new data integration, advanced analytics, and modern applications that address new customer needs and are highly visible and strategic within the organization. Do you...

  • Lead technical recruiter

    6 days ago

    Lucknow, India DynPro Inc. Full time

    Lead Recruiter — Core Tech (Data / Cloud / Integration) – US StaffingLocation: India (Remote/Hybrid) • Shift: US • Function: Talent Acquisition – US MarketAbout the roleWe’re scaling our Core Tech desk across Data (Snowflake, Databricks, Big Query, dbt), Cloud (AWS/Azure/GCP), Integration/Automation (Workato, Mule Soft, Boomi, Tray), and...

  • Senior ai engineer

    3 weeks ago

    Lucknow, India Chetty Technologies Full time

    Company DescriptionChetty Technologies is a specialized Technology Company providing high-end consulting services in the Banking & Finance, Telecom, Healthcare, and Hospitality domains. With offices in the US and India, we offer solutions in Application Development, AI & Machine Learning, Big Data & Analytics, Business Intelligence, Robotic Process...

  • Data Science Trainer

    1 day ago

    Lucknow, Uttar Pradesh, India UNI Business Solutions Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Deliver training on data analysis, machine learning, and Python/R Strong knowledge of statistics and data visualization tools Experience with SQL and Big Data technologies Excellent communication and teaching skills required

  • Databricks data engineer

    4 days ago

    Lucknow, India Insight Global Full time

    ** Immediate Joiner **Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain. The ideal candidate will have hands-on expertise in Databricks, SQL, and Python, and a strong understanding of pharma/life sciences data. This role involves building and...

  • AI/ML DATA Engineering

    2 weeks ago

    Gomtinagar, Lucknow, Uttar Pradesh, India DISPL Full time ₹ 4,20,000 - ₹ 9,60,000 per year

    AI/ML Data EngineerWe are looking for a passionate AI/ML Data Engineer to join our growing data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that power our machine learning and analytics initiatives.You will collaborate closely with data scientists, ML engineers, and...

  • Node.js - backend developer - founding team engineer

    2 weeks ago

    Lucknow, India Trackzio Mobile Applications Private Limited Full time

    About TrackzioTrackzio is a 1-year-old startup building mobile apps that improve productivity, health, and personal development. With a lean team of 9, we ship delightful, ai based, data-driven products—from habit trackers and child-care tools to hobbyist utilities for coin collectors, gardeners, and more.Role OverviewWe’re hiring a Node.js Backend...