GCP Big Data Engineer

6 days ago

Solapur, India HARP Full time

Job Summary:

We are looking for an experienced and motivated GCP Big Data Engineer to join our team in a leadership capacity. The ideal candidate will have 8–10 years of relevant experience in data engineering, with a strong focus on Google Cloud Platform (GCP), SQL, PySpark, and ETL processes. This role requires strong technical expertise and leadership capabilities to guide and mentor a team of engineers while ensuring high-quality data solutions.

Key Responsibilities:

  • Design, develop, and maintain scalable and efficient data pipelines on Google Cloud Platform (GCP).
  • Work with PySpark to process large-scale datasets and optimize performance.
  • Write complex and efficient SQL queries for data extraction, transformation, and analysis.
  • Lead the implementation of ETL workflows and ensure data accuracy, completeness, and integrity.
  • Collaborate with cross-functional teams including data analysts, architects, and product managers to define data needs.
  • Provide technical leadership, mentorship, and code reviews for junior engineers.
  • Drive best practices for data engineering and cloud-based data processing.

Required Skills & Qualifications:

  • 8–10 years of experience in Data Engineering roles.
  • Proven experience with Google Cloud Platform (GCP) and its data services (e.g., BigQuery, Dataflow, Cloud Storage).
  • Strong programming skills in PySpark and Python.
  • Advanced proficiency in SQL and working with large, complex datasets.
  • Deep understanding of ETL frameworks and data pipeline orchestration.
  • Experience leading or mentoring teams in a technical capacity.
  • Excellent communication and problem-solving skills.

Preferred Qualifications:

  • GCP Certification (e.g., Professional Data Engineer) is a plus.
  • Experience with CI/CD pipelines and data pipeline automation.
  • Familiarity with Agile/Scrum methodologies.

  • GCP Data Architect

    3 weeks ago

    Solapur, Maharashtra, India HCLTech Full time

    Role: GCP Data ArchitectTotal years of experience: 12+ YearsLocation: Noida, Bangalore, Chennai, Pune, HyderabadRelevant experience for engagement: 10 YearsRelevant skillset:Maintain architecture principles, guidelines and standardsData WarehousingProgramming Language: Python/JavaBig DataData AnalyticsGCP ServicesRelevant technology domains:Experience in...

  • Data Engineer

    3 weeks ago

    Solapur, Maharashtra, India Sapaad Full time

    WHO WE ARESapaad is a global leader in unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering thousands of F&B businesses across 40+ countries—with many more coming onboard each day.Driven by a...

  • Senior Data Engineer

    3 weeks ago

    Solapur, Maharashtra, India Celebal Technologies Full time

    Job Description- Senior Data Engineer (Teradata Migration Specialist)About Us Celebal Technologies is a leading Solution Service company that provides services in the fields of Data Science, Big Data, Enterprise Cloud, and Automation. We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance our business processes. As...

  • Data Engineer

    3 weeks ago

    Solapur, Maharashtra, India Talescope Full time

    About the Role:We are looking for a highly experienced and hands-on Data Engineer (AdTech) to lead our analytics team. This role is ideal for someone with a strong background in log-level data handling, cross-platform data engineering, and a solid command of modern BI tools. You'll play a key role in building scalable data pipelines, leading analytics...

  • Data engineer

    2 weeks ago

    Solapur, India Randstad Enterprise Full time

    Role : Data EngineerLocation : RemoteShift Timing : 2:00 Pm - 11:00 PmExperience : 2- 4 years relevant only ( this is a Junior position with us )Must have skillset :GCP - 2 years minimumPython and Pyspark - 2 yearsSQL - 2 yearsExcellent communicationWorked with global stakeholdersWho we are:Randstad Sourceright’s global talent solutions provides instant...

  • Senior AI Platform Engineer

    2 weeks ago

    Solapur, India Jaipur Robotics Full time

    Location: Remote (availability to work in the CET timezone)Who we areAt Jaipur Robotics, we envision a future where data from waste is abundant, driving automation and digital transformation across the waste industry. We’re developing cutting-edge intelligent solutions that are revolutionising operational pipelines for the European waste sector, unlocking...

  • Data Engineer

    2 weeks ago

    Solapur, India Randstad Enterprise Full time

    Role : Data EngineerLocation : RemoteShift Timing : 2:00 Pm - 11:00 PmExperience : 2- 4 years relevant only ( this is a Junior position with us )Must have skillset :GCP - 2 years minimum working Experience Python and Pyspark - 2 yearsSQL - 2 yearsExcellent communicationWorked with global stakeholdersWho we are:Randstad Sourceright’s global talent solutions...

  • Senior Data Scientist

    1 week ago

    Solapur, India Delivery Hero Full time

    About Delivery Hero: As the world’s leading local delivery platform, our mission is to deliver an amazing experience, fast, easy, and to your door. We operate in over 70+ countries worldwide, powered by tech but driven by people. As one of Europe’s largest tech platforms, we enable ambitious talent to deliver solutions that create impact within our...

  • AWS Senior Data Engineer

    3 weeks ago

    Solapur, Maharashtra, India InfoCepts Full time

    Key Result Areas and Activities: Study existing technology landscape and understand current data integration framework and do impact assessment for the requirements.Develop spark jobs using Scala for new project requirements.Enhance existing spark jobs for any ongoing product enhancement.Performance tuning of spark jobs, stress testing etc.Create new data...

  • Cloud Engineer

    2 days ago

    Solapur, India EXL Full time

    We're looking for a highly skilled and experienced Cloud AI Engineer to join our dynamic team. In this role, you'll be instrumental in designing, developing, and deploying cutting-edge artificial intelligence and machine learning solutions leveraging the full suite of Google Cloud Platform (GCP) services.Objectives of this roleLead the end-to-end development...