GCP Data Engineer

4 weeks ago


PuneHyderabadAnywhere in IndiaMultiple Locations, IN Huquo Full time

Job Description :


Must-Have :

- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.

- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure

- Strong technical expertise in Python and SQL

- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage, Cloud Composer, DataProc, Dataflow, Pub/Sub.

- Experience with Big Data Tools such as Hadoop and Apache Spark (Pyspark)

- Experience Developing DAGs in Apache Airflow 1.10.x or 2. x

- Good Problem-Solving Skills

- Detail Oriented

- Strong Analytical skills working with a large store of Databases and Tables

- Ability to work with geographically diverse teams.

Good to Have :

- Certification in GCP service.

- Experience with Kubernetes.

- Experience with Docker

- Experience with CircleCI for Deployment

- Experience with Great Expectations.

Responsibilities :

- Build Data and ETL pipelines in GCP.

- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Talend, Java

- Interact with customers on daily basis to ensure smooth engagement.

- Responsible for timely and quality deliveries.

- Fulfill organization responsibilities : Sharing knowledge and experience with the other groups in the organization, and conducting various technical training sessions.

Location : Pune, Hyderabad, Remote

Education : Bachelors or Masters (preferably BE/B.Tech) - Computer Science/IT.

(ref:hirist.tech)

  • Anywhere in India/Multiple Locations, IN Cloudsufi India Private Limited Full time

    About Us :CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for the Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting-edge infrastructure and cloud services. We partner...

  • GCP Data Architect

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Huquo Full time

    Role : GCP Data Architect Description : As a GCP Data Architect, you will be responsible for architecting enterprise data solutions for migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable...

  • Sigmoid Analytics

    4 weeks ago


    Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full time

    This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...

  • Sigmoid Analytics

    4 weeks ago


    Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full time

    Job Description :This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Change leaders Full time

    Primary Skill - GCP + Python + SQLORGCP + Java + SQL NP - Immediate to 35 Days maxJob Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida- Bachelor's degree in computer science or a related discipline- 6+ years of applicable engineering experience- Experience in GCP, Big Query- Strong proficiency in Python with an emphasis in...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations/Pune, IN Rocket Consulting Full time

    A Data Engineer/developer having good experience working withPrimary skills : Python, AirFlow - ETL skills - GCPSecondary skills : Google Cloud Composer - Google Big Query - Google Cloud- Storage - SQL - MS SQL Serve- Proven experience as a Data Engineer/Developer with expertise in Python, Airflow, and GCP.- Strong understanding of ETL concepts and best...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations, IN AAR Consultancy Full time

    Technical Skills :1. Google Cloud Platform (GCP) : In-depth knowledge and hands-on experience with GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Data Studio, and Cloud Storage.2. Data Engineering : Strong understanding of data engineering principles, including data ingestion, transformation, processing, and storage.3. Big Data Technologies :...

  • Big Data Developer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Risk Resources LLP Full time

    Responsibilities :- Lead and mentor a team of Big Data engineers in designing, developing, and deploying big data solutions on GCP- Define the technical vision and roadmap for big data architecture within the organization- Architect and implement scalable, high-performance big data pipelines using technologies like MapReduce, Hive, Spark, and BigQuery-...

  • Data Engineer

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Connectio IT Pvt Ltd Full time

    This is a full-time on-site role for a GCP Data Engineer. As a Data Engineer, your responsibilities will include data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Job Description :- You will work closely with the development team to design and implement data solutions to meet the organization's needs.-...

  • Aptus Data Labs

    1 day ago


    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...


  • Anywhere in India/Multiple Locations, IN SportsGameX Full time

    SportsGameX is seeking a highly skilled and experienced Senior Data Engineer to join our data team. This is an exciting opportunity to play a key role in designing and implementing robust data pipelines for our advanced analytics and machine learning Overview :As a Senior Data Engineer, you will be responsible for architecting, implementing, and maintaining...

  • MLOps Engineer

    1 day ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • GCP Developer

    2 weeks ago


    Bangalore/Pune/Noida/Hyderabad/Chennai, IN Nilasu consulting Full time

    JOB DESCRIPTION:Must Have: - Min 3 years' Experience with Building Pipelines using GCP-Big-Query - Min 2-3 Experience in working on Large Scale Data warehouses like Teradata - Experience building and optimizing data warehousing data pipelines (ELT and ETL), architectures and data sets. - Advanced working SQL knowledge and experience working with...


  • Anywhere in India/Multiple Locations, IN Havells India Limited Full time

    Must have : - 3-7 years of meaningful experience in data engineering working on building ETL pipelines, big data tech like spark- Very good expertise in algorithms and data structures- Excellent in at least one programming language: Python, Go, R- Hands-on expertise big data technologies such as Apache Spark, Hadoop, message queues(Kafka), Apache Airflow,...

  • Data Engineer

    4 weeks ago


    Trivandrum/Thiruvananthapuram/Cochin/Kochi/Anywhere in India/Multiple Locations, IN ProPMO Services Private Limited Full time

    Job Description :We have a requirement for 3 Data Engineers who could join us on a short notice.3 to 8 years of professional software development/engineering experience.Specialist experience working in Python coding as a Data Engineer. Must have good experience working with databases PostgreSQL/MySQL/MS SQL.Must have good experience working in AWS/GCP...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Lancesoft India Pvt Ltd Full time

    Hiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have...


  • Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN consultancy Full time

    Note : It's a work-from-home opportunity.Skills You must have experience with:- Twilio Segment - Customer Data Platform- Google Analytics (Inc. Firebase)- Experience creating tailored dashboards using PowerBi- Experience in data management, data warehousing, data quality, data lakes, data marts- Deep understanding of data platform technologies, SQL...

  • Data Scientist

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Awign Full time

    About Awign Expert : Awign Expert is an Enterprise focused platform that helps businesses Hire, Assess and Manage high skilled resources for Gig Based Projects. We provide our Experts a gateway to work for and build a freelance/consulting career with large scale Enterprises. We are a newly launched business division of Awign, which is one of the pioneers and...

  • Java GCP Developer

    4 weeks ago


    Bangalore/Pune/Hyderabad, IN Swift Strategic Staff Solutions INC Full time

    Job Description:- We are seeking a skilled Java GCP Developer to join our team and contribute to the development of our Payments Data Platform within Google Cloud Platform (GCP).- The ideal candidate will be responsible for executing project-specific development activities, ensuring adherence to applicable standards and quality parameters.- They will own and...