GCP Data Engineer

3 months ago


Rajkot, India Quantiphi Full time

Designation: Data Engineer

Experience Level: 4-16 Years

Location: Mumbai/Bangalore/Trivandrum


Role & Responsibilities:

  • In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable
  • Must have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB
  • Solid understanding of relational database concepts and technologies such as SQL, MySQL, PostgreSQL, or Oracle.
  • Hands-on experience with other cloud platforms and services such as AWS RDS, or Azure SQL Database.
  • Experience with NoSQL databases such as MongoDB, Scylla, Cassandra, or DynamoDB is a plus.
  • Familiarity with database performance tuning, optimization, and troubleshooting techniques is a plus
  • Strong working experience on one or more of the Big Data/Hadoop distributions (or ecosystems) like, Cloudera/Hortonworks, MapR, Azure HDInsight, IBM Open platform, Kafka, Hive, Spark etc.
  • Good understanding of the following AWS Data services, Redshift, RDS, Athena or SQS/Kinesis
  • Good understanding of Native and external tables, with different file formats : Avro, ORC, Parquet
  • CI/CD pipelines for data workloads using Cloud Build, Artifact Registry, Terraform
  • Data governance solutioning using GCP governance tooling (Dataplex, Data Catalog)


Skills required:

  • GCP Dataflow, Pub/Sub, Cloud Composer, Cloud Workflow, BigQuery, Cloud Run, CloudBuild
  • Must have: programming knowledge and willingness to be hands-on - Python, Java
  • Specialization on streaming such as PubSub or Kafka or equivalent


Good to have:

  • Experience in BigQuery or Presto or Equivalent
  • Experience with open source ecosystem and distributions such as Hadoop, Spark, Cloudera/Hortonworks and frameworks and tech such as SPARK, Oozie, Kafka, HBASE
  • Understanding and experience with NoSQL databases such as HBASE, MongoDB, Cassandra
  • Knowledge of cloud databases such as Spanner, BigTable, Cloud SQL, DB migrations
  • Good to have GCP Data engineering Certification


  • Data Engineer

    1 month ago


    Rajkot, India NCR Voyix Full time

    Position Summary & Key Areas of ResponsibilityWe are looking for a passionate professional who can blend the fast-changing technology landscape of Cloud based Big Data & Advanced Analytics with the complex and high-impact space of IoT Analytics. The Senior Big Data Engineer is responsible for partnering with business unit leaders within NCR Voyix to analyze,...


  • Rajkot, Gujarat, India ScoreTravel Full time

    **About ScoreTravel**We're a leading travel technology company seeking an experienced Data Engineering Lead to join our team.This is an opportunity to lead the development of our data engineering infrastructure, working closely with cross-functional teams to design and implement scalable solutions.As a seasoned professional in the field, you'll have a deep...


  • Rajkot, Gujarat, India Emeritus Full time

    About Emeritus:Emeritus is committed to making high-quality education accessible and affordable. We achieve this by collaborating with top-tier universities worldwide, offering a range of programs that help individuals transform their lives and companies.Role Overview: We're seeking a Senior Data Engineer to join our dynamic team and shape the future of our...


  • Rajkot, Gujarat, India Emeritus Full time

    About Emeritus:Emeritus is committed to making high-quality education accessible and affordable to individuals, companies, and governments worldwide. It achieves this by collaborating with over 50 top-tier universities across the globe. The company offers a range of programs, including short courses, degree programs, professional certificates, and senior...


  • Rajkot, India True Tech Professionals Full time

    ● Overall 7+ Years and 4+ years of experience in data engineering and analytics.● Strong experience with cloud data solutions (AWS preferred), ETL processes, and Big Data tools.● Hands-on experience with data storage systems such as S3, MinIO, and Snowflake.● Familiarity with Kafka for real-time data streaming and Airflow for scheduling and...


  • Rajkot, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: Location - AhmedabadKey Responsibilities...


  • Rajkot, Gujarat, India Gloroots Full time

    Are you a skilled DevOps professional looking to take your career to the next level? We're seeking a highly motivated Cloud Infrastructure Engineer to join our team at Gloroots (Recrew.ai), a pioneering company revolutionizing the recruiting industry with cutting-edge AI solutions.We offer a competitive salary range of $120,000 - $180,000 per annum,...


  • Rajkot, India Core Minds Tech SOlutions Full time

    Job Description :In this role, you will :- Manage and develop team of data analysts with low to moderate complexity and risk in data management and technology, and engage stakeholders and internal partners- Identify and recommend opportunities for process improvement and risk control development- Operate data environments, integrate with new technologies and...

  • DevOps Engineer

    2 months ago


    Rajkot, India AORBIS Inc Full time

    About Our Company:Aerocraft Engineering India Pvt Ltd based in Ahmedabad, provides services to US based Architecture, Engineering and Construction group of companies:- Russell and Dawson – An Architecture/Engineering/Construction firm ( United-BIM – BIM Modeling Services Firm ( AORBIS – Procurement as a Service Provider ( Location:- Ahmedabad...


  • Rajkot, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring forAWS Data EngineerDesired experience range:4 to 8 YearsJob location:Bangalore / Chennai / PuneMust have skillsSQLPythonPyspark/ spark / ScalaAWS Services – GlueAWS RedshiftAirflow DAGsGood to haveGood knowledge in ETL Data WarehousingRegardsAankhi DebTalent Acquisition - TCS


  • Rajkot, India Welspun Transformation Services Limited Full time

    Job DescriptionAs a Multi Agent AI/RPA Automation Engineer Manager, you will be responsible for leading the design, development, and implementation of AI models and Robotic Process Automation (RPA) solutions. You will be working closely with various teams to understand business processes and identify areas for automation. You will also be responsible for...


  • Rajkot, Gujarat, India Netstratum Technologies Full time

    About Netstratum TechnologiesNetstratum Technologies is a cutting-edge technology company that empowers businesses to harness the power of data-driven insights. We are seeking a highly skilled and experienced Data Engineer to join our team and contribute to shaping the future of data management.Key ResponsibilitiesCreate and manage automated data pipelines...

  • Subhanu Technologies

    2 weeks ago


    rajkot, India Subhanu Technologies & Solutions Full time

    We are seeking highly specialized candidates willing to work in India / Korea time zone and completely remote for an exciting project.SALARY IS NOT CONSTRAINT FOR THE RIGHT CANDIDATE The role is Compute Service Engineer with 8+ years of experience. This team is responsible for the compute system design, hardware optimization, OS hardening, system...


  • Rajkot, India Worksol Services Full time

    Company DescriptionWorksol Services in Ahmedabad specializes in engineering and non-engineering services, including designing, estimating, manufacturing, quality engineering, project management, data analysis, and software duties.Role DescriptionThis is a full-time on-site Mechanical Engineering Intern role at Worksol Services in Ahmedabad. The intern will...

  • Python Developer

    2 weeks ago


    Rajkot, India Adani AI Labs Full time

    Job Description:Purpose:We are looking for an experienced Software Developer to join our dynamic team in Ahmedabad. As a Software Developer, you will be responsible for developing and maintaining high-performance backend applications, utilizing your expertise in Python. The ideal candidate will have a strong background in backend development and a passion...


  • Rajkot, India Technavious Full time

    Job Description: Data Center ELV Design Expert (10+ Years of Experience in Hyperscale Data Center Design)Position: Data Center ELV Design Expert Location: Mumbai/Chennai Department: Engineering / Data Center Design Reports to: Head of Engineering Employment Type: Full-TimeOverview: We are looking for a highly experienced Data Center ELV Design Expert with...


  • Rajkot, India Welspun Transformation Services Limited Full time

    Job DescriptionAs a Security Engineer Manager, you will be responsible for leading a team of security engineers to ensure the safety and integrity of our company's information systems. You will be tasked with developing and implementing security measures, protocols, and policies to protect the organization's data from cyber threats. You will also be...

  • Frontend Developer

    1 month ago


    Rajkot, India Three Across Full time

    Frontend (TypeScript) Developer Job DescriptionLocation: Noida, Hybrid (3 Days from Office)Employment Type: Full-timeCompensation: 25 Lacs - 30 LacsRole Summary:We are looking for a skilled TypeScript Developer to design, develop, and maintain cutting-edge software applications. This role involves collaborating with cross-functional teams to create...

  • Full Stack Engineer

    4 months ago


    rajkot, India Agoda Full time

    About Agoda Agoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with more than 3.6 million accommodations globally. Based in Asia and part of Booking Holdings, our 6,000+ employees representing 90+ nationalities foster a work environment rich in diversity,...

  • Entry-Level Engineer

    3 months ago


    rajkot, India Workassist Full time

    Work Level: IndividualCore: OrganizedLeadership: Customer FocusRole: N/AIndustry Type: Recruitment/StaffingFunction: Head - RecruitmentKey Skills: State Bank of IndiaEducation: GraduateNote: This is a requirement for one of the Workassist Hiring PartnerRole DescriptionThis is a full-time entry-level engineer role at Workassist located in Pune. As an...