Senior GCP Big Data Engineer

2 weeks ago


Bangalore, Karnataka, India Notus Full time

Job Title : GCP (Google Cloud Platform) Specialist

Number of Positions : 6 (1 Senior Role, 5 Lead Roles)

Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PM

Location : TechM India locations

Notice Period : Early/Immediate/30 days (Positions need to be filled by May)

Budget :

Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate sharing offer in hand proof during approval stage.

Lead Role : 6+ years of experience - Depending upon hike % and candidate sharing offer in hand proof during approval stage.

Skillset :

- GCP ETL

- Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, Python

Mandatory Requirements :

- Knowledge of Big Data Architecture patterns and experience in delivery of BigData and Hadoop ecosystems.

- Strong experience in GCP with multiple large projects involving GCP Big Query and ETL.

- Experience in GCP-based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, Airflow, Google Cloud Storage, Data Fusion, Data Flow, Dataproc, etc.

- Experience in SQL/Data Warehouse.

- Expertise in programming languages such as Java, Hadoop, Scala, Python, PySpark.

- Expertise in at least one distributed data processing framework like Spark (Core, streaming, SQL), Storm, or Flink, etc.

- Worked on any of Orchestration tools like Airflow, Oozie.

- Experience in performance tuning, optimization, and data security.

Preferred Experience and Knowledge :

- Excellent understanding of the data technologies landscape/ecosystem.

- Exposure to development with CI/CD pipeline, knowledge of containerization orchestration, and KE engine would be an added advantage.

- Familiarity with the pros and cons of various database technologies like relational, BigQuery, columnar databases, NoSQL.

-Exposure to Data governance, catalog, lineage, and associated tools would be an added advantage.

- GCP PDE certification is a plus point.

(ref:hirist.tech)
  • Senior Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP :Must be able to write quality code and build secure, highly available...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Muoro Full time

    Job Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Unison Consulting

    3 weeks ago


    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....

  • Databricks Architect

    2 weeks ago


    Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...

  • Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Intelli Swift Full time

    Data Engineer - Bangalore (Hybrid) Position : Data Engineer Experience : 7-12 Years Notice Period : less than 15-20 days Mode of Hiring : Permanent Work Location : Bangalore (Hybrid Must Have skills : Data Engineer, GCP, Big Query, Python, SQL, big data. Job Requirement Must Have skills : 1. Designing and implementing data pipelines and infrastructure 2....

  • Big Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India TalentPulse Consultant Full time

    Role : Big Data EngineerJob Description :We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis.The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala.This is an active position with a high priority, offering a competitive rate and the...


  • Bangalore, Karnataka, India Zyoin group Full time

    We are seeking a highly experienced Senior Software Engineer with expertise in Machine Learning (ML) Infrastructure to join our team.- The ideal candidate will have a strong background in designing large-scale and production ML infrastructure systems or distributed systems.- This role requires deep knowledge of building distributed systems or recommendation...

  • Big Data Engineer

    4 weeks ago


    Bangalore/Hyderabad, Karnataka, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:- This position will be part of a growing team working towards building world class large scale Big Data architectures.- This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to spend a majority of their time coding.Location - Bangalore and...


  • Bangalore, Karnataka, India People Impact Full time

    Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent :- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 5+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL).- Solid Datawarehousing concepts.- Knowledge...

  • Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India ARR Recruitment Solutions Full time

    Job Description : We are looking for a highly skilled Senior Data Engineer with extensive experience in data integration, processing, and application development for handling large-scale data sets measured in Terabytes from multiple sources.- The ideal candidate will have a strong background in AWS services, particularly Lambda, EMR, and Glue, along with...

  • Senior Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India MIQ Digital Full time

    Role : Sr. Data EngineerLocation : BengaluruWhat you'll do :We're MiQ, a global programmatic media partner for marketers and agencies. Our people are at the heart of everything we do, so you will be too. No matter the role or the location, we're all united in the vision to lead the programmatic industry and make it better.As a Sr. Data Engineer...

  • Big Data Engineer

    4 weeks ago


    Bangalore/Hyderabad, Karnataka, India VIDPRO CONSULTANCY SERVICES Full time

    This position will be part of a growing team working towards building world class large scale Big Data architectures. This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to spend a majority of their time coding.Location : Bangalore and HyderabadWork...

  • Sigmoid Analytics

    2 weeks ago


    Bangalore, Karnataka, India Sigmoid Analytics Full time

    As a Technical Lead, you will be responsible in building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports to Engineering Manager.Responsibilities : - Align Sigmoid with key Client initiatives- Interface daily with...

  • Big Data Consultant

    4 weeks ago


    Bangalore, Karnataka, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Software Engineer

    3 weeks ago


    Bangalore, Karnataka, India symphoni HR Full time

    Skill: Java (Data structures/Algorithims) & Spark - Design, develop and implement, scalable, maintainable, and efficient software solutions using best practices and modern technologies. - Write clean, well designed, and testable code, following coding standards and guidelines. - Conduct code reviews and provide constructive feedback to team members to ensure...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India LOGIC PLANET IT SERVICES Full time

    About the job :We are hiring for a global technology company, home to more than 224,000 people across 60 countries.Role : Data EngineerExp : 5+ years Mode of Work : HybridMode of Hire : FTEAvailability : Immediate joinee or serving maximum of 30 days notice period.Job Description :- 5+ years of experience operating and deploying solutions using AWS Service...

  • Data Engineer

    4 weeks ago


    Bangalore/Hyderabad, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Description :Role : Data EngineerRequired Technical Skills :- More than 5 years' experience implementing data solutions- Strong proficiency in Python with an emphasis in building data pipelines- Experience in big data technologies like HDFS, YARN, Map-Reduce, Kafka, Spark, Airflow, etc.- Experience with Apache Airflow, Google Composer and dataflow-...

  • Big Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India randstad Full time

    Primary Responsibilities :- Design, develop, and implement big data solutions using Java, Python, or Scala.- Utilize SQL and Spark Scala for data processing and analysis.- Implement and manage data storage solutions using AWS services like S3, EC2, and Lambda.- Work with various databases such as Postgres, MySQL, Oracle, etc., for data storage and...


  • Bangalore, Karnataka, India Zyoin group Full time

    Job Description :We are looking for Principal Data Engineers to help us build and enhance big data platforms to achieve availability, scalability, and operational effectiveness. The right individual will embrace the opportunity to tackle challenging problems and use their influence to drive continual improvement.You will also work on the cutting edge of...