GCP data Engineer

3 weeks ago

Bangalore Urban Karnataka India, IN Impetus Full time

Provides technical leadership in Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies.

Responsibilities

  • Must have: Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer services).
  • Should be aware with columnar database e.g parquet, ORC etc.
  • Visualize and evangelize next generation infrastructure in Cloud platform/Big Data space (Batch, Near Real-time, Real-time technologies).
  • Passionate for continuous learning, experimenting, applying and contributing towards cutting edge open source technologies and software paradigms.
  • Developing and implementing an overall organizational data strategy that is in line with business processes. The strategy includes data model designs, database development standards, implementation and management of data warehouses and data analytics systems.
  • Expert-level proficiency in at-least 4-5 GCP services.
  • Experience with technical solutions based on industry standards using GCP - IaaS, PaaS and SaaS capabilities.
  • Strong understanding and experience in distributed computing frameworks, particularly.
  • Experience working within a Linux computing environment, and use of command line tools including knowledge of shell/Python scripting for automating common tasks.

Qualifications

7-10 years of experience in the role of implementation of high end software products

Required Skills

  • Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer services).
  • Expert-level proficiency in at-least 4-5 GCP services.
  • Strong understanding and experience in distributed computing frameworks.
  • Experience working within a Linux computing environment.
  • Should be aware with columnar database e.g parquet, ORC etc.
  • Experience with technical solutions based on industry standards using GCP - IaaS, PaaS and SaaS capabilities.

  • GCP Data Engineer

    3 weeks ago

    india, IN EXL Full time

    Job Description:Must Have- GCP Data Engineer with Banking/ Finance Institutions ExperienceAbout the RoleWe are seeking experienced Google Cloud Platform (GCP) Engineers to join our team in building a scalable and robust Model Monitoring Framework. This solution will integrate data from diverse sources including Excel files, SAS datasets, and GCP-native...

  • AI Data Engineer

    3 weeks ago

    Bangalore Urban, Karnataka, India, IN Tata Consultancy Services Full time

    Job Title: AI Data EngineerExp- 4 to 8 yearsLocation- PAN IndiaJob DescriptionKey Responsibilities:• Build and maintain data infrastructure: Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud.• Ensure data quality: Clean, transform, and enrich raw data to create "business truth" that AI models can use for...

  • Data Architect

    3 weeks ago

    Bangalore Urban, Karnataka, India, IN Grid Dynamics Full time

    Experience: 12-16Years(only)Location: Bangalore/HyderabadA result- oriented thought-leader to drive the development of the data engineering practiceA trusted advisor and business partner to customers across verticals, and consulting team leader who establishes engineering processes and skill development.Responsibilities:Trusted Advisor: Provide direction to...

  • AI Data Architect

    3 weeks ago

    Bangalore Urban, Karnataka, India, IN Tata Consultancy Services Full time

    Role:- AI Data ArchitectExperience- 8 to 15yearsLocation - PAN IndiaJob DescriptionWe are seeking an inventive Data Architect for AI with 8–15 years of experience to lead the strategic design and implementation of enterprise-scale AI solutions.8+ years of experience in ETL/ELT, Big Data cloud data solutioning, with at least 3 years in architectural...

  • Data Engineer

    3 weeks ago

    Bangalore Urban, Karnataka, India, IN V2Soft Full time

    Data Engineer :8+year experience in design and development of streaming data pipelines.Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK/Flink/Spark/Scala. Very good knowledge on atleast 3 out of the 4 technologiesDesirable experience in Databricks, Snowflake or any data warehouse...

  • Data Engineer

    3 weeks ago

    india, IN Insight Global Full time

    Position: GCP Data Engineer Location: 100% Remote in IndiaDuration: 12 month contract + extensions + conversionsPackage: 10 LPA- 26 LPAInterview Process: 2 RoundsREQUIRED SKILLS AND EXPERIENCE6+ Years of experience as a Data Engineer Experience with GCP Data ie. Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow Strong SQL experience (NoSQL,...

  • Sr. Data Engineer

    3 weeks ago

    Bangalore Urban, Karnataka, India, IN Tata Consultancy Services Full time

    Greetings from TCS!We are Looking for Senior Data EngineerExperience : 8 + YearsLocation : BangaloreMust-HaveThe Senior Data Engineer is the one who designs and builds data foundations and end to end solutions for the Shell Business to maximize value from data. The role helps create a data-driven thinking within the organization, not just within IT teams,...

  • AiOps Engineer

    3 weeks ago

    Bangalore Urban, Karnataka, India, IN L&T Technology Services Full time

    Only immediate to 15 days joinerExperience – 8 to 10 yrsKey Responsibilities:Develop and Deploy AI Solutions: Design, build, and deploy end-to-end Machine Learning and Generative AI pipelines on Google Cloud Platform, using Vertex AI services such as Vertex Pipelines, Model Registry, and Endpoints.Implement Generative AI Applications: Focus on implementing...

  • Data Engineer

    3 weeks ago

    Bangalore Urban, Karnataka, India, IN Tata Consultancy Services Full time

    Opening - PUNE/Bangalore/Hyd/ChennaiAbout the RoleRole - Data Engineer - Quantexa ,Big Data Hadoop, Spark and ScalaResponsibilitiesDevelop Spark and SCALA code as per requirement.Build efficient and optimized ETLs for data ingestion/transformations.Should be able to customize and update the Quantexa UI as per business requirement.Documentation of the...

  • Senior Data Scientist

    3 weeks ago

    Bangalore Urban, Karnataka, India, IN Analyttica Datalab Full time

    Senior Data ScientistLocation: BangaloreAbout the RoleWe are seeking a Senior Data Scientist with deep expertise in data science methodologies and exceptional proficiency in Python. You will lead end-to-end analytical initiatives — from problem framing and data preparation to model development, validation, deployment, and monitoring. This role requires...