Gcp Data Engineer

1 week ago

Bengaluru Gurugram, India Compunnel Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Job Description:

As a Data Engineer, you will be responsible for designing, developing, and maintaining robust and scalable framework/services/application/pipelines for processing huge volume of data. You will work closely with cross-functional teams to deliver high-quality software solutions that meet our organizational needs.

Key Responsibilities:

• Design and develop solutions using Bigdata tools and technologies like MapReduce, Hive, Spark etc.

• Extensive hands-on experience in object-oriented programming using Python, PySpark APIs etc.

• Experience in building data pipelines for huge volume of data.

• Experience in designing, implementing, and managing various ETL job execution flows.

• Experience in implementing and maintaining Data Ingestion process.

• Hands on experience in writing basic to advance level of optimized queries using HQL, SQL & Spark.

• Hands on experience in designing, implementing, and maintaining Data Transformation jobs using most efficient tools/technologies.

• Ensure the performance, quality, and responsiveness of solutions.

• Participate in code reviews to maintain code quality.

• Should be able to write shell scripts.

• Utilize Git for source version control.

• Set up and maintain CI/CD pipelines.

• Troubleshoot, debug, and upgrade existing application & ETL job chains.

Required Skills and Qualifications:

• Bachelors degree in computer science engineering, or a related field.

• Proven experience as Data Engineer or similar role.

• Strong proficiency in Object Oriented programming using Python.

• Experience with ETL jobs design principles.

• Solid understanding of HQL, SQL and data modelling.

• Knowledge on Unix/Linux and Shell scripting principles.

• Familiarity with Git and version control systems.

• Experience with Jenkins and CI/CD pipelines.

• Knowledge of software development best practices and design patterns.

• Excellent problem-solving skills and attention to detail.

• Strong communication and collaboration skills.

• Experience with cloud platforms such as Google Cloud.

  • Gcp Data Science

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Statistical Modeling**: Strong understanding of statistical techniques and experience leveraging BigQuery ML and Vertex AI for model development. **Machine Learning Algorithms**: Experience with GCP's pre-built ML APIs (e.g., Vision AI, Natural Language API) and custom model building using Vertex AI. **Feature Engineering**: Ability to create meaningful...

  • Gcp Lead Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 298270NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a GCP Lead Engineer to join our team in Bangalore Karn xc4 x81taka IN-KA India IN Primary Skill ...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    We're seeking a seasoned Data Engineering professional to join our team.Key ResponsibilitiesThe ideal candidate will have extensive experience in designing and implementing scalable data pipelines using GCP managed services, such as Dataproc, Dataflow, Pub/Sub, Cloud Functions, BigQuery, and GCS. They should be proficient in programming languages like Python...

  • API Engineer with GCP

    1 week ago

    Bengaluru, Gurugram, India Augusta Infotech Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Mandatory SkillsGCP; API; ETL - Big Data / Data Warehousing; Big Data; PythonAPI Engineer - Auditboard SaaS integrations (Mandatory) with on-pem and GCP.

  • GCP Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Infogain Full time US$ 1,00,000 - US$ 1,50,000 per year

    ROLES & RESPONSIBILITIESMust have skillset - Java8, Python, pyspark, Spark, Spring Boot, GCP/Cloud, Jenkins, TerraformCore SkillsExtensive experience with Google Cloud Platform (GCP) data services such as BigQuery, Cloud Storage, and Dataflow.Expertise in ETL (Extract, Transform, Load) processes and data integration on GCP.Strong SQL and database querying...

  • GCP Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Ascendion Full time

    Job Title: GCP Data Engineer (4 - 12 Years)Job Type: Full-TimeWork Mode: HybridLocations: Bengaluru, Hyderabad, Chennai, PuneJob Summary:We are looking for a talented GCP Big Query Data Engineer with strong SQL skills and basic proficiency in Python to join our data engineering team. The ideal candidate should have hands-on experience working with Google...

  • GCP Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCSTCS is looking for GCP Data EngineerJob Location : Chennai, Hyderabad, Bangalore, Pune, GurgaonExperience : 5to 10 YearsRequired technical skills: GCP Big query, Python, SQL , ETLRequirements:- Proficiency in programming languages: Python, Java- Expertise in data processing frameworks: Apache Beam (Data Flow)- Active...

  • GCP Architect

    1 day ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    Req ID: 341129NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a GCP Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). GCP - Architect Job DescriptionRole...

  • GCP Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Ascendion Full time

    Job Title: GCP Data Engineer (4 - 12 Years) Job Type: Full-Time Work Mode: Hybrid Locations: Bengaluru, Hyderabad, Chennai, Pune Job Summary: We are looking for a talented GCP Big Query Data Engineer with strong SQL skills and basic proficiency in Python to join our data engineering team. The ideal candidate should have hands-on experience working with...

  • GCP Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Ascendion Full time

    Job Title: GCP Data Engineer (4 - 12 Years)Job Type: Full-Time Work Mode: HybridLocations: Bengaluru, Hyderabad, Chennai, PuneJob Summary:We are looking for a talented GCP Big Query Data Engineer with strong SQL skills and basic proficiency in Python to join our data engineering team. The ideal candidate should have hands-on experience working with Google...