Data Engineer

2 days ago

bangalore, India Capleo Global Full time

GCP Data Engineer

Experience: 5+ Years

Location: Bengaluru

Availability: Immediate to 15 Days


Job Description:

We are looking for an experienced GCP Data Engineer to join our team in Bengaluru. The ideal candidate will have over 5 years of experience in data engineering, with a strong focus on Google Cloud Platform (GCP), Dataproc, Python, PySpark, and Airflow. If you are passionate about building scalable data solutions and have a proven track record of working with GCP technologies, we want to hear from you.

Key Responsibilities:

  • Data Pipeline Development: Design, develop, and maintain scalable data pipelines using GCP services, including Dataproc and Cloud Storage.
  • Big Data Processing: Utilize PySpark on Dataproc for large-scale data processing and transformation.
  • Workflow Orchestration: Implement and manage data workflows using Apache Airflow, ensuring timely and reliable data delivery.
  • Python Scripting: Develop and optimize Python scripts for data processing, automation, and integration tasks.
  • Data Management: Oversee the ingestion, transformation, and storage of structured and unstructured data from various sources.
  • Performance Tuning: Optimize the performance of data pipelines and processing frameworks to ensure efficiency and scalability.
  • Collaboration: Work closely with data scientists, analysts, and other stakeholders to deliver data solutions that align with business needs.
  • Data Governance: Ensure data quality, security, and compliance with relevant data protection regulations.

Required Skills:

  • GCP Expertise: In-depth knowledge of Google Cloud Platform services, particularly Dataproc, BigQuery, and Cloud Storage.
  • Python: Advanced proficiency in Python for data processing, scripting, and automation.
  • PySpark: Strong experience with PySpark for big data processing and ETL pipeline development.
  • Apache Airflow: Hands-on experience with Airflow for orchestrating and managing complex data workflows.
  • Data Processing: Solid understanding of distributed data processing concepts and experience with big data tools.
  • Problem-Solving: Ability to troubleshoot and resolve data-related issues effectively.
  • Team Collaboration: Excellent communication skills and the ability to work effectively in a collaborative environment.

  • Data Engineer

    2 days ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer Grade 07ResponsibilitiesAssure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements using Azure data factory and Azure databricksDevelop and maintain innovative Azure Azure data factory and Azure databricksSolution design using Microsoft Azure...

  • Data Engineer

    1 week ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer Grade 07 ResponsibilitiesAssure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements using Azure data factory and Azure databricksDevelop and maintain innovative Azure Azure data factory and Azure databricksSolution design using Microsoft...

  • Data Engineer

    1 month ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 287747  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Mandatory Skills...

  • Data Engineer

    10 hours ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Join Our Cutting-Edge Team as a Data Engineer at Data Labs!Are You a Data Enthusiast?If you’re passionate about transforming complex data into actionable insights and enjoy working with the latest technologies, this is your chance to shine! We at Data Labs Landmark Group, are on the lookout for a talented Data Engineer who thrives in a collaborative and...

  • Data Engineer

    2 days ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    🌟 Join Our Cutting-Edge Team as a Data Engineer at Data Labs! 🚀Are You a Data Enthusiast? If you’re passionate about transforming complex data into actionable insights and enjoy working with the latest technologies, this is your chance to shine! We at Data Labs Landmark Group, are on the lookout for a talented Data Engineer who thrives in a...

  • Data Specialist

    2 days ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 287764  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Specialist / Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Data...

  • AWS DataLake Data Engineers

    2 days ago

    bangalore, India NTT DATA Services Full time

    Req ID: 296111 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a AWS DataLake Data Engineers to join our team in Bangalore, Karnātaka (IN-KA), India (IN).  AWS DataLake Data...

  • AWS DataLake Data Engineer

    42 minutes ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 296111  NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS DataLake Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Data Engineer

    3 weeks ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 295709  NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Migration to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job Duties:...

  • Data Engineer

    1 month ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 293309  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (Tableau & SQL) to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Senior Engineering Manager

    2 days ago

    bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Solutions Engineer

    2 days ago

    bangalore, India Hevo Data Full time

    Overview : We’re seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You’ll work one-on-one with the sales team to help discover our customers’ business and technical needs and demonstrate how Hevo’s platform can solve their real-time data replication needs. In this role, you will have a deep...

  • Senior Engineering Manager

    4 months ago

    bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Senior Engineering Manager

    2 weeks ago

    Bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    2 days ago

    bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Senior Engineering Manager

    2 days ago

    bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Digital Engineering Staff Engineer

    4 weeks ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 253253  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Staff Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job...

  • Digital Engineering Lead Engineer

    4 weeks ago

    Bangalore, India NTT DATA Services Full time

    NTT DATA Services currently seeks AIML Engineer to join our team in Bangalore Key Responsibilities: •    Participate in developing Generative AI & Traditional AI Platform Capabilities on enterprise on-prem and cloud platforms. •    Responsible for AI model delivery to on-prem infrastructure and cloud platforms (GCP-Vertex AI, Azure...

  • Sales Engineer

    2 days ago

    Bengaluru/ Bangalore, India Unravel Data Full time

    Apply Sales Engineer - India, Unravel Data in Bengaluru/ Bangalore ,Pune for 5 - 8 year of Experience on TimesJobs.com

  • Data & Analytics

    2 weeks ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 293686  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data & Analytics to join our team in Bangalore, Karnātaka (IN-KA), India (IN). JOB...