GCP Data Engineer

2 days ago

Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Overview:

Overview:

We are seeking a talented and motivated GCP Data Engineer with experience in real-time streaming technologies, specifically Apache Kafka, and proficiency in Java. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and streaming applications in a cloud environment.

Responsibilities:

Key Responsibilities:
  • Data Pipeline Development: Design and implement robust data pipelines using Google Cloud services (BigQuery, Dataflow, Pub/Sub) integrated with Kafka for real-time data processing.
  • Streaming Applications: Develop and maintain real-time streaming applications using Kafka and Java, ensuring high availability and performance.
  • Cloud Infrastructure: Utilize GCP technologies to build scalable and efficient data architectures, leveraging tools such as Cloud Storage, Cloud Functions, and Kubernetes.
  • Monitoring and Optimization: Monitor data flow, performance metrics, and troubleshoot issues in production environments. Optimize data pipeline performance and reliability.
  • Collaboration: Work closely with data scientists, analysts, and other engineers to understand data requirements and translate them into technical specifications.
  • Documentation: Maintain comprehensive documentation of data pipelines, architecture, and processes to ensure knowledge sharing and compliance.

Requirements:

Required Skills:
  • Cloud Skills: Proficiency in Google Cloud Platform (GCP), including services like BigQuery, Dataflow, and Pub/Sub.
  • Streaming Technologies: Strong experience with Kafka for real-time data streaming and messaging.
  • Programming Language: Proficient in Java, with a solid understanding of object-oriented programming principles and best practices.
  • Data Management: Familiarity with data modeling, ETL processes, and database management.
  • Development Tools: Experience with version control systems (e.g., Git), CI/CD tools, and Agile methodologies.
  • Problem-Solving: Strong analytical and troubleshooting skills, with the ability to work independently and as part of a team.
Preferred Qualifications:
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Experience with other programming languages (Python, Scala) is a plus.
  • Knowledge of additional GCP services or data visualization tools (e.g., Looker, Tableau) is advantageous.

  • GCP Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Qode Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    GCP Data Engineer Location: Chennai Workplace Type: HybridAbout the RoleWe are seeking a highly skilled and experienced Data Engineer to join our growing data team. In this role, you will be responsible for designing, building, and maintaining our data infrastructure on Google Cloud Platform (GCP). You will work closely with data scientists, analysts, and...

  • GCP Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Raah Techservices Full time ₹ 47,300 - ₹ 20,00,000 per year

    Job Summary:We are seeking an experienced and results-driven GCP Data Engineer with over 5 years of hands-on experience in building and optimizing data pipelines and architectures using Google Cloud Platform (GCP). The ideal candidate will have strong expertise in data integration, transformation, and modeling, with a focus on delivering scalable, efficient,...

  • Gcp Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India Altimetrik Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Description:We are seeking a skilled and proactive GCP Data Engineer with strong experience in Python and SQL to build and manage scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will work closely with data analysts, architects, and business teams to enable data-driven decision-making.Key Responsibilities:Design and develop...

  • GCP Data Engineer

    1 hour ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role:GCP Data Engineer (BI Focus)Required Technical Skill Set:GCP Data Engineer (BI Focus)Desired Experience Range:4-10 yrsLocation of Requirement:Chennai/Bangalore/GandhinagarNotice period:Immediate joiner onlyAre you able to attend the Virtual Interview on these weekdays?Job Description:Experience:Associate should have 4+ years of IT experience with good...

  • GCP Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India Prodapt Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    OverviewOverview:We are seeking a talented and motivated GCP Data Engineer with experience in real-time streaming technologies, specifically Apache Kafka, and proficiency in Java. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and streaming applications in a cloud environment.ResponsibilitiesKey...

  • Sr GCP Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Kovan Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job description:Responsibilities:Design, develop, and maintain data pipelines on GCP.Implement data storage solutions and optimize data processing workflows.Ensure data quality and integrity throughout the data lifecycle.Collaborate with data scientists and analysts to understand data requirements.Monitor and maintain the health of the data...

  • GCP data engineer

    6 days ago

    Chennai, Tamil Nadu, India Prodapt Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    OverviewDesign and implement complex ETL/ELT pipelines using PySpark and Airflow for large-scale data processing on GCP.Lead data migration initiatives, including automating the movement of Teradata tables to BigQuery, ensuring data accuracy and consistency.Develop robust frameworks to streamline batch and streaming data ingestion workflows, leveraging...

  • GCP Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    TCS Hiring for GCP Data Engineers Role - GCP Data EngineersExperience - 10 to 12 Years Location - Bengaluru, Chennai, Hyderabad, Pune Roles & ResponsibilitiesProficiency in programming languages: Python, JavaExpertise in data processing frameworks: Apache Beam (Data Flow)Active experience on GCP tools and technologies like Big Query, Dataflow, Cloud...

  • Data Engineer

    10 hours ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Data Engineer – Chennai Build the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights. Location: Chennai, India Experience: 2–3 years in data engineering or data-driven product development Role Overview As a Data Engineer, you will be responsible for building and...

  • Hybrid Mode| GCP Data Engineer

    7 days ago

    Chennai, Tamil Nadu, India Getronics Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Greetings from GetronicsWe have permanent opportunities for GCP Data Engineers in Chennai Location.Hope you are doing well This is Narmadha from Getronics Talent Acquisition team. We have multiple opportunities for GCP Data Engineers for our automotive client in Chennai Sholinganallur location. Please find below the company profile and Job Description. If...