GCP Data Engineer

2 days ago

Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Overview:

Overview:

We are seeking a talented and motivated GCP Data Engineer with experience in real-time streaming technologies, specifically Apache Kafka, and proficiency in Java. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and streaming applications in a cloud environment.

Responsibilities:

Key Responsibilities:
  • Data Pipeline Development: Design and implement robust data pipelines using Google Cloud services (BigQuery, Dataflow, Pub/Sub) integrated with Kafka for real-time data processing.
  • Streaming Applications: Develop and maintain real-time streaming applications using Kafka and Java, ensuring high availability and performance.
  • Cloud Infrastructure: Utilize GCP technologies to build scalable and efficient data architectures, leveraging tools such as Cloud Storage, Cloud Functions, and Kubernetes.
  • Monitoring and Optimization: Monitor data flow, performance metrics, and troubleshoot issues in production environments. Optimize data pipeline performance and reliability.
  • Collaboration: Work closely with data scientists, analysts, and other engineers to understand data requirements and translate them into technical specifications.
  • Documentation: Maintain comprehensive documentation of data pipelines, architecture, and processes to ensure knowledge sharing and compliance.

Requirements:

Required Skills:
  • Cloud Skills: Proficiency in Google Cloud Platform (GCP), including services like BigQuery, Dataflow, and Pub/Sub.
  • Streaming Technologies: Strong experience with Kafka for real-time data streaming and messaging.
  • Programming Language: Proficient in Java, with a solid understanding of object-oriented programming principles and best practices.
  • Data Management: Familiarity with data modeling, ETL processes, and database management.
  • Development Tools: Experience with version control systems (e.g., Git), CI/CD tools, and Agile methodologies.
  • Problem-Solving: Strong analytical and troubleshooting skills, with the ability to work independently and as part of a team.
Preferred Qualifications:
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Experience with other programming languages (Python, Scala) is a plus.
  • Knowledge of additional GCP services or data visualization tools (e.g., Looker, Tableau) is advantageous.

  • Gcp Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India Altimetrik Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Description:We are seeking a skilled and proactive GCP Data Engineer with strong experience in Python and SQL to build and manage scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will work closely with data analysts, architects, and business teams to enable data-driven decision-making.Key Responsibilities:Design and develop...

  • GCP Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India Prodapt Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    OverviewOverview:We are seeking a talented and motivated GCP Data Engineer with experience in real-time streaming technologies, specifically Apache Kafka, and proficiency in Java. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and streaming applications in a cloud environment.ResponsibilitiesKey...

  • GCP data engineer

    6 days ago

    Chennai, Tamil Nadu, India Prodapt Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    OverviewDesign and implement complex ETL/ELT pipelines using PySpark and Airflow for large-scale data processing on GCP.Lead data migration initiatives, including automating the movement of Teradata tables to BigQuery, ensuring data accuracy and consistency.Develop robust frameworks to streamline batch and streaming data ingestion workflows, leveraging...

  • Hybrid Mode| GCP Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Getronics Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Greetings from GetronicsWe have permanent opportunities for GCP Data Engineers in Chennai Location.Hope you are doing well This is Narmadha from Getronics Talent Acquisition team. We have multiple opportunities for GCP Data Engineers for our automotive client in Chennai Sholinganallur location. Please find below the company profile and Job Description. If...

  • GCP Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Referral Program Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Design and develop robust ETL pipelines using Python, PySpark, and GCP services.Build and optimize data models and queries in BigQuery for analytics and reporting.Ingest, transform, and load structured and semi-structured data from various sources.Collaborate with data analysts, scientists, and business teams to understand data requirements.Ensure data...

  • GCP Data Architect

    13 hours ago

    Chennai, Tamil Nadu, India SWITS DIGITAL Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: GCP Data ArchitectExperience:12+ YearsWork Location:Hyderabad / ChennaiJob SummaryWe are looking for a highly experiencedGCP Data Architectwith deep expertise in Data Engineering, ETL/ELT development, and Enterprise Data Warehousing. The candidate should have strong hands-on experience in GCP cloud technologies, Airflow, Python, and Teradata. You...

  • Senior GCP Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Prodapt Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    OverviewProdapt is looking for senior data engineers having 3+ years of experience having hands on expertise on GCP, BQ, Data Pipeline creation & ETL.ResponsibilitiesUnderstanding the requirementsPerforming in-depth analysis on dataSetting up secure data pipelines from ingestion to deliveryIndividual contributorRequirements3- 5 years of experience in Data...

  • Gcp Data Engineer

    6 hours ago

    Chennai, Tamil Nadu, India Changeleaders Consulting Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    • Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub.• Hands-on experience with Terraform for provisioning and managing GCP infrastructure.• Proficiency in SQL and Python for data manipulation and analysis

  • GCP Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Design and develop robust ETL pipelines using Python, PySpark, and GCP services.Build and optimize data models and queries in BigQuery for analytics and reporting.Ingest, transform, and load structured and semi-structured data from various sources.Collaborate with data analysts, scientists, and business teams to understand data requirements.Ensure data...

  • Data Engineer

    6 hours ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...