GCP Data Engineer

6 days ago

tamil nadu, India Intellistaff Services Pvt. Ltd Full time

Job description: Data Engineer with Python and GCP Experience Level: 5 to 9 Years Loc: Chennai Must Have Skillset SQL (4+ Years) Python or PySpark (4+ Years) GCP services (3+ Years) BigQuery Dataflow or Dataproc Pub/Sub Scheduled Query Cloud Functions Monitoring Tools Dashboard Apache Kafka Terraform scripting (2+ Year) Airflow/Astronomer/Cloud Composer (2+ Year) Good to have Skillset Data fusion Tekton pipeline/CI-CD Pipeline GCP: Cloud Secrete Manager Soft Skills Strong all-round communication skills (written / presentation, one-to-one / group) & Excellent analytical, problem-solving and communication skills Additional Notes: When hiring for a Data Engineer with GCP experience, it is important to look for candidates with a strong understanding of both data warehousing and data processing technologies. Roles & Responsibilities Design, develop, and maintain scalable data pipelines and architectures in Google Cloud Platform (GCP) using Python and SQL. Lead the implementation of data integration solutions utilizing GCP services such as BigQuery, Dataflow, and Pub/Sub. Collaborate with cross-functional teams to gather requirements and translate them into technical specifications for data-related projects. Implement monitoring and optimization processes to ensure data quality and performance across data workflows. Utilize Apache Kafka for real-time data processing and ensure data availability and reliability. Develop and manage CI/CD pipelines using Terraform and Tekton for automated deployment. Mentor and guide junior data engineers in best practices for data engineering and GCP technologies. Create and maintain documentation for data engineering processes, architecture, and workflows. Conduct regular performance testing and troubleshooting of data systems to identify and resolve issues swiftly. Stay updated with the latest trends and advancements in data engineering and GCP services to drive continuous improvement. Our ideal candidate Data Engineer with 5-30 years of experience Advanced proficiency in Google Cloud Platform (GCP) Ability to design, develop, and manage scalable data processing solutions in a cloud environment Expertise in GCP services like BigQuery, Cloud Dataflow, and Data Storage Efficient data handling and analysis Proficient knowledge of Python as the primary programming language for data manipulation Building data pipelines and automating data workflows Strong skills in data engineering concepts including ETL processes, data modeling, and architecture Managing complex datasets to ensure data integrity and accessibility across platforms Experience in leveraging GCP for data lakes and warehouses Implementing best practices for data governance and security Optimizing performance Solid understanding of data analytics frameworks and tools Deriving meaningful insights from large datasets Master's of Technology (M.Tech) in Data Science or Big Data Bachelor’s degree in Engineering (B.E. or B.Tech) with a specialization in Computer Science and Engineering Preferred certifications: Google Cloud Professional Data Engineer Microsoft Certified: Azure Data Engineer Associate Share your CV for

  • GCP Data Engineer

    2 weeks ago

    tamil nadu, India Intellistaff Services Pvt. Ltd Full time

    Job description: Data Engineer with Python and GCPExperience Level: 5 to 9 YearsLoc: Chennai Must Have SkillsetSQL (4+ Years)Python or PySpark (4+ Years)GCP services (3+ Years)BigQueryDataflow or DataprocPub/SubScheduled QueryCloud FunctionsMonitoring Tools DashboardApache KafkaTerraform scripting (2+ Year)Airflow/Astronomer/Cloud Composer (2+ Year) Good to...

  • Data Engineer-GCP

    4 days ago

    tamil nadu, India Forward Biz Pvt Ltd Full time

    Apply only if you are interested in taking an in-person assessment either in Bangalore or ChennaiRole DescriptionThis is a full-time Data Engineer-GCP role based in Chennai. The role involves designing, building, and maintaining data pipelines and workflows, implementing data models, performing ETL processes, and managing data warehousing. The candidate will...

  • Data Engineer-GCP

    3 days ago

    tamil nadu, India Forward Biz Pvt Ltd Full time

    Apply only if you are interested in taking an in-person assessment either in Bangalore or Chennai Role Description This is a full-time Data Engineer-GCP role based in Chennai. The role involves designing, building, and maintaining data pipelines and workflows, implementing data models, performing ETL processes, and managing data warehousing. The candidate...

  • GCP Data engineer

    4 days ago

    tamil nadu, India LatentView Analytics Full time

    Job Summary:We are seeking a Senior Data Engineer to join a Global Data Analytics & Insights team focused on transforming enterprise data management and democratizing access to insights. This role will lead a large-scale data migration from external agency-managed environments into an internal Google Cloud Platform (GCP) ecosystem. You will drive discovery,...

  • GCP Data Engineer – BigQuery

    2 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Job Title: GCP Data Engineer – Big QueryLocation: Hyderabad / Chennai / Bangalore ( Onsite ) Experience: 6–10 years Joining: ImmediateRole OverviewWe are looking for a skilled GCP Data Engineer with expertise in Big Query and related Google Cloud Platform services. The candidate will be responsible for designing, building, and optimizing data pipelines...

  • Senior GCP Data Engineer

    6 days ago

    tamil nadu, India Getronics Full time

    Greeting from Getronics!We have multiple opportunities for Senior GCP Data Engineers for our automotive client in Chennai Location.Position Description:Data Analytics team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analysing and manipulating large...

  • Senior Devops Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 347833 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Senior DevOps Engineer - GCP Infrastructure Networking to join our team in Chennai Tamil N du IN-TN India IN How You ll Help...

  • Data Engineer-GCP

    4 days ago

    Chennai, Tamil Nadu, India, Tamil Nadu Forward Biz Pvt Ltd Full time

    Apply only if you are interested in taking an in-person assessment either in Bangalore or ChennaiRole DescriptionThis is a full-time Data Engineer-GCP role based in Chennai. The role involves designing, building, and maintaining data pipelines and workflows, implementing data models, performing ETL processes, and managing data warehousing. The candidate will...

  • GCP Data engineer

    4 days ago

    Chennai, Tamil Nadu, India, Tamil Nadu LatentView Analytics Full time

    Job Summary:We are seeking a Senior Data Engineer to join a Global Data Analytics & Insights team focused on transforming enterprise data management and democratizing access to insights. This role will lead a large-scale data migration from external agency-managed environments into an internal Google Cloud Platform (GCP) ecosystem. You will drive discovery,...

  • Gcp Data Engineer Hyderabad

    3 weeks ago

    Chennai, Tamil Nadu Telangana, India Diverse Lynx Full time

    Hiring for GCP Data Engineer Hyderabad Design build and manage ETL ELT data pipelines using GCP-native services Develop scalable data solutions leveraging tools such as BigQuery Cloud Dataflow Cloud Composer Apache Airflow Cloud Pub Sub Cloud Storage Data Fusion Optimize data workflows for performance reliability and cost-efficiency Collaborate with data...