GCP Data Engineer

1 week ago

Chennai, India Intellistaff Services Pvt. Ltd Full time

Job description: Data Engineer with Python and GCPExperience Level: 5 to 9 YearsLoc: ChennaiMust Have SkillsetSQL (4+ Years)Python or PySpark (4+ Years)GCP services (3+ Years)BigQueryDataflow or DataprocPub/SubScheduled QueryCloud FunctionsMonitoring Tools DashboardApache KafkaTerraform scripting (2+ Year)Airflow/Astronomer/Cloud Composer (2+ Year)Good to have SkillsetData fusionTekton pipeline/CI-CD PipelineGCP:Cloud Secrete ManagerSoft SkillsStrong all-round communication skills (written / presentation, one-to-one / group) & Excellent analytical, problem-solving and communication skillsAdditional Notes:When hiring for a Data Engineer with GCP experience, it is important to look for candidates with a strong understanding of both data warehousing and data processing technologies.Roles & ResponsibilitiesDesign, develop, and maintain scalable data pipelines and architectures in Google Cloud Platform (GCP) using Python and SQL.Lead the implementation of data integration solutions utilizing GCP services such as BigQuery, Dataflow, and Pub/Sub.Collaborate with cross-functional teams to gather requirements and translate them into technical specifications for data-related projects.Implement monitoring and optimization processes to ensure data quality and performance across data workflows.Utilize Apache Kafka for real-time data processing and ensure data availability and reliability.Develop and manage CI/CD pipelines using Terraform and Tekton for automated deployment.Mentor and guide junior data engineers in best practices for data engineering and GCP technologies.Create and maintain documentation for data engineering processes, architecture, and workflows.Conduct regular performance testing and troubleshooting of data systems to identify and resolve issues swiftly.Stay updated with the latest trends and advancements in data engineering and GCP services to drive continuous improvement.Our ideal candidateData Engineer with 5-30 years of experienceAdvanced proficiency in Google Cloud Platform (GCP)Ability to design, develop, and manage scalable data processing solutions in a cloud environmentExpertise in GCP services like BigQuery, Cloud Dataflow, and Data StorageEfficient data handling and analysisProficient knowledge of Python as the primary programming language for data manipulationBuilding data pipelines and automating data workflowsStrong skills in data engineering concepts including ETL processes, data modeling, and architectureManaging complex datasets to ensure data integrity and accessibility across platformsExperience in leveraging GCP for data lakes and warehousesImplementing best practices for data governance and securityOptimizing performanceSolid understanding of data analytics frameworks and toolsDeriving meaningful insights from large datasetsMaster's of Technology (M.Tech) in Data Science or Big DataBachelor’s degree in Engineering (B.E. or B.Tech) with a specialization in Computer Science and EngineeringPreferred certifications: Google Cloud Professional Data EngineerMicrosoft Certified: Azure Data Engineer AssociateShare your CV for

  • GCP Data Engineer

    1 week ago

    Chennai, India Intellistaff Services Pvt. Ltd Full time

    Job description: Data Engineer with Python and GCP Experience Level: 5 to 9 Years Loc: Chennai Must Have Skillset SQL (4+ Years) Python or PySpark (4+ Years) GCP services (3+ Years) BigQuery Dataflow or Dataproc Pub/Sub Scheduled Query Cloud Functions Monitoring Tools Dashboard Apache Kafka Terraform scripting (2+ Year) Airflow/Astronomer/Cloud Composer (2+...

  • Gcp Data Engineer

    1 week ago

    Chennai, India Intellistaff Services Pvt. Ltd Full time

    Job description: Data Engineer with Python and GCP Experience Level: 5 to 9 Years Loc: Chennai Must Have Skillset SQL (4+ Years) Python or PySpark (4+ Years) GCP services (3+ Years) BigQuery Dataflow or Dataproc Pub/Sub Scheduled Query Cloud Functions Monitoring Tools Dashboard Apache Kafka Terraform scripting (2+ Year) Airflow/Astronomer/Cloud Composer (2+...

  • GCP Data Engineer

    7 days ago

    Chennai, India Intellistaff Services Pvt. Ltd Full time

    Job description: Data Engineer with Python and GCP Experience Level: 5 to 9 Years Loc: Chennai Must Have Skillset SQL (4+ Years) Python or PySpark (4+ Years) GCP services (3+ Years) BigQuery Dataflow or Dataproc Pub/Sub Scheduled Query Cloud Functions Monitoring Tools Dashboard Apache Kafka Terraform scripting (2+ Year) Airflow/Astronomer/Cloud Composer (2+...

  • GCP Data Engineer

    3 days ago

    Chennai, India Intellistaff Services Pvt. Ltd Full time

    Job description: Data Engineer with Python and GCPExperience Level: 5 to 9 YearsLoc: Chennai Must Have SkillsetSQL (4+ Years)Python or PySpark (4+ Years)GCP services (3+ Years)BigQueryDataflow or DataprocPub/SubScheduled QueryCloud FunctionsMonitoring Tools DashboardApache KafkaTerraform scripting (2+ Year)Airflow/Astronomer/Cloud Composer (2+ Year) Good to...

  • GCP Data Engineer

    1 week ago

    Chennai, India Intellistaff Services Pvt. Ltd Full time

    Job description: Data Engineer with Python and GCPExperience Level: 5 to 9 YearsLoc: Chennai Must Have SkillsetSQL (4+ Years)Python or PySpark (4+ Years)GCP services (3+ Years)BigQueryDataflow or DataprocPub/SubScheduled QueryCloud FunctionsMonitoring Tools DashboardApache KafkaTerraform scripting (2+ Year)Airflow/Astronomer/Cloud Composer (2+ Year) Good to...

  • GCP Data Engineer

    1 week ago

    Chennai, India Intellistaff Services Pvt. Ltd Full time

    Job description: Data Engineer with Python and GCPExperience Level: 5 to 9 YearsLoc: Chennai Must Have SkillsetSQL (4+ Years)Python or PySpark (4+ Years)GCP services (3+ Years)BigQueryDataflow or DataprocPub/SubScheduled QueryCloud FunctionsMonitoring Tools DashboardApache KafkaTerraform scripting (2+ Year)Airflow/Astronomer/Cloud Composer (2+ Year) Good to...

  • GCP Data Engineer

    1 week ago

    Chennai, India Intellistaff Services Pvt. Ltd Full time

    Job description: Data Engineer with Python and GCPExperience Level: 5 to 9 YearsLoc: Chennai Must Have SkillsetSQL (4+ Years)Python or PySpark (4+ Years)GCP services (3+ Years)BigQueryDataflow or DataprocPub/SubScheduled QueryCloud FunctionsMonitoring Tools DashboardApache KafkaTerraform scripting (2+ Year)Airflow/Astronomer/Cloud Composer (2+ Year) Good to...

  • GCP Data Engineer

    1 week ago

    Chennai, India Intellistaff Services Pvt. Ltd Full time

    Job description: Data Engineer with Python and GCPExperience Level: 5 to 9 YearsLoc: ChennaiMust Have SkillsetSQL (4+ Years)Python or PySpark (4+ Years)GCP services (3+ Years)BigQueryDataflow or DataprocPub/SubScheduled QueryCloud FunctionsMonitoring Tools DashboardApache KafkaTerraform scripting (2+ Year)Airflow/Astronomer/Cloud Composer (2+ Year)Good to...

  • GCP Data Engineer

    7 days ago

    chennai, India Intellistaff Services Pvt. Ltd Full time

    Job description: Data Engineer with Python and GCPExperience Level: 5 to 9 YearsLoc: ChennaiMust Have SkillsetSQL (4+ Years)Python or PySpark (4+ Years)GCP services (3+ Years)BigQueryDataflow or DataprocPub/SubScheduled QueryCloud FunctionsMonitoring Tools DashboardApache KafkaTerraform scripting (2+ Year)Airflow/Astronomer/Cloud Composer (2+ Year)Good to...

  • GCP Data Engineer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    - Role- GCP Data Engineer- Exp Range-6 to 12 Years- Location- Chennai- GCP Professional Data Engineer certification.- Experience with data modeling and data warehousing concepts.- Exposure to other cloud platforms (AWSJob Summary:- We are seeking a highly skilled and experienced GCP Data Engineer to join our dynamic data engineering team. The ideal candidate...