GCP Data Engineer

1 day ago

bangalore, India Intellistaff Services Pvt. Ltd Full time

Job description: Data Engineer with Python and GCP Experience Level: 5 to 9 Years Loc: Chennai Must Have Skillset SQL (4+ Years) Python or PySpark (4+ Years) GCP services (3+ Years) BigQuery Dataflow or Dataproc Pub/Sub Scheduled Query Cloud Functions Monitoring Tools Dashboard Apache Kafka Terraform scripting (2+ Year) Airflow/Astronomer/Cloud Composer (2+ Year) Good to have Skillset Data fusion Tekton pipeline/CI-CD Pipeline GCP: Cloud Secrete Manager Soft Skills Strong all-round communication skills (written / presentation, one-to-one / group) & Excellent analytical, problem-solving and communication skills Additional Notes: When hiring for a Data Engineer with GCP experience, it is important to look for candidates with a strong understanding of both data warehousing and data processing technologies. Roles & Responsibilities Design, develop, and maintain scalable data pipelines and architectures in Google Cloud Platform (GCP) using Python and SQL. Lead the implementation of data integration solutions utilizing GCP services such as BigQuery, Dataflow, and Pub/Sub. Collaborate with cross-functional teams to gather requirements and translate them into technical specifications for data-related projects. Implement monitoring and optimization processes to ensure data quality and performance across data workflows. Utilize Apache Kafka for real-time data processing and ensure data availability and reliability. Develop and manage CI/CD pipelines using Terraform and Tekton for automated deployment. Mentor and guide junior data engineers in best practices for data engineering and GCP technologies. Create and maintain documentation for data engineering processes, architecture, and workflows. Conduct regular performance testing and troubleshooting of data systems to identify and resolve issues swiftly. Stay updated with the latest trends and advancements in data engineering and GCP services to drive continuous improvement. Our ideal candidate Data Engineer with 5-30 years of experience Advanced proficiency in Google Cloud Platform (GCP) Ability to design, develop, and manage scalable data processing solutions in a cloud environment Expertise in GCP services like BigQuery, Cloud Dataflow, and Data Storage Efficient data handling and analysis Proficient knowledge of Python as the primary programming language for data manipulation Building data pipelines and automating data workflows Strong skills in data engineering concepts including ETL processes, data modeling, and architecture Managing complex datasets to ensure data integrity and accessibility across platforms Experience in leveraging GCP for data lakes and warehouses Implementing best practices for data governance and security Optimizing performance Solid understanding of data analytics frameworks and tools Deriving meaningful insights from large datasets Master's of Technology (M.Tech) in Data Science or Big Data Bachelor’s degree in Engineering (B.E. or B.Tech) with a specialization in Computer Science and Engineering Preferred certifications: Google Cloud Professional Data Engineer Microsoft Certified: Azure Data Engineer Associate Share your CV for

  • GCP Data Engineer

    3 days ago

    bangalore, India Adastra Full time

    Job Description We are looking for a proactive and solution-oriented GCP Data Engineer to join our team. This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, alongside strong SQL and Python skills. The ideal candidate is a self-starter who thrives in solving problems independently, communicates...

  • Data Engineer

    2 weeks ago

    bangalore, India People Prime Worldwide Full time

    Job Title: Senior Data Engineer - GCP + PythonLocation: HyderabadYears of Experience: 5+YearsAbout the CompanyOur client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they...

  • GCP Data Engineer

    1 week ago

    bangalore, India Brillio Full time

    We're Hiring: GCP Senior Data EngineerDo you love building scalable data pipelines and working with cutting‑edge cloud technologies? Join our team and make an impact by designing solutions that power data‑driven decisions.Key ResponsibilitiesDesign and develop robust, scalable data pipelines and solutionsCollaborate with cross‑functional teams to...

  • Data Engineer-GCP

    3 hours ago

    bangalore, India Forward Biz Pvt Ltd Full time

    Apply only if you are interested in taking an in-person assessment either in Bangalore or Chennai Role Description This is a full-time Data Engineer-GCP role based in Chennai. The role involves designing, building, and maintaining data pipelines and workflows, implementing data models, performing ETL processes, and managing data warehousing. The candidate...

  • GCP Data Engineer

    1 week ago

    bangalore, India Tata Consultancy Services Full time

    Job Title: GCP Data Engineer Experience: 5 years - 10 Years Location: Bangalore/ Hyderabad/Delhi/Chennai/Pune Experience Required: Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and ETL processes Skills: GCP, Big Query, Dataflow, Data Proc, Cloud SQL, Cloud Spanner, Pub/Sub, ETL, Apache airflow, Python, Pandas...

  • Gcp data engineer

    2 weeks ago

    bangalore, India Impetus Full time

    We are hiring Sr. GCP Data Engineer for Bangalore & Gurgaon Location. We are looking candidate should have good experience in Bigdata Spark, SQL, Pyspark, GCP - Bigquery, Dataflow, Airflow, Pubsub, Dataproc, GCS, Cloud Composer. If you are good in above skills & can join un in 0-30 Days notice, kindly share your Resume at & Responsibilities-Able to...

  • GCP Data Engineer

    1 week ago

    Bangalore, India RB Consultancy Services Full time

    Job Title: GCP Data Engineer Location: TCS - Chennai, Hyderabad, Bangalore, Pune, Delhi Type: Full-time Experience: 4+ years Primary Skills: Python with OOPs concept. Data flow Cloud Composer Big query Secondary Skills: Agile Spinnaker Jenkins Git GKE GOOD TO HAVE: Data modelling basics Tableau basics SQL Performance tuning Responsibilities: Develops and...

  • Gcp Data engineer

    2 weeks ago

    bangalore, India Teamware Solutions Full time

    Greetings from Teamware SolutionsWe Are Hiring – GCP Data EngineerExperience: 8+ YearsLocation: Pan INDIAFull-time | Immediate to 15 Days Joiners PreferredWe are looking for a highly skilled GCP Data Engineer to join our dynamic data engineering team. If you excel in building scalable data pipelines and enjoy working with modern cloud technologies—this...

  • GCP Data Engineer

    2 weeks ago

    bangalore, India Tata Consultancy Services Full time

    Dear Professionals Greetings from TCS!!! Job Title : GCP Data Engineer Experience : 6- 8 Years Location : Pune/Hyderabad/bangalore/ chennai/ kolkata Skills: GCP, Big Query, Dataflow, Data Proc, Cloud SQL, Cloud Spanner, Pub/Sub, ETL, Apache airflow, Python, Pandas and Numphy JD: Google Data Engineer (Overall 5+ Years with 3 years relevant hands-on...

  • GCP Data Engineer

    1 week ago

    bangalore, India RB Consultancy Services Full time

    Job Title: GCP Data EngineerLocation: TCS - Chennai, Hyderabad, Bangalore, Pune, DelhiType: Full-timeExperience: 4+ yearsPrimary Skills:Python with OOPs concept.Data flowCloud ComposerBig querySecondary Skills:AgileSpinnakerJenkinsGitGKEGOOD TO HAVE: Data modelling basicsTableau basicsSQL Performance tuningResponsibilities:Develops and maintain scalable data...