GCP Data Engineer

3 weeks ago

Greater Hyderabad Area, IN Tata Consultancy Services Full time

Required Technical Skill Set - GCP, Python, SQL, Big Query, ETL Data Pipeline

Location of Requirement - Chennai, Kochi, Bangalore,HYD,Pune

Must-Have Competencies ,

Python, Pandas, NumPy

SQL, Data Warehouse concept

GCP services (Big Query, Cloud Run, Pub/Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Functions)

Docker, Kubernetes, GitHub

Good Communication skills

Good-to-Have

Pyspark, Data Modeling, Dataproc, Terraform

Google Cloud Professional Data Engineer certification


Responsibility of / Expectations from the Role

1 Design, develop, and manage robust, scalable ETL/ELT pipelines on GCP using tools such as Dataflow, Cloud Run, Big Query, Pub/Sub and Cloud Composer.

2 Implement data ingestion workflows from various structured and unstructured data sources.

3 Build and maintain data warehouses and data lakes using Big Query, Cloud Storage, and other GCP services.

4 Optimize data models and schema design for efficient querying and storage

5 Experience with ETL/ELT tools and data modeling concepts

6 Monitor and troubleshoot data pipeline performance and failures.


Reporting To Which Role GC developer

Size of the Team, if any Reporting to this Role - 200

Unique Selling Proposition (USP) of The Role - Long term program, Learning emerging cloud technologies,

Details of The Project (A short Briefing on the Project may be attached with this document for candidate- briefing). It may be shared with external stakeholders like job-agencies etc.

Migration of F&A data from Oracle to GCP and setting up the analytical platform for reporting

  • Databricks QA Engineer – Python, PySpark

    3 weeks ago

    Greater Hyderabad Area, IN ValueMomentum Full time

    Job Title: Data QA Engineer – Databricks & PythonExperience: 3 – 8 YearsLocation: Hyderabad / Pune / CoimbatoreNotice Period: Immediate to 30 DaysAbout The JobWe are seeking a Data QA Engineer with strong experience in Databricks and Python to ensure the quality, reliability, and accuracy of data pipelines and analytical solutions. The ideal candidate...

  • GCP ARCHITECT

    3 weeks ago

    Greater Bengaluru Area, IN People Prime Worldwide Full time

    Our is Client is a largest Top 5 Software giant in India, with over 11.3 USD billion dollars revenue, Global work force 2,40,000 employees, It delivers end-to-end technology, consulting, and business process services to clients across the globe, Presence: 60+ countries and Publicly traded company NSE & BSE (India), NYSE (USA).Job Title: GCP Architect or AWS...

  • Senior Network Engineer

    3 weeks ago

    Greater Hyderabad Area, IN ValueLabs Full time

    Note: Need Immediate joiners or who join within 15 daysJob Title: Networking Engineer – WLAN, WAN, LAN, and Cloud Networking (AWS/GCP/OCI)Job Summary: We are seeking a highly skilled Networking Engineer with expertise in designing, implementing, and managing enterprise-grade wireless (WLAN), local area (LAN), wide area (WAN), and cloud-based networking...

  • Senior Data Engineer

    3 weeks ago

    Greater Delhi Area, IN Dhurin Full time

    About the CompanyDhurin is a fastgrowing data science firm serving financial services industry. We work with banks, NBFCs, fintech and other financial institutions. Our work is in the space of risk, fraud, collections, marketing, sales, and operations through it we directly influence how financial institutions make smarter decisions. Dhurin is ‘the...

  • Platform Data Engineer

    3 weeks ago

    Greater Delhi Area, IN Insight Global Full time

    Key Responsibilities• Administer and optimize Azure Databricks, including clusters, jobs, and user access.• Manage Snowflake environments (warehouses, roles/permissions, performance tuning, cost optimization).• Design, implement, and monitor Azure Data Factory (ADF) pipelines for batch and streaming workloads.• Enable data movement and replication...

  • AI Engineer – Generative AI

    3 weeks ago

    Greater Hyderabad Area, IN Accelyst, LLC Full time

    AI Engineer – Generative AI & LLMsOnsite Role - Hyderabad Accelyst is an innovative AI Consultancy that leverages a unique catalog of industry-specific Agents and leading-edge AI platforms to deliver tangible, integrated, secure and ROI-optimized solutions. We combine deep industry and technical expertise to enable rapid deployment of innovative AI-driven...

  • AWS DeVops Engineer

    4 weeks ago

    Greater Bengaluru Area, IN Tata Consultancy Services Full time

    Greetings from Tata Consulting ServicesTCS is Hiring for AWS DevOps EngineerExperience : 5-9 years yearsLocation: Bangalore/ Chennai/Gurgaon/ Pune Please find the JD belowRequired Technical Skill - • Cloud Platform automation through DevOps scripting o (Terraform, Ansible, HELM, K8S, Shell, Python, Ruby, PowerShell, CloudFormation etc..or Similar DevOps...

  • Data Associate

    2 weeks ago

    Greater Coimbatore Area, IN Arcana Full time

    We are seeking a detail-oriented Data Associate to join our growing team. As a Data Associate, you will work closely with our product managers, financial analysts, and engineers to ensure high-quality data integration, analysis, and maintenance. The ideal candidate will have a passion for working with large datasets, a strong analytical mindset, and a desire...

  • Java Software Engineer

    3 weeks ago

    Greater Chennai Area, IN Tata Consultancy Services Full time

    Greetings, TCS is looking for Java API Management & Microservices DeveloperExperience: 5 - 8 years OnlyEducation: Minimum 15 years of full time education (10th, 12th and Graduation)Location: Chennai/Bangalore/Hyderabad/Delhi/PuneMust-Have:Excellent grasp on Core Java8 & hands-on experience developing standalone & web applications, microservices.Hands-on...

  • Software Engineer

    4 weeks ago

    Greater Bengaluru Area, IN Coforge Full time

    Job Profile : C++ DeveloperExperience : 4 - 8 YearsLocation : Greater Noida & Bangalore Expert Knowledge of C++ development in Linux environment with 3+ years of development experience.In-depth Knowledge of Object-Oriented Programming and Design PatternsLow-latency multithreaded application development experienceExperience developing cache solutions Must...