Gcp + Big Query + Python

**Skills**:Knowledge of Google Cloud Platform Google Cloud GCP cloud storage, Data proc, Big query SQL Strong SQL & Advanced SQL Spark writing skills on Pyspark DWH Data warehousing concepts & dimension modeling (Good to have) Python GIT Any GCP Certification Roles & Responsibilities: Perform data analytics, warehousing, ETL development Design & Build...

1. Dataiku exp of at least 1.5-2 years. Good to know on creating and handling partitioned dataset in Dataiku. 2. Good with Python, data handling using pandas, numpy (Pandas and numpy are must and must know it in depth) and basics of regex. 3. Should be able to work on GCP big query and use terraform as base for managing the code changes. **About...

Design and develop robust ETL pipelines using Python, PySpark, and GCP services.Build and optimize data models and queries in BigQuery for analytics and reporting.Ingest, transform, and load structured and semi-structured data from various sources.Collaborate with data analysts, scientists, and business teams to understand data requirements.Ensure data...

**Job Title: GCP Architect** **Location: Noida/Bangalore** **Type of Employment: Full Time** **Experience: 12 to 20 Years** **Notice Period: Immediate or Less than 20 Days** **Skill Set**: GCP DATA LAKE **Skill to Evaluate**: GCP-Architecture, GA4-Model, Data-form, Python or Pyspark, BigQuery, Terraform **JOB DESCRIPTION**: - Good understanding of...

8 years of experience in Python. Strong Programming skills in Python 3, Shell and Linux. RESTful API Design using Python FLASK framework. Testing of APIs and writing pytest unit tests. o Experience in Implementing Microservices architecture. Knowledge of Google Cloud Environment and BigQuery database would be an added advantage. SQL o Knowledge of the...

Site Reliability Engineering In this role, you will: Manage the availability, latency, scalability, and efficiency of GFiber services running on Google infrastructure by engineering reliability into software and systems. Design, implement, and maintain highly available and scalable infrastructure on GCP. Work closely with development teams to integrate...

Job Summary:We are hiring an experienced Big Data Engineer to design, build, and maintain high-performance data processing systems. The role requires strong expertise in Hadoop ecosystem, Spark, and cloud-based data pipelines with a focus on scalability, reliability, and performance.Key Responsibilities:Design and develop end-to-end big data pipelines for...

Here is the JD Data Quality Skills : Data profiling to ensure data accuracy & consistency by using data quality scans and automated scripts. Data Analysis Skills - Shall be able to analyze large datasets, identify trends & anomalies. SQL Skills - query syntax and querying data for validation. (DML, DDL, etc) Tools - Looker Studio, Google Sheets,Sql query,...

Data Engineer Position Summary Minimum Qualifications 6 Years overall IT experience with minimum 4 years of work experience in below tech skills Tech Skills Proficient in Python scripting and PySpark for data processing tasks Strong SQL capabilities with hands on experience managing big data using ETL tools like Informatica Experience with the AWS cloud...

Data Engineer Must have 9+ years of experience in below mentioned skills. Must Have: Big Data Concepts Python(Core Python - Able to write code), SQL, Shell Scripting, AWS S3 Good to Have: Event-driven/AWA SQS, Microservices, API Development,Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Aurora **About Virtusa** Teamwork, quality of life, professional and...