Gcp + Big Query + Python
7 days ago
Key Responsibilities:
Design and develop robust ETL pipelines using Python, PySpark, and GCP services.
Build and optimize data models and queries in BigQuery for analytics and reporting.
Ingest, transform, and load structured and semi-structured data from various sources.
Collaborate with data analysts, scientists, and business teams to understand data requirements.
Ensure data quality, integrity, and security across cloud-based data platforms.
Monitor and troubleshoot data workflows and performance issues.
Automate data validation and transformation processes using scripting and orchestration tools.
Required Skills & Qualifications:
Hands-on experience with Google Cloud Platform (GCP), especially BigQuery.
Strong programming skills in Python and/or PySpark.
Experience in designing and implementing ETL workflows and data pipelines.
Proficiency in SQL and data modeling for analytics.
Familiarity with GCP services such as Cloud Storage, Dataflow, Pub/Sub, and Composer.
Understanding of data governance, security, and compliance in cloud environments.
Experience with version control (Git) and agile development practices.
**About Virtusa**
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.
-
Big Query+ GCP Professional
2 weeks ago
Bengaluru, Chennai, Gurugram, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled professional with expertise in Big Query and GCP to join our team. The ideal candidate will have 5-9 years of experience.Roles and ResponsibilityDesign, develop, and implement Big Query and GCP solutions.Collaborate with cross-functional teams to identify and prioritize project requirements.Develop and maintain large-scale data...
-
Java + GCP + big query
4 days ago
Chennai, India NTT Full timeJOB DESCRIPTION Job Requirements 6+ years of experience with Java, including building complex, scalable applications. 6+ years of experience in Spring Boot, including designing and implementing advanced microservices architectures. 4+ years of GCP and Big Query experience
-
Data Engineer
10 hours ago
tamil nadu, India iO Associates Full timeOur Client is a leading company in the tech industry, known for its innovation, growth opportunities, and excellent workplace culture.Role SummaryOur Client is seeking a Data Engineer (Python + GCP) to join their team in a contract position. This hire is crucial for supporting ongoing growth and innovation within the company. As a Data Engineer, you will...
-
Data engineer
1 hour ago
Chennai, India IO Associates Full timeOur Client is a leading company in the tech industry, known for its innovation, growth opportunities, and excellent workplace culture. Role Summary Our Client is seeking a Data Engineer (Python + GCP) to join their team in a contract position. This hire is crucial for supporting ongoing growth and innovation within the company. As a Data Engineer, you will...
-
Guindy, Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 8,00,000 - ₹ 12,00,000 per yearOverview:GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQLResponsibilities:GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQLRequirements:GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL
-
GCP Data engineer
2 weeks ago
Chennai, India Jobted IN C2 Full timeOverview: GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Responsibilities: GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Requirements: GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL
-
GCP Data engineer
2 weeks ago
Chennai, Tamil Nadu, India Prodapt Full time ₹ 6,00,000 - ₹ 12,00,000 per yearOverview GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Responsibilities GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Requirements GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL
-
Urgent Requirement On Hive
1 week ago
Sholinganallur, Chennai, Tamil Nadu, India CROWN BUSINESS Full timeUrgent Requirement on Hive ,Hadoop, gcp, Bigquery Min 5 years Exp in Azure Data Engineering well versed in Azure Data Eng Hive , Hadoop, gcp, Bigquery Databricks SQL Database Hands on exp in programming language - Python / pyspark / sql Exp in Azure DevOps Processes for CICD Nice Exp in Data governance tools - Unity catalog/purview **Job Types**:...
-
Data Engineer
1 day ago
Chennai, India iO Associates Full timeOur Client is a leading company in the tech industry, known for its innovation, growth opportunities, and excellent workplace culture.Role SummaryOur Client is seeking a Data Engineer (Python + GCP) to join their team in a contract position. This hire is crucial for supporting ongoing growth and innovation within the company. As a Data Engineer, you will...
-
GCP Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Swift Strategic Solutions Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per yearOur technology services client is seeking multipleGCP Data Engineerto join their team on a contract basis. These positions offer a strong potential for conversion to full-time employment upon completion of the initial contract period. Below are further details about the role:Role: GCP Data EngineerExperience: 6- 10 YearsLocation: ChennaiNotice Period:...
