Gcp + Big Query + Python

1 week ago

Chennai Tamil Nadu, India Virtusa Full time

Key Responsibilities:
Design and develop robust ETL pipelines using Python, PySpark, and GCP services.
Build and optimize data models and queries in BigQuery for analytics and reporting.
Ingest, transform, and load structured and semi-structured data from various sources.
Collaborate with data analysts, scientists, and business teams to understand data requirements.
Ensure data quality, integrity, and security across cloud-based data platforms.
Monitor and troubleshoot data workflows and performance issues.
Automate data validation and transformation processes using scripting and orchestration tools.

Required Skills & Qualifications:
Hands-on experience with Google Cloud Platform (GCP), especially BigQuery.
Strong programming skills in Python and/or PySpark.
Experience in designing and implementing ETL workflows and data pipelines.
Proficiency in SQL and data modeling for analytics.
Familiarity with GCP services such as Cloud Storage, Dataflow, Pub/Sub, and Composer.
Understanding of data governance, security, and compliance in cloud environments.
Experience with version control (Git) and agile development practices.

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • GCP Data engineer-Attrition backfill-Saravanan S

    4 hours ago

    Guindy, Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Overview:GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQLResponsibilities:GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQLRequirements:GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL

  • Python Development

    7 days ago

    Chennai, Bengaluru, India Infrasoft Technologies Limited Full time

    Job DescriptionJob Title: DeveloperWork Location: Chennai, TN & Bangalore, KAExperience Range: 68 YearsJob Description:We are seeking a highly skilled Developer with 68 years of experience in Python, PySpark, PL/SQL, and Big Data technologies. The ideal candidate will have strong expertise in data engineering, with hands-on experience in Google Cloud...

  • Big Data Architect

    1 week ago

    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    **Responsibilities**: - Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Bigdata + GCP Engineer

    2 days ago

    Chennai, Tamil Nadu, India Impetus Technologies Full time US$ 1,20,000 - US$ 2,00,000 per year

    Chennai, Tamil Nadu, IndiaQualification:Must have : Bigdata ,GCP (Bigquery, Dataproc)We are looking for energetic, high-performing and highly skilled data engineers to help shape our technology and product roadmap.You will be part of the fast-paced, entrepreneurial Global Campaign Tracking (GCT) team under Enterprise PersonalizationPortfolio focused on...

  • Gcp Data Engineer

    2 days ago

    Chennai, Hyderabad, India Randomtrees Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: GCP Data EngineerLocation: Hyderabad & Chennai (Hybrid mode of working)Experience: 5+ YearsEmployment Type: Full TimeKey ResponsibilitiesDesign, build, and optimize scalable data pipelines using GCP services (Big Query, Dataflow, Airflow, Pub/Sub, Cloud Storage).Develop and maintain ETL/ELT workflows leveraging Airflow and DBT for data modeling...

  • Bigdata + GCP Engineer

    2 days ago

    Chennai, Tamil Nadu, India Impetus Full time US$ 80,000 - US$ 1,50,000 per year

    QualificationMust have :Bigdata ,GCP (Bigquery, Dataproc)We are looking for energetic, high-performing and highly skilled data engineers to help shape our technology and product roadmap.You will be part of the fast-paced, entrepreneurial Global Campaign Tracking (GCT) team under Enterprise PersonalizationPortfolio focused on delivering the next generation of...

  • GCP Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Location- Chennai, Hyderabad, Bangalore, Pune, Gurgaon Experience- 10-12 years Requirements: - Proficiency in programming languages: Python, Java - Expertise in data processing frameworks: Apache Beam (Data Flow) - Active experience on GCP tools and technologies like Big Query, Dataflow, Cloud Composer, Cloud Spanner, GCS, DBT etc., - Data...

  • GCP Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Location- Chennai, Hyderabad, Bangalore, Pune, Gurgaon Experience- 10-12 years Requirements: - Proficiency in programming languages: Python, Java - Expertise in data processing frameworks: Apache Beam (Data Flow) - Active experience on GCP tools and technologies like Big Query, Dataflow, Cloud Composer, Cloud Spanner, GCS, DBT etc., - Data...

  • GCP Bigquery Developer

    2 days ago

    Chennai, Coimbatore, Kolkata, India Ltimindtree Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Mandate Skills: GCP, Bigquery, Python, SQLResponsibility:Good Knowledge of GCP, Bigquery, SQL, Python dataflow skills.Has worked in Implementation projects building data pipelines transformation logics and data modelsProficient in dealing data access layer RDBMS, NOSQLExperience in implementing and deploying Big data applications with GCP Big Data...

  • GCP Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Role: GCP Data Architect Job Location: Chennai/Hyderabad/Pune/Bangalore/Gurgaon Exp Range: 10Years to 15Years. Desired Competencies (Technical/Behavioral Competency): Should have experience in GCP Data Architect Should have experience in Data Flow, Data Proc, Big Query Develop ETL/ELT pipeline using Data Flow, Data Proc, Big Query Provide technical...