Gcp Data Architect

2 months ago


Bengaluru Karnataka, India Cygnus Professionals Inc. Full time

**Title: GCP Data Architect**

**Location: Bangalore India (Hybrid Role)**

**Employment Type: Full Time**

**Job Description for Data Engineering Architect (GCP & Apache Spark)**

**Job Summary**:
**Key Requirements**:
Over 12 years of professional experience in data engineering, specializing in implementing large-scale enterprise Data Engineering projects with the latest technologies.

Over 5 years of hands-on experience in GCP technologies and over 3 years of architect experience.

Design and implement end-to-end data architectures leveraging GCP services (e.g., Big Query, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer) for large-scale data ingestion and processing.

Build and optimize large-scale data pipelines using Apache Spark on GCP (via Dataproc or other Spark services). Ensure high performance and scalability in Spark-based data processing workloads.

Implement both real-time streaming and batch processing pipelines using Apache Spark, Dataflow, and other GCP services to meet business requirements.

Implement data governance, access controls, and security best practices to ensure the integrity, confidentiality, and compliance of data across systems.

Collaborate with business stakeholders, data scientists, and engineering teams to define data requirements, ensuring the architecture aligns with business goals.

Optimize Apache Spark jobs for performance, scalability, and cost-efficiency, ensuring that the architecture can handle growing data volumes.

Provide technical leadership to the data engineering team, mentoring junior engineers in data architecture, Apache Spark development, and GCP best practices.

**Technical Expertise**:
Expert-level programming proficiency in Python, Java, and Scala.

Extensive hands-on experience with big data technologies, including Spark, Hadoop, Hive, Yarn, MapReduce, Pig, Kafka, and PySpark.

Proficient in Google Cloud Platform services, such as BigQuery, Dataflow, Cloud Storage, Dataproc, and Cloud Composer Google Pub/Sub, and Google Cloud Functions.

Expertise in Apache Spark for both batch and real-time processing, as well as proficiency in Apache Beam, Hadoop, or other big data frameworks.

Experienced in using Cloud SQL, BigQuery, and Looker Studio (Google Data Studio) for cloud-based data solutions.

Skilled in orchestration and deployment tools like Cloud Composer, Airflow, and Jenkins for continuous integration and deployment (CI/CD).

Expertise in designing and developing integration solutions involving Hadoop/HDFS, real-time systems, data warehouses, and analytics solutions.

Experience with DevOps practices, including version control (Git), CI/CD pipelines, and infrastructure-as-code (e.g., Terraform, Cloud Deployment Manager).

Strong background in working with relational databases, NoSQL databases, and in-memory databases.

Experience managing large datasets within Data Lake and Data Fabric architectures.

Strong knowledge of security best practices, IAM, encryption mechanisms, and compliance frameworks (GDPR, HIPAA) within GCP environments.

Experience in implementing data governance, data lineage, and data quality frameworks.

Led end-to-end processes for the design, development, deployment, and maintenance of data engineering projects.

Excellent debugging and problem-solving skills.

Retail and e-commerce domain knowledge is a plus.

Positive attitude with strong analytical skills and the ability to guide teams effectively.

**Preferred Qualifications**:
GCP Certifications: Such as Professional Data Engineer or Professional Cloud Architect.

Apache Spark and Python certifications.

Experience with Data visualization tools like Tableau, Power BI etc.

**Job Types**: Full-time, Permanent

Pay: ₹3,500,000.00 - ₹5,000,000.00 per year

**Benefits**:

- Health insurance
- Provident Fund

Schedule:

- Day shift
- Monday to Friday
- Morning shift

Supplemental Pay:

- Performance bonus
- Yearly bonus

**Experience**:

- total work: 10 years (required)

Work Location: In person


  • Gcp Data Architect

    8 months ago


    Bengaluru, Karnataka, India Coforge Ltd. Full time

    **Position: GCP Data Architect** **Location: Gr. Noida, Bangalore, Hyderabad, Pune** **Duration: Full Time** **JOB DESCRIPTION**: **Designing Data Architecture**: Analyze data requirements and business needs to design high-level and detailed data architecture plans. Select appropriate data storage solutions like BigQuery, Cloud Storage, and Cloud SQL...

  • Gcp Data Architect

    7 months ago


    Bengaluru, Karnataka, India Coforge Ltd. Full time

    **Position: GCP Architect** **Location: Bangalore OR Greater Noida** **Duration: Full time** **JOB DESCRIPTION**: - Good understanding of GA4 Model and Big Query linking for GA4 - Experience in Data form to create the database - Experienced using Bitbucket for versioning the SQL code created on Data form - Solid programming skills in SQL, Python,...

  • Gcp Data Architect

    2 months ago


    Bengaluru, Karnataka, India Wipro Limited Full time

    Bengaluru, India - Tech Hiring - 3116562 **Job Description**: - **Architecture Design - Architect and implement scalable and secure data storage solution using Big Query and other GCP storage services. Design the Big Query solution or any other alternate** - ** Strong experience on Google Cloud solutions in an enterprise organizations** - ** Capability to...

  • Data Architect(Gcp)

    3 weeks ago


    Bengaluru, Karnataka, India 66degrees Full time

    Overview of 66degrees 66degrees is a leading consulting and professional services company specializing in developing AI-focused, data-led solutions leveraging the latest advancements in cloud technology. With our unmatched engineering capabilities and vast industry experience, we help the world's leading brands transform their business challenges into...

  • Data Architect(Gcp)

    3 months ago


    Bengaluru, Karnataka, India 66degrees Full time

    Overview of 66degrees 66degrees is a leading consulting and professional services company specializing in developing AI-focused, data-led solutions leveraging the latest advancements in cloud technology. With our unmatched engineering capabilities and vast industry experience, we help the world's leading brands transform their business challenges into...

  • Gcp Architect

    9 months ago


    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time

    **About the job GCP Architect**: Strong in GCP Services(cloud Service Platform, Google Kubernetes Engine Cloud Interconnect) Google Cloud Certified - Professional Cloud Architect or GCP ArchitectGoogle Cloud Platform(GCP) or certifications-AWS Solution Architect, AWS Certified DevOps Engineer Knowledge of security, identity, and Access Management(IAM), Key...

  • Gcp Data Science

    1 month ago


    Bengaluru, Karnataka, India NTT DATA Full time

    **Statistical Modeling**: Strong understanding of statistical techniques and experience leveraging BigQuery ML and Vertex AI for model development. **Machine Learning Algorithms**: Experience with GCP's pre-built ML APIs (e.g., Vision AI, Natural Language API) and custom model building using Vertex AI. **Feature Engineering**: Ability to create meaningful...

  • Gcp Architect

    7 months ago


    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time

    **About the job GCP Architect**: Job Title**:Google Cloud Platform (GCP) Architect** Experience: 8 - 9 Years Location: Bangalore, Pune, Hyderabad **Role and Responsibilities**: **1. Cloud Architecture Design**: - Design, implement, and manage robust and scalable cloud architecture solutions on the Google Cloud Platform. - Collaborate with...

  • Gcp Architect

    2 days ago


    Bengaluru, India Mindtree Full time

    JOB SUMMARY A Solutions Architect defines and owns the end-to-end solution architecture and quality attributes of systems to deliver business objectives. They understand business objectives, priorities, and pain areas and incorporate diverse technic al, functional, software and physical requirements to create the solution architecture for an overall...

  • Ai Data Architect

    2 months ago


    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 303825 We are currently seeking a AI Data Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Experience: - 10+ years of experience in Solution Architecting of Data & Analytics, AI/ML & Gen AI Solutions as Presales Consultant/ Business Development Manager/ Solution Architect **Responsibilities**: - Solid...

  • Cloud Data Architect

    6 months ago


    Bengaluru, Karnataka, India SA Technologies Inc. Full time

    **What You'll Be Doing**: As a Cloud Data Architect at SAT, you'll be immersed in diverse projects across different development stages, from pre-sales/scoping and discovery to architecting robust solutions. Your role extends to overseeing and executing projects in data engineering, including greenfield data warehouse implementations, database re-platforming,...


  • Bengaluru, India CareAtor technologies Full time

    Creates and owns technical solutions for a specific technology area(GCP, SQL, BQ, Python, Airflow), delivering work autonomously. - Integrates and implements end-to-end solutions across customers and business areas. - Executes the technical roadmap for the assigned area or domain. - Provides recommendations on the development budget based on technology...

  • Gcp Architect

    10 hours ago


    Bengaluru, India Whiteforce Full time

    **Employment Information**: - Industry - ** GCP Architect -** - Job level - *** - Salary - ** -** - Experience - ** -** - Pay-Type- Close-date- JOB-ID - **JB-20596** - Location - **Bangalore** **Job Descriptions**: **Skills**:

  • Gcp Cloud Architect

    4 months ago


    Bengaluru, Karnataka, India ARYAN SOLUTIONS PTE. LTD. Full time

    **Job description: - ** **Must have skills**: - Expert GCP knowledge (certifications highly recommended). Please provide a portfolio/description of large-scale GCP projects undertaken. - GKE/Kubernetes management and troubleshooting - Terraform IaC - Good knowledge of AWS (certifications highly recommended) - Cloud Architect, GCP, GKE,...

  • Gcp Architect

    4 days ago


    Bengaluru, India Change Leader Full time

    **JOB DESCRIPTION** **GCP Architect** **Explerience: 8**: - 15 years **Locations**:Bangalore, Chennai, Pune, Gurgaon, Hyderabad, Kolkata. **Primary Skills**: Exp.in GCP, Big Query, Air Flow, Cloud Composer, Data Fusion, Data Flow, Data Proc, Data Warehousing, Data Modeling, Big Data **Desired Skills & Responsibilities ** Strong understanding of data...

  • Gcp Data Architect

    7 months ago


    Bengaluru, Karnataka, India Infogain Full time

    ROLES & RESPONSIBILITIES **Core Skills** - In-depth knowledge of Google Cloud Platform (GCP) data services such as BigQuery, Cloud Storage, and Dataflow. - Experience in designing and implementing scalable data solutions on GCP. - Proficiency in data modeling and database design on GCP. - Understanding of data governance and security practices on...

  • Gcp Architect

    4 days ago


    Bengaluru, India growel softech Full time

    **SO ID** **Role** **Requirement** **Location** **Experience** **No.of Position** - SSL-22-23-271- GCP Architect- GCP Architect working on a migration project and should have experience on the following: - B'lore/Hyd/WFA, should also be flexible to travel onsite- 10+ Yrs- 2- There are microservices (Lambda written on Clojure/ Python), running in AWS...

  • Gcp Architect

    6 months ago


    Bengaluru, Karnataka, India Impetus Technologies Full time

    10-15 years of experience in the role of implementation of high end software products. - Provides technical leadership in Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies. - Must have : Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc,...

  • Gcp Architect

    4 days ago


    Bengaluru, India growel softech Full time

    GCP Architect working on a migration project and should have experience on the following: There are microservices (Lambda written on Clojure/ Python), running in AWS that needs to be migrated to GCP environment (Cloud Function). Databases - DynamoDB, Postgres in AWS to be migrated into GCP (Cloud Store, Postgres) The following components/ services of AWS...

  • Gcp Architect

    4 days ago


    Bengaluru, India Brillio Full time

    **GCP Architect**: