Data Architect – Data Migration

Job Title: Data Architect – Data Migration & Compliance Platform Modernization

Location: Lakshimi Colony, T. Nagar, Chennai (This is work from office for 3 months initially

Duration: Long-term (C2H)

Role Summary:

We are seeking a highly experienced and hands-on Data Architect to lead and deliver the end-to-end data migration from Databricks and Teradata to BigQuery, including complete ETL/ELT pipeline design, dataset migration, and platform modernization. The candidate will also be responsible for understanding the existing audit compliance monitoring application and building a new data pipeline into the next-generation audit platform, ensuring high data quality, governance, and traceability.

Key Responsibilities:

Data Migration & Platform Delivery

•  Lead and execute data migration strategy from Databricks and Teradata to Google BigQuery

•  Analyze and migrate existing data models, views, datasets, and ETL pipelines

•  Redesign schemas for optimized performance and compliance in BigQuery

•  Identify and address data quality, format, lineage, and validation issues

Audit Compliance Application Transition

•  Understand the current audit compliance monitoring application

•  Identify data flows, lineage, metrics, alerts, and critical data sets used

•  Redesign and build pipelines to feed data into the new audit compliance platform

•  Ensure compliance with audit trails, data retention, and security policies

ETL/ELT Architecture

•  Design and implement scalable and efficient ETL/ELT workflows using tools like Apache Airflow, dbt, Dataflow, or custom frameworks

•  Ensure reusability, observability, and resilience of data pipelines

•  Work closely with DevOps for CI/CD of data pipelines

Data Design & Governance

•  Build logical and physical data models, define data contracts and standards

•  Enable data quality rules, validation frameworks, and governance mechanisms

•  Define partitioning, clustering, cost optimization strategies for BigQuery

Stakeholder Management & Leadership

•  Collaborate with engineering, QA, product, data analysts, compliance, and audit teams

•  Capture requirements, translate into technical designs, estimate workloads

•  Lead and mentor a team of data engineers and assign responsibilities effectively

•  Communicate status, risks, dependencies, and results to senior leadership

Required Skills & Experience:

Data Platforms:

•  Deep hands-on expertise in BigQuery, Teradata, Databricks (Delta Lake, Spark)

•  Good understanding of Google Cloud Platform (GCP) services: GCS, Pub/Sub, Dataflow, Composer

Tools & Frameworks:

•  Proficiency in SQL, Python, and orchestration tools (Airflow, dbt, etc.)

•  Experience with data pipeline frameworks, batch & streaming architectures

•  Familiarity with audit logging, compliance monitoring, data security

Strategic & Functional:

•  Strong data architecture, modeling (3NF, star, snowflake) and schema design experience

•  Ability to reverse engineer data flows and audit systems

•  Proven experience in data migration and modernization programs

•  Experience working with audit, compliance, or risk applications is a strong plus

Communication & Leadership:

•  Experience working with cross-functional teams in Agile/DevOps environment

•  Excellent skills in requirement analysis, effort estimation, and task allocation

•  Ability to lead technically while being hands-on in design and delivery

Preferred Qualifications:

•  10+ years in data engineering, data architecture, or BI

•  Certifications in GCP (Professional Data Engineer or Architect)

•  Background in audit, compliance, banking, or regulated environments

Deliverables Expected:

•  Migration plan and roadmap for all datasets

•  Target data models, dictionaries, and lineage documentation

•  ETL/ELT pipeline code and documentation

•  Data validation test scripts

•  Migration success criteria and signoff reports

Soft Skills:

•  Detail-oriented, organized, and analytical thinker

•  Strong communication and presentation skills

•  Proactive, adaptable, and thrives in a fast-moving environment