Data Platform Engineer

2 weeks ago

Bengaluru, Karnataka, India Mitra AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

We are seeking a skilled and proactive Data Migration Automation Engineer to design, develop, and maintain automation scripts for bi-directional data migration between AWS and GCP environments. The ideal candidate will have hands-on experience with cloud-native databases and migration tools, along with strong scripting and data transformation skills. This role requires working with diverse data sources and ensuring secure, efficient, and reliable migration processes.

Key Responsibilities:

  • Design and develop automation scripts for bi-directional data migration between AWS and GCP platforms.
  • Implement data migration strategies involving snapshot export/import, Change Data Capture (CDC), and logical replication.
  • Handle schema and data transformations between source and destination databases.
  • Develop and orchestrate workflows for the following migration scopes:
  • RDS PostgreSQL / Aurora PostgreSQL → Cloud SQL for PostgreSQL / AlloyDB
  • Snapshot export/import, CDC via logical replication, schema/data transformation.
  • RDS Microsoft SQL Server → Cloud SQL for SQL Server
  • Snapshot-based migration (full load) and CDC using native SQL Server replication tools.
  • DynamoDB → Cloud Bigtable / Firestore
  • Export tables to S3, transform data, and import into appropriate GCP services based on use case.
  • Collaborate with data engineers, cloud architects, and DevOps teams to optimize migration pipelines.
  • Monitor and troubleshoot migration jobs, ensuring data integrity, consistency, and performance.
  • Document technical designs, migration procedures, and automation frameworks.

Required Skills & Qualifications:

  • Strong hands-on experience in AWS and GCP cloud platforms.
  • Proven expertise in PostgreSQL, Microsoft SQL Server, and NoSQL (DynamoDB, Firestore, Bigtable) databases.
  • Experience with data migration tools such as:
  • AWS DMS, SCT, native replication tools.
  • GCP Database Migration Service, Dataflow, BigQuery Data Transfer Service.
  • Proficiency in automation/scripting languages: Python, Bash, Terraform, etc.
  • Knowledge of Change Data Capture (CDC) and logical replication mechanisms.
  • Understanding of schema design, data modeling, and ETL pipelines.
  • Familiarity with snapshot-based backups and restores for RDS and Cloud SQL.
  • Strong problem-solving and troubleshooting skills.

Preferred Qualifications:

  • Experience with CI/CD pipelines for data operations.
  • Familiarity with containerization tools (Docker, Kubernetes).
  • Knowledge of data governance and security best practices during migration.
  • GCP and AWS certifications are a plus.

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Senior Automation Platform Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 340459NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Automation Platform Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Summary: The...

  • Data Platform Engineer

    2 days ago

    Bengaluru, Karnataka, India Grizmo Labs 🌐 Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    What you'll do:• Design, build, and maintain scalable data platforms and pipelines to support the needs of the business• Ensure data quality and accuracy by implementing data validation and testing processes• Participate in code reviews and provide feedback to improve code quality and adherence to best practices• Work closely with DevOps to ensure...

  • Data Platform Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Palo Alto Networks Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    IT Data Platform Engineer Company Description Our Mission At Palo Alto Networks everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and...

  • IT Data Platform Engineer

    1 week ago

    Bengaluru, Karnataka, India Palo Alto Networks Full time US$ 1,20,000 - US$ 2,00,000 per year

    Our MissionAt Palo Alto Networks everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for...

  • IT Data Platform Engineer

    2 days ago

    Bengaluru, Karnataka, India Palo Alto Networks Full time US$ 1,20,000 - US$ 2,00,000 per year

    Company Description Our MissionAt Palo Alto Networks everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and...

  • Data Platform Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Launch It Consulting Full time ₹ 6,00,000 - ₹ 15,00,000 per year

    Data & AI Data Platform EngineerDescription: Be a part of our success story. Launch offers talented and motivated people the opportunity to do the best work of their lives in a dynamic and growing company. Through competitive salaries, outstanding benefits, internal advancement opportunities, and recognized community involvement, you will have the chance to...

  • Cloud Data Platform Engineer

    2 days ago

    Bengaluru, Karnataka, India Capgemini Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    About The Role  A Data Platform Engineer specialises in the design, build, and maintenance of cloud-based data infrastructure and platforms for data-intensive applications and services. They develop Infrastructure as Code and manage the foundational systems and tools for efficient data storage, processing, and management. This role involves architecting...

  • Senior Data Engineer cum Data Scientist

    2 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...

  • AI Platform Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 343079NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AI Platform Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job Duties: Exercise expertise in...