Data Platform Engineer

3 days ago

Bengaluru, Karnataka, India Mitra AI Full time ₹ 1,04,000 - ₹ 1,30,878 per year

We are seeking a skilled and proactive Data Migration Automation Engineer to design, develop, and maintain automation scripts for bi-directional data migration between AWS and GCP environments. The ideal candidate will have hands-on experience with cloud-native databases and migration tools, along with strong scripting and data transformation skills. This role requires working with diverse data sources and ensuring secure, efficient, and reliable migration processes.

Key Responsibilities:

  • Design and develop automation scripts for bi-directional data migration between AWS and GCP platforms.
  • Implement data migration strategies involving snapshot export/import, Change Data Capture (CDC), and logical replication.
  • Handle schema and data transformations between source and destination databases.
  • Develop and orchestrate workflows for the following migration scopes:
  • RDS PostgreSQL / Aurora PostgreSQL → Cloud SQL for PostgreSQL / AlloyDB
  • Snapshot export/import, CDC via logical replication, schema/data transformation.
  • RDS Microsoft SQL Server → Cloud SQL for SQL Server
  • Snapshot-based migration (full load) and CDC using native SQL Server replication tools.
  • DynamoDB → Cloud Bigtable / Firestore
  • Export tables to S3, transform data, and import into appropriate GCP services based on use case.
  • Collaborate with data engineers, cloud architects, and DevOps teams to optimize migration pipelines.
  • Monitor and troubleshoot migration jobs, ensuring data integrity, consistency, and performance.
  • Document technical designs, migration procedures, and automation frameworks.

Required Skills & Qualifications:

  • Strong hands-on experience in AWS and GCP cloud platforms.
  • Proven expertise in PostgreSQL, Microsoft SQL Server, and NoSQL (DynamoDB, Firestore, Bigtable) databases.
  • Experience with data migration tools such as:
  • AWS DMS, SCT, native replication tools.
  • GCP Database Migration Service, Dataflow, BigQuery Data Transfer Service.
  • Proficiency in automation/scripting languages: Python, Bash, Terraform, etc.
  • Knowledge of Change Data Capture (CDC) and logical replication mechanisms.
  • Understanding of schema design, data modeling, and ETL pipelines.
  • Familiarity with snapshot-based backups and restores for RDS and Cloud SQL.
  • Strong problem-solving and troubleshooting skills.

Preferred Qualifications:

  • Experience with CI/CD pipelines for data operations.
  • Familiarity with containerization tools (Docker, Kubernetes).
  • Knowledge of data governance and security best practices during migration.
  • GCP and AWS certifications are a plus.

  • Data Platform Engineer

    4 days ago

    Bengaluru, Karnataka, India beBeeQlikReplicate Full time US$ 1,04,000 - US$ 1,30,878

    Job Title: Data Platform EngineerWe are seeking a skilled Data Platform Engineer to join our team. As a Data Platform Engineer, you will be responsible for designing and implementing data platforms that meet the needs of our organization.Key Responsibilities:Design and implement data platforms that meet the needs of our organization.Collaborate with...

  • Data Platform Engineer

    3 days ago

    Bengaluru, Karnataka, India Umanist NA Full time ₹ 15,00,000 - ₹ 22,00,000 per year

    Job TitleLead I – Software Engineering (Data Platform Engineer)27609Location:Bangalore, Mumbai, Navi MumbaiExperience:5 to 7 YearsSalary Range:₹15,00,000 – ₹22,00,000 per annumNotice Period:Immediate to 30 daysRole OverviewWe are looking for a highly skilled and motivatedData Platform Engineerwith 4 to 10 years of experience in designing, building,...

  • Data Platform Engineer

    19 hours ago

    Bengaluru, Karnataka, India AMISEQ Full time

    Title : Data Platform ProdOps Engineer Bengaluru, KA We are seeking a proactive and detail-oriented Production Operations Engineer to join our Data Platforms team. This role plays a critical part in maintaining the stability and reliability of our large-scale data platform by providing hands-on operational support, system monitoring, and first-line...

  • Data Platform Engineer

    2 days ago

    Bengaluru, Karnataka, India CloudNuro Full time ₹ 25,00,000 - ₹ 35,00,000 per year

    Location: Bengaluru or Pune preferred, hybrid work modelWe are on the cusp of a major transformation in our data capabilities, and we are looking for a hands-on Data Platform Engineer to help lead the way. Working alongside a Staff Data Architect and Engineer, you will play a key role in designing and setting up the next generation of our lakehouse and...

  • IT Data Platform Engineer

    7 hours ago

    Bengaluru, Karnataka, India Palo Alto Networks Full time US$ 1,20,000 - US$ 2,00,000 per year

    Our MissionAt Palo Alto Networks everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for...

  • Data Platform Engineer

    3 days ago

    Bengaluru, Karnataka, India Guha Edge Professional Consulting Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Hiring Data Platform Engineer (5 to 7 yrs) | Exp in Databricks, Snowflake, Kafka, AWS/Azure | Strong in Java/Scala/Python, OOP, data modeling | NP: Immediate30 days | Location: Bangalore / Mumbai |

  • data platform

    5 days ago

    Bengaluru, Karnataka, India Cred Full time

    Job Descriptionwhat will you do- lead the design and architecture of complex data application platforms, including real-time personalization services and core metrics governance systems, ensuring scalability, reliability, and technical excellence- mentor engineers through thoughtful code reviews, pair programming, technical deep dives, and by setting a high...

  • Senior Security Platform Engineer

    1 day ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 13,08,780 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Data Platform ProdOps Engineer

    1 week ago

    Bengaluru, Karnataka, India AMISEQ Full time

    Title: Data Platform ProdOps EngineerBengaluru, KARole SummaryWe are seeking a proactive and detail-oriented Production Operations Engineer to join our Data Platforms team. This role plays a critical part in maintaining the stability and reliability of our large-scale data platform by providing hands-on operational support, system monitoring, and first-line...