Urgent: Data Platform Engineer

4 days ago

Bengaluru, Karnataka, India Mitra AI Full time
Job Description

We are seeking a skilled and proactive Data Migration Automation Engineer to design, develop, and maintain automation scripts for bi-directional data migration between AWS and GCP environments. The ideal candidate will have hands-on experience with cloud-native databases and migration tools, along with strong scripting and data transformation skills. This role requires working with diverse data sources and ensuring secure, efficient, and reliable migration processes.

Key Responsibilities:

- Design and develop automation scripts for bi-directional data migration between AWS and GCP platforms.
- Implement data migration strategies involving snapshot export/import, Change Data Capture (CDC), and logical replication.
- Handle schema and data transformations between source and destination databases.
- Develop and orchestrate workflows for the following migration scopes:
- RDS PostgreSQL / Aurora PostgreSQL Cloud SQL for PostgreSQL / AlloyDB
- Snapshot export/import, CDC via logical replication, schema/data transformation.
- RDS Microsoft SQL Server Cloud SQL for SQL Server
- Snapshot-based migration (full load) and CDC using native SQL Server replication tools.
- DynamoDB Cloud Bigtable / Firestore
- Export tables to S3, transform data, and import into appropriate GCP services based on use case.
- Collaborate with data engineers, cloud architects, and DevOps teams to optimize migration pipelines.
- Monitor and troubleshoot migration jobs, ensuring data integrity, consistency, and performance.
- Document technical designs, migration procedures, and automation frameworks.

Required Skills & Qualifications:

- Strong hands-on experience in AWS and GCP cloud platforms.
- Proven expertise in PostgreSQL, Microsoft SQL Server, and NoSQL (DynamoDB, Firestore, Bigtable) databases.
- Experience with data migration tools such as:
- AWS DMS, SCT, native replication tools.
- GCP Database Migration Service, Dataflow, BigQuery Data Transfer Service.
- Proficiency in automation/scripting languages: Python, Bash, Terraform, etc.
- Knowledge of Change Data Capture (CDC) and logical replication mechanisms.
- Understanding of schema design, data modeling, and ETL pipelines.
- Familiarity with snapshot-based backups and restores for RDS and Cloud SQL.
- Strong problem-solving and troubleshooting skills.

Preferred Qualifications:

- Experience with CI/CD pipelines for data operations.
- Familiarity with containerization tools (Docker, Kubernetes).
- Knowledge of data governance and security best practices during migration.
- GCP and AWS certifications are a plus.

  • Urgent Data Platform Admin And Engineer

    5 days ago

    Bengaluru, Karnataka, India Winbold Full time

    Company DescriptionWe are a startup working on an investing platform for algo tradingNO FRESHERS Please read the job description before applying We are seeking a skilled Data Platform Admin and Engineer to join our team in Bengaluru India In this role you will be responsible for managing and optimizing our data platform infrastructure ensuring its...

  • Urgent Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - ETL to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties:. Migrate ETL workflows from...

  • Data Platform Engineer

    5 days ago

    Bengaluru, Karnataka, India beBeeQlikReplicate Full time US$ 1,04,000 - US$ 1,30,878

    Job Title: Data Platform EngineerWe are seeking a skilled Data Platform Engineer to join our team. As a Data Platform Engineer, you will be responsible for designing and implementing data platforms that meet the needs of our organization.Key Responsibilities:Design and implement data platforms that meet the needs of our organization.Collaborate with...

  • Data Platform Engineer

    4 days ago

    Bengaluru, Karnataka, India Umanist NA Full time ₹ 15,00,000 - ₹ 22,00,000 per year

    Job TitleLead I – Software Engineering (Data Platform Engineer)27609Location:Bangalore, Mumbai, Navi MumbaiExperience:5 to 7 YearsSalary Range:₹15,00,000 – ₹22,00,000 per annumNotice Period:Immediate to 30 daysRole OverviewWe are looking for a highly skilled and motivatedData Platform Engineerwith 4 to 10 years of experience in designing, building,...

  • Data Platform Engineer

    2 days ago

    Bengaluru, Karnataka, India AMISEQ Full time

    Title : Data Platform ProdOps Engineer Bengaluru, KA We are seeking a proactive and detail-oriented Production Operations Engineer to join our Data Platforms team. This role plays a critical part in maintaining the stability and reliability of our large-scale data platform by providing hands-on operational support, system monitoring, and first-line...

  • Data Platform Engineer

    3 days ago

    Bengaluru, Karnataka, India CloudNuro Full time ₹ 25,00,000 - ₹ 35,00,000 per year

    Location: Bengaluru or Pune preferred, hybrid work modelWe are on the cusp of a major transformation in our data capabilities, and we are looking for a hands-on Data Platform Engineer to help lead the way. Working alongside a Staff Data Architect and Engineer, you will play a key role in designing and setting up the next generation of our lakehouse and...

  • IT Data Platform Engineer

    1 day ago

    Bengaluru, Karnataka, India Palo Alto Networks Full time US$ 1,20,000 - US$ 2,00,000 per year

    Our MissionAt Palo Alto Networks everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for...

  • Data Platform Engineer

    3 days ago

    Bengaluru, Karnataka, India Guha Edge Professional Consulting Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Hiring Data Platform Engineer (5 to 7 yrs) | Exp in Databricks, Snowflake, Kafka, AWS/Azure | Strong in Java/Scala/Python, OOP, data modeling | NP: Immediate30 days | Location: Bangalore / Mumbai |

  • Urgent) Staff Data and ML Platform Engineer

    23 hours ago

    Bengaluru, Karnataka, India Palo Alto Networks Full time

    Our MissionAt Palo Alto Networks everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for...

  • data platform

    6 days ago

    Bengaluru, Karnataka, India Cred Full time

    Job Descriptionwhat will you do- lead the design and architecture of complex data application platforms, including real-time personalization services and core metrics governance systems, ensuring scalability, reliability, and technical excellence- mentor engineers through thoughtful code reviews, pair programming, technical deep dives, and by setting a high...