Data Platform Engineer

1 day ago

Bengaluru, Karnataka, India Mitra AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

We are seeking a skilled and proactive Data Migration Automation Engineer to design, develop, and maintain automation scripts for bi-directional data migration between AWS and GCP environments. The ideal candidate will have hands-on experience with cloud-native databases and migration tools, along with strong scripting and data transformation skills. This role requires working with diverse data sources and ensuring secure, efficient, and reliable migration processes.

Key Responsibilities:

  • Design and develop automation scripts for bi-directional data migration between AWS and GCP platforms.
  • Implement data migration strategies involving snapshot export/import, Change Data Capture (CDC), and logical replication.
  • Handle schema and data transformations between source and destination databases.
  • Develop and orchestrate workflows for the following migration scopes:
  • RDS PostgreSQL / Aurora PostgreSQL → Cloud SQL for PostgreSQL / AlloyDB
  • Snapshot export/import, CDC via logical replication, schema/data transformation.
  • RDS Microsoft SQL Server → Cloud SQL for SQL Server
  • Snapshot-based migration (full load) and CDC using native SQL Server replication tools.
  • DynamoDB → Cloud Bigtable / Firestore
  • Export tables to S3, transform data, and import into appropriate GCP services based on use case.
  • Collaborate with data engineers, cloud architects, and DevOps teams to optimize migration pipelines.
  • Monitor and troubleshoot migration jobs, ensuring data integrity, consistency, and performance.
  • Document technical designs, migration procedures, and automation frameworks.

Required Skills & Qualifications:

  • Strong hands-on experience in AWS and GCP cloud platforms.
  • Proven expertise in PostgreSQL, Microsoft SQL Server, and NoSQL (DynamoDB, Firestore, Bigtable) databases.
  • Experience with data migration tools such as:
  • AWS DMS, SCT, native replication tools.
  • GCP Database Migration Service, Dataflow, BigQuery Data Transfer Service.
  • Proficiency in automation/scripting languages: Python, Bash, Terraform, etc.
  • Knowledge of Change Data Capture (CDC) and logical replication mechanisms.
  • Understanding of schema design, data modeling, and ETL pipelines.
  • Familiarity with snapshot-based backups and restores for RDS and Cloud SQL.
  • Strong problem-solving and troubleshooting skills.

Preferred Qualifications:

  • Experience with CI/CD pipelines for data operations.
  • Familiarity with containerization tools (Docker, Kubernetes).
  • Knowledge of data governance and security best practices during migration.
  • GCP and AWS certifications are a plus.

  • It Data Platform Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Palo Alto Networks Full time

    Company Description Our Mission At Palo Alto Networks everything starts and ends with our mission Being the cybersecurity partner of choice protecting our digital way of life Our vision is a world where each day is safer and more secure than the one before We are a company built on the foundation of challenging and disrupting the way things are done ...

  • Data Platform Engineer

    1 day ago

    Bengaluru, Karnataka, India Palo Alto Networks Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    IT Data Platform Engineer Company Description Our Mission At Palo Alto Networks everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and...

  • IT Data Platform Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Palo Alto Networks Full time

    Our MissionAt Palo Alto Networks everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for...

  • Data Platform Engineer

    1 day ago

    Bengaluru, Karnataka, India Launch It Consulting Full time ₹ 6,00,000 - ₹ 15,00,000 per year

    Data & AI Data Platform EngineerDescription: Be a part of our success story. Launch offers talented and motivated people the opportunity to do the best work of their lives in a dynamic and growing company. Through competitive salaries, outstanding benefits, internal advancement opportunities, and recognized community involvement, you will have the chance to...

  • data platform

    4 weeks ago

    Bengaluru, Karnataka, India Cred Full time

    Job Descriptionwhat will you do- lead the design and architecture of complex data application platforms, including real-time personalization services and core metrics governance systems, ensuring scalability, reliability, and technical excellence- mentor engineers through thoughtful code reviews, pair programming, technical deep dives, and by setting a high...

  • High Salary) Senior Automation Platform Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 340459 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Senior Automation Platform Engineer to join our team in Bangalore Karn taka IN-KA India IN Job Summary The...

  • Automation Platform Engineer

    1 day ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Senior Automation Platform Engineer Req ID: 340459 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Automation Platform Engineer to join our team in Bangalore, Karnātaka...

  • Technical Lead- Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data Platform Engineer III

    6 days ago

    Bengaluru, Karnataka, India Grizmo Labs Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Responsibilities : - Design, build, and maintain scalable data platforms and pipelines to support the needs of the business. - Ensure data quality and accuracy by implementing data validation and testing processes. - Participate in code reviews and provide feedback to improve code quality and adherence to best practices. - Work closely with DevOps to...

  • Azure Data Engineer – Data Platforms

    1 day ago

    Bengaluru, Karnataka, India SWITS DIGITAL Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    **Job Title: Azure Data Engineer – Data PlatformsLocation:**Bangalore, IndiaExperience Required:6 – 9 YearsAbout The RoleWe are seeking an experiencedAzure Data Engineerto join our Data Platforms team. The ideal candidate will have strong expertise inAzure Databricks, Azure Data Factory, SQL, and Python, with a solid understanding of data engineering...