Freelance Senior Data Engineer – Snowflake to Redshift Migration

2 weeks ago

bangalore, India ThreatXIntel Full time

Company Description ThreatXIntel is a startup focused on providing innovative and affordable cyber security services tailored to the needs of businesses and organizations. Specializing in areas such as cloud security, web and mobile security testing, and DevSecOps, our team of professionals works to protect digital assets against potential cyber threats. With a proactive approach to security, we continuously monitor and address vulnerabilities in client environments. Our mission is to deliver exceptional cyber security solutions, enabling organizations to focus on growth while maintaining peace of mind. Role Description We are looking for a Senior Data Engineer with strong Python skills to support a large-scale data warehouse migration from Snowflake to AWS Redshift. The consultant will be responsible for schema conversion, data migration, validation, performance optimization, and post-migration stabilization. This role requires deep hands-on experience with AWS migration tools and modern data engineering practices. Key Responsibilities Perform schema conversion from Snowflake to Amazon Redshift using AWS Schema Conversion Tool (SCT) Execute data migration using AWS DMS, Redshift COPY commands, and S3-based ingestion patterns Validate data type mappings, encoding, and partitioning strategies for Redshift compatibility and performance Develop automation scripts for migration, validation, and cutover using Python, SQL, or shell scripting Build data validation and reconciliation frameworks to ensure data accuracy and completeness post-migration Collaborate with DBT and reporting teams to align transformations, data lineage, and downstream models Optimize Amazon Redshift performance including distribution keys, sort keys, compression, and workload management Troubleshoot and resolve migration issues related to schemas, data loads, or query performance Document migration processes, mappings, validation results, and operational runbooks Support post-migration stabilization and performance tuning activities Required Skills and Experience 7+ years of experience in data engineering or database development Strong hands-on experience with Snowflake and Amazon Redshift (including RA3 nodes and Redshift Spectrum) Proven experience using AWS Schema Conversion Tool (SCT) and AWS DMS Strong proficiency in SQL and Python for automation and data engineering tasks Solid understanding of data modeling, data warehouse optimization, and performance tuning Experience working with DBT and modern data stack tools Familiarity with S3-based data pipelines and data validation frameworks Experience with Git and CI/CD pipelines Strong problem-solving and communication skills Preferred Skills AWS certifications such as Data Analytics Specialty, Database Specialty, or Solutions Architect Experience with large-scale data migration or data platform modernization initiatives Familiarity with AWS Glue, Lambda, and CloudWatch for integrated data workflows Experience with infrastructure-as-code tools such as Terraform or CloudFormation

  • Senior Data Engineer

    18 hours ago

    bangalore, India People Tech Group Inc Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer with 5+ years of experience in data engineering and migration projects. The ideal candidate will have strong expertise in SQL, Python, data modeling, and building scalable data pipelines. Proficiency with AWS services (Redshift, S3, Glue, EMR, Lambda) is essential. A solid understanding of data...

  • Data Engineer

    2 days ago

    bangalore, India Sonata Software Full time

    We are looking for Sr Data Engineer - Snowflake Resource should have 7+ years of working knowledge in snowflake with data engineering skills Experience in AWS especially in S3, Lambda, event driven services, working proficiency in python. Very good knowledge with Kubernetes and Mongo DB Data engineering and good understanding of data warehousing and...

  • Data Engineer

    1 day ago

    bangalore, India Sonata Software Full time

    We are looking for Sr Data Engineer - Snowflake Resource should have 7+ years of working knowledge in snowflake with data engineering skills Experience in AWS especially in S3, Lambda, event driven services, working proficiency in python. Very good knowledge with Kubernetes and Mongo DB Data engineering and good understanding of data warehousing and...

  • Senior Data Engineer

    1 week ago

    Bangalore, India People Tech Group Inc Full time

    Job Summary: We are seeking a highly skilled Senior Data Engineer with 5+ years of experience in data engineering and migration projects. The ideal candidate will have strong expertise in SQL, Python, data modeling, and building scalable data pipelines. Proficiency with AWS services (Redshift, S3, Glue, EMR, Lambda) is essential. A solid understanding of...

  • Senior Snowflake Data Engineer

    1 week ago

    bangalore, India iVoyant Full time

    One of our clients is looking for an experienced Senior Snowflake Data Engineer based in India, who can work U.S. Eastern Time (EST) hours. Key Responsibilities: We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering and Snowflake development. Expert in Snowflake native features: Snow pipe, Streams, Tasks, Time...

  • Data Integration Engineer

    2 weeks ago

    bangalore, India beBeeDataMigration Full time

    Data Migration Specialist Job DescriptionWe are seeking a highly skilled professional to design, manage and optimize complex data migrations from legacy platforms. Data Migrations: Design, manage and optimize complex data migrations using AWS Redshift dbt ETL/ELT processes The ideal candidate should possess experience in designing and implementing ETL/ELT...

  • Senior Snowflake Data Engineer

    6 days ago

    bangalore, India iVoyant Full time

    One of our clients is looking for an experienced Senior Snowflake Data Engineer based in India, who can work U.S. Eastern Time (EST) hours.Key Responsibilities:We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering and Snowflake development.Expert in Snowflake native features: Snow pipe, Streams, Tasks, Time Travel,...

  • Data Engineer

    22 hours ago

    bangalore, India Sonata Software Full time

    We are looking for Sr Data Engineer - SnowflakeResource should have 7+ years of working knowledge in snowflake with data engineering skills Experience in AWS especially in S3, Lambda, event driven services, working proficiency in python. Very good knowledge with Kubernetes and Mongo DB Data engineering and good understanding of data warehousing and migration...

  • Snowflake Lead/Architect

    5 days ago

    bangalore, India Boolean Data Systems Full time

    Job Tittle: Snowflake Lead/Architect Job Id: JPC - 67 Location: Hyderabad About The Company : Boolean Data Systems is a system integration company focusing on Snowflake products. We focus on helping companies implement innovative solutions combining People+ Process+ Technology to reach their maximum ROI. We are headquartered in Atlanta, GA with additional...

  • Snowflake Lead/Architect

    7 days ago

    bangalore, India Boolean Data Systems Full time

    Job Tittle: Snowflake Lead/Architect Job Id: JPC - 67 Location: Hyderabad About The Company : Boolean Data Systems is a system integration company focusing on Snowflake products. We focus on helping companies implement innovative solutions combining People+ Process+ Technology to reach their maximum ROI. We are headquartered in Atlanta, GA with additional...