Freelance Senior Data Engineer – Snowflake to Redshift Migration
1 day ago
Company DescriptionThreatXIntel is a startup focused on providing innovative and affordable cyber security services tailored to the needs of businesses and organizations. Specializing in areas such as cloud security, web and mobile security testing, and DevSecOps, our team of professionals works to protect digital assets against potential cyber threats. With a proactive approach to security, we continuously monitor and address vulnerabilities in client environments. Our mission is to deliver exceptional cyber security solutions, enabling organizations to focus on growth while maintaining peace of mind.Role DescriptionWe are looking for a Senior Data Engineer with strong Python skills to support a large-scale data warehouse migration from Snowflake to AWS Redshift. The consultant will be responsible for schema conversion, data migration, validation, performance optimization, and post-migration stabilization. This role requires deep hands-on experience with AWS migration tools and modern data engineering practices.Key ResponsibilitiesPerform schema conversion from Snowflake to Amazon Redshift using AWS Schema Conversion Tool (SCT)Execute data migration using AWS DMS, Redshift COPY commands, and S3-based ingestion patternsValidate data type mappings, encoding, and partitioning strategies for Redshift compatibility and performanceDevelop automation scripts for migration, validation, and cutover using Python, SQL, or shell scriptingBuild data validation and reconciliation frameworks to ensure data accuracy and completeness post-migrationCollaborate with DBT and reporting teams to align transformations, data lineage, and downstream modelsOptimize Amazon Redshift performance including distribution keys, sort keys, compression, and workload managementTroubleshoot and resolve migration issues related to schemas, data loads, or query performanceDocument migration processes, mappings, validation results, and operational runbooksSupport post-migration stabilization and performance tuning activitiesRequired Skills and Experience7+ years of experience in data engineering or database developmentStrong hands-on experience with Snowflake and Amazon Redshift (including RA3 nodes and Redshift Spectrum)Proven experience using AWS Schema Conversion Tool (SCT) and AWS DMSStrong proficiency in SQL and Python for automation and data engineering tasksSolid understanding of data modeling, data warehouse optimization, and performance tuningExperience working with DBT and modern data stack toolsFamiliarity with S3-based data pipelines and data validation frameworksExperience with Git and CI/CD pipelinesStrong problem-solving and communication skillsPreferred SkillsAWS certifications such as Data Analytics Specialty, Database Specialty, or Solutions ArchitectExperience with large-scale data migration or data platform modernization initiativesFamiliarity with AWS Glue, Lambda, and CloudWatch for integrated data workflowsExperience with infrastructure-as-code tools such as Terraform or CloudFormation
-
bangalore, India ThreatXIntel Full timeCompany Description ThreatXIntel is a startup focused on providing innovative and affordable cyber security services tailored to the needs of businesses and organizations. Specializing in areas such as cloud security, web and mobile security testing, and DevSecOps, our team of professionals works to protect digital assets against potential cyber threats....
-
AWS Data Engineer
2 weeks ago
bangalore, India Techmango Technology Services Private Limited Full timeAbout TechMango: Founded in 2014, Techmango Technology Services Private Limited is a trusted global technology partner with a presence in India, the USA, and the UAE. The company specializes in delivering transformative digital solutions by integrating Generative AI, Data Analytics, and Intelligent Automation with advanced engineering expertise. Techmango...
-
Senior Data Engineer
1 day ago
bangalore, India Meril Full time🔍 We're Hiring: Senior Data EngineerWe are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure. If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you.🔧 Key Technical ResponsibilitiesDesign and build scalable ETL/ELT...
-
Data Migration Specialist
2 weeks ago
bangalore, India Atlas - the Recruitment Platform Full timeBefore you start reading, please read this carefully! I've spent a good amount of time thinking about what to write :D Anyone who successfully passes our 30 minute SQL assessment will receive $30 Who we are Atlas Technologies is an anti-CRM built solely for recruitment professionals. A customer relationship management tool is a necessary software for running...
-
Business-Critical Data Migration Expert
1 week ago
bangalore, India beBeeDataMigration Full timeJob Opportunity:Data migration is an intricate process involving the transformation of data from one system to another.As a Data Migration Specialist, you will be responsible for designing and managing complex data migrations using AI coding assistants to create efficient methods of transforming incoming clients from their legacy platforms to our...
-
Lead Data Engineer
4 days ago
bangalore, India Vriba Solutions Full timeLead Data Engineer Location & Work ModelLocation: Remote Work Model: Full-time Timings :8AM IST to 5 PM ISTJob SummaryWe are seeking a highly experienced Senior Cloud Data Engineer with 10+ years of hands-on experience in designing, building, and managing large-scale data platforms and pipelines in cloud environments. The ideal candidate will have strong...
-
Sr Snowflake Data Engineer
3 weeks ago
bangalore, India Impactron Global Full timeRole Overview We’re seeking a Sr Data Engineer passionate about building scalable, cloud-native data solutions using Snowflake, dbt, and modern ETL frameworks. You will design, implement, and support data architectures and pipelines that support analytics, reporting, and AI-driven use cases for global clients. You’ll work within a consulting team that...
-
Lead Data Engineer
3 days ago
bangalore, India Vriba Solutions Full timeLead Data Engineer Location & Work Model Location: Remote Work Model: Full-time Timings :8AM IST to 5 PM IST Job Summary We are seeking a highly experienced Senior Cloud Data Engineer with 10+ years of hands-on experience in designing, building, and managing large-scale data platforms and pipelines in cloud environments. The ideal candidate will have strong...
-
Snowflake Engineer
4 weeks ago
bangalore, India Tata Consultancy Services Full timeTCS is Hiring!!! Greetings from TCS!!! TCS presents an excellent opportunity for Data Engineer Role: Snowflake Developer Desired Experience Range: 5-10 Years Location: Bangalore/Pune Desired Competencies (Technical/Behavioral Competency) Must Have - Strong experience in Snowflake, SQL for data manipulation and engineering tasks. Strong Expertise in SQL and...
-
Snowflake Engineer
4 days ago
bangalore, India Tata Consultancy Services Full timeTCS is Hiring!!! Greetings from TCS!!! TCS presents an excellent opportunity for Data Engineer Role: Snowflake Developer Desired Experience Range: 5-10 Years Location: Bangalore/Pune Desired Competencies (Technical/Behavioral Competency) Must Have - Strong experience in Snowflake, SQL for data manipulation and engineering tasks. Strong Expertise in SQL and...
