Data Migration Engineer
2 days ago
Job Summary:
We are seeking a skilled Senior Data Migration Engineer with expertise in AWS, Databricks, Python, PySpark, and SQL to lead and execute complex data migration projects. The ideal candidate will design, develop, and implement data migration solutions to move large volumes of data from legacy systems to modern cloud-based platforms, ensuring data integrity, accuracy, and minimal downtime.
Job Responsibilities
Software Development:
- Design, develop, test, and deploy high-performance and scalable data solutions using Python, PySpark, SQL
- Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.
- Implement efficient and maintainable code using best practices and coding standards.
AWS & Databricks Implementation:
- Work with Databricks platform for big data processing and analytics.
- Develop and maintain ETL processes using Databricks notebooks.
- Implement and optimize data pipelines for data transformation and integration.
- Utilize AWS services (e.g., S3, Glue, Redshift, Lambda) and Databricks to build and optimize data migration pipelines.
- Leverage PySpark for large-scale data processing and transformation tasks.
Continuous Learning:
- Stay updated on the latest industry trends, tools, and technologies related to Python, SQL, and Databricks.
- Share knowledge with the team and contribute to a culture of continuous improvement.
SQL Database Management:
- Utilize expertise in SQL to design, optimize, and maintain relational databases.
- Write complex SQL queries for data retrieval, manipulation, and analysis.
Qualifications & Skills:
- Education: Bachelor's degree in Computer Science, Engineering, Data Science, or a related field. Advanced degrees are a plus.
- 4 to 8 Years of experience in Databricks and big data frameworks
- Proficient in AWS services and data migration
- Experience in Unity Catalogue
- Familiarity with Batch and real time processing
- Data engineering with strong skills in Python, PySpark, SQL
- Certifications: AWS Certified Solutions Architect, Databricks Certified Professional, or similar are a plus.
Soft Skills:
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
- Ability to work in a fast-paced, agile environment.
Qualifications
- Career Level - IC2
-
Senior Database Migration Engineer
3 days ago
Mumbai, Maharashtra, India Mactores Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMactores is a trusted leader among businesses in providing modern data platform solutions. Since 2008, Mactores have been enabling businesses to accelerate their value through automation by providing End-to-End Data Solutions that are automated, agile, and secure. We collaborate with customers to strategize, navigate, and accelerate an ideal path forward...
-
Data Engineer
2 weeks ago
Mumbai, Maharashtra, India Exponentia Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole SummaryWe are seeking an experiencedData Engineerto design, build, and optimise modern data pipelines and transformation workflows on cloud-based platforms. The role will focus on ingesting raw source data, structuring it into curated layers, and ensuring it is reliable, governed, and optimised for analytics and reporting.Key ResponsibilitiesDesign,...
-
Data Engineer
3 days ago
Mumbai, Maharashtra, India Tata Power Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRole & responsibilities7 to 12+ years of hands-on experience in SQL database design, data architecture, ETL, Data Warehousing, Data Mart, Data Lake, Big Data, Cloud (AWS) and Data Governance domains.Take ownership of the technical aspects of implementing data pipeline & migration requirements, ensuring that the platform is being used to its fullest potential...
-
Data Engineer
1 week ago
Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDesign and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...
-
Full Stack Engineer
7 days ago
Mumbai, Maharashtra, India LEAMSS-Ladhani Education & Migration Services Pvt Ltd. Full time ₹ 5,00,000 - ₹ 15,00,000 per yearCompany DescriptionLEAMSS-Ladhani Education & Migration Services Pvt Ltd. provides comprehensive career guidance, from improving communication and language skills to assisting individuals in migrating and settling abroad. The organization specializes in teaching Spoken English and Personality Development, and in supporting academic pursuits for Bachelor's or...
-
Data Engineer
4 days ago
Mumbai, Maharashtra, India PibyThree Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWe're Hiring Snowflake Data Engineer | Pune, MaharashtraPibyThree Consulting Services Pvt. Ltd. is looking for an experiencedSnowflake Data Engineerwith strong expertise inDBT, Shell Scripting, and SQLto join our growing teamJob Title:Snowflake Data EngineerSkills:Snowflake, DBT, Shell Script, SQL (Good to have: ADF, Python)Experience:Minimum 4...
-
AWS Data Engineer
2 weeks ago
Mumbai, Maharashtra, India translab Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Title:AWSDataEngineerLocation: MumbaiExperience Required: 2 to 3 YearsRole Overview:We are looking for a highly skilledAWSDataEngineerto join our team. The ideal candidate should have a solid background in SQL, Python, PySpark, andAWS. In this role, you will be responsible for designing and developing ETL pipelines and performingdatamigrations...
-
Data Engineer
3 days ago
Mumbai, Maharashtra, India Kfin Technologies Full time ₹ 8,00,000 - ₹ 12,00,000 per yearLocation : MumbaiYears of Experience: 4-5 YearsEmployment Type : Full timeJob Summary:We are seeking a highly skilled and motivated Data Engineer with strong experience in the mutual fund or asset management industry. The ideal candidate should have deep technical expertise in Scala, Python, PySpark, and cloud platforms such as AWS, with working knowledge of...
-
Data Protection Engineer
2 weeks ago
Mumbai, Maharashtra, India Swan Solutions & Services Pvt Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Title:Data Protection Engineer (Fresher / 1–2 Years Experience)Location:MumbaiExperience:0–2 YearsEmployment Type:Full-TimeAbout the RoleWe are seeking motivated individuals to join our team asData Protection Engineers. This role is suitable for recent graduates or professionals with up to 2 years of experience, who have knowledge or hands-on...
-
Lead Data Engineer
2 weeks ago
Mumbai, Maharashtra, India Green Leaf Consultants Kolkata Full time ₹ 15,00,000 - ₹ 25,00,000 per yearTake ownership of the technical aspects of implementing data pipeline & migrationrequirements, ensuring that the platform is being used to its fullest potential throughdesigning and building applications around business stakeholder needs.. Required Candidate profilehands-on experience in SQL database design, data architecture,ETL, Data Warehousing, Data...