Data Engineer
3 weeks ago
Job Role Data Engineer - Scale Migration Specialist (AWS) Key Responsibilities 1. Design and implement data migration strategies from on-premise Hadoop to AWS. 2. Develop and optimize Spark jobs for data processing on AWS EMR. 2. Develop and optimize Spark jobs for data processing on AWS EMR. 3. Manage and maintain S3 storage solutions for data lake architecture. 4. Configure and manage AWS Glue for ETL processes and data cataloging. 5. Ensure data quality and integrity throughout the migration process. 6. Collaborate with stakeholders to understand and document data requirements. 7. Perform data mapping and transformation tasks as part of the migration strategy. 8. Implement and manage AWS Lake Formation for data governance and security. 9. Troubleshoot and resolve data migration issues and performance bottlenecks. 10. Monitor and optimize data workflows for performance and cost efficiency. 11. Develop and maintain documentation for data processes and architecture. 12. Coordinate with cross-functional teams to align migration activities with project goals. 13. Provide technical guidance and support to junior team members. 14. Conduct performance tuning and optimization of data processing tasks. 15. Ensure compliance with data security and privacy policies. 16. Design and implement automated data pipelines using AWS services. 17. Perform regular data validation and verification checks. 18. Collaborate with AWS support and engineering teams as needed. 19. Stay up-to-date with the latest developments in big data and cloud technologies. 20. Assist in training and knowledge transfer activities for team members. Job Requirements l 6 to 10 years of work experience l 4 to 6 years of experience specifically with data migration and big data technologies. Primary Skills Expertise in Apache Spark and AWS EMR. Strong experience with AWS services such as S3, Glue, and Lake Formation. Proficiency in HDFS, Hive, and data migration strategies. Solid understanding of data processing and optimization techniques. AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect – Associate/Professional. Cloudera Certified Professional (CCP) in Data Engineering (preferred).
-
Data engineer
3 weeks ago
Bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...
-
Data Engineer
3 weeks ago
Bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Solution Engineer
1 month ago
Bangalore, Karnataka, India HEVO DATA Full timeOverview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...
-
Data Engineer
3 weeks ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...
-
Data Engineer
4 days ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...
-
Data Engineer
1 month ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...
-
Data Engineer
1 month ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data engineer
5 days ago
Bangalore City, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...
-
Data Solutions Architect
2 weeks ago
Bangalore, India HEVO DATA Full timeOverview:We're seeking a talented Solutions Engineer to join our Sales team at Hevo Data. As a Solutions Engineer, you'll work closely with the sales team to understand customers' business and technical needs and demonstrate how our platform can solve their real-time data replication needs.This role requires a deep understanding of our architecture and a...
-
Software Development Engineer II
1 month ago
Bangalore, Karnataka, India HEVO DATA Full timeAbout Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...
-
Solutions Engineer
2 months ago
bangalore, India Hevo Data Full timeOverview : We’re seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You’ll work one-on-one with the sales team to help discover our customers’ business and technical needs and demonstrate how Hevo’s platform can solve their real-time data replication needs. In this role, you will have a deep...
-
Senior Engineering Manager
3 weeks ago
bangalore, India Hevo Data Full timeAbout HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Senior Engineering Manager
5 months ago
bangalore, India Hevo Data Full timeAbout HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Senior engineering manager
3 weeks ago
Bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Senior Engineering Manager
3 weeks ago
Bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Senior Engineering Manager
2 days ago
bangalore, India Hevo Data Full timeAbout HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Senior Engineering Manager
2 months ago
bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Senior Engineering Manager
2 months ago
bangalore, India Hevo Data Full timeAbout HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Senior Engineering Manager
2 months ago
Bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Senior Engineering Manager
2 weeks ago
bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
