Data Engineer

1 month ago

Bangalore, India GCC client Full time

Job Role Data Engineer - Scale Migration Specialist (AWS) Key Responsibilities 1. Design and implement data migration strategies from on-premise Hadoop to AWS. 2. Develop and optimize Spark jobs for data processing on AWS EMR. 2. Develop and optimize Spark jobs for data processing on AWS EMR. 3. Manage and maintain S3 storage solutions for data lake architecture. 4. Configure and manage AWS Glue for ETL processes and data cataloging. 5. Ensure data quality and integrity throughout the migration process. 6. Collaborate with stakeholders to understand and document data requirements. 7. Perform data mapping and transformation tasks as part of the migration strategy. 8. Implement and manage AWS Lake Formation for data governance and security. 9. Troubleshoot and resolve data migration issues and performance bottlenecks. 10. Monitor and optimize data workflows for performance and cost efficiency. 11. Develop and maintain documentation for data processes and architecture. 12. Coordinate with cross-functional teams to align migration activities with project goals. 13. Provide technical guidance and support to junior team members. 14. Conduct performance tuning and optimization of data processing tasks. 15. Ensure compliance with data security and privacy policies. 16. Design and implement automated data pipelines using AWS services. 17. Perform regular data validation and verification checks. 18. Collaborate with AWS support and engineering teams as needed. 19. Stay up-to-date with the latest developments in big data and cloud technologies. 20. Assist in training and knowledge transfer activities for team members. Job Requirements   l 6 to 10 years of work experience l 4 to 6 years of experience specifically with data migration and big data technologies. Primary Skills Expertise in Apache Spark and AWS EMR. Strong experience with AWS services such as S3, Glue, and Lake Formation. Proficiency in HDFS, Hive, and data migration strategies. Solid understanding of data processing and optimization techniques. AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect – Associate/Professional. Cloudera Certified Professional (CCP) in Data Engineering (preferred).

  • Data engineer

    1 month ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Solution Engineer

    2 months ago

    Bangalore, Karnataka, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...

  • Solution Engineer

    23 hours ago

    Bangalore, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will...

  • Data Engineer

    3 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. - Lead the architecture, design, and delivery of enterprise grade microservices. - Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    3 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    1 month ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    4 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    2 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    2 months ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    2 months ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data engineer

    4 weeks ago

    Bangalore City, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Solutions Architect

    1 month ago

    Bangalore, India HEVO DATA Full time

    Overview:We're seeking a talented Solutions Engineer to join our Sales team at Hevo Data. As a Solutions Engineer, you'll work closely with the sales team to understand customers' business and technical needs and demonstrate how our platform can solve their real-time data replication needs.This role requires a deep understanding of our architecture and a...

  • Software Development Engineer II

    2 months ago

    Bangalore, Karnataka, India HEVO DATA Full time

    About Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...

  • Software Development Engineer II

    23 hours ago

    Bangalore, India HEVO DATA Full time

    About Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...

  • Senior Engineering Manager

    2 months ago

    bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Senior Engineering Manager

    3 weeks ago

    bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    1 month ago

    bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Senior Engineering Manager

    3 weeks ago

    bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Senior engineering manager

    1 month ago

    Bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    1 month ago

    Bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...