Data Engineer for Hadoop Ecosystem

1 week ago


Hyderabad, Telangana, India Virtusa Full time
Job Description:

We are seeking an experienced Data Engineer to join our team in Hyderabad, India. This is a challenging role that requires strong expertise in designing, building, and supporting large-scale data applications using Hadoop ecosystem components.

About the Role:

  • Designing and Developing Data Applications: Develop complex software requirements to accomplish business goals, ensuring principal architecture integrity is maintained.
  • Hadoop Ecosystem Expertise: In-depth knowledge of Hive, Shell scripting, Python, Spark, and experience with MapReduce jobs.
  • Unix and Shell Scripting: Strong experience in Unix and Shell scripting, including job schedulers like Autosys.
  • Agile Development: Good understanding of Agile development methodologies.

Responsibilities:

  1. Develop components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained.
  2. Ensure solutions are well-designed with maintainability/ease of integration and testing built-in from the outset.
  3. Participate and guide teams in estimating work necessary to realize a story/requirement through the software delivery lifecycle.

Requirements:

  • Bachelor's or Master's degree in Computer Science or related field.
  • 5+ years of hands-on experience in designing, building, and supporting data applications using Spark, Sqoop, and Hive.
  • Strong knowledge of working with large data sets and high-capacity big data processing platforms.
  • Experience with Jenkins for Continuous Integration and Source Code and Version Control Systems like Bitbucket, Git.

Salary: ₹1,200,000 - ₹1,800,000 per annum (depending on experience).

Location: Hyderabad, Andhra Pradesh, India.



  • Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...


  • Hyderabad, Telangana, India Anblicks Full time

    Job DescriptionWe are seeking an experienced Data Architect to join our team at Anblicks. This role involves designing and implementing data solutions using Hadoop technologies.About the Role:Design and develop large-scale data processing pipelines using Hadoop ecosystem tools such as HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, and...

  • Data Engineer

    14 hours ago


    Hyderabad, Telangana, India People Tech Group Inc Full time

    Job Title: Data Engineer - Hadoop and Big Data Expert About People Tech Group IncWe are a leading technology solutions provider, dedicated to delivering innovative and effective solutions to our clients. As a result-driven organization, we strive to stay ahead of the curve in terms of technological advancements, ensuring that our services meet the evolving...


  • Hyderabad, Telangana, India data Full time

    Unlock the Power of Big DataWe are seeking an experienced Advanced Data Analytics Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will play a crucial role in designing and implementing innovative data products using agile methodologies and open-source technologies.About the RoleThis is an exciting opportunity to...


  • Hyderabad, Telangana, India ValueMomentum Full time

    {"Responsibilities": "Key Responsibilities:Design, develop, and execute test plans and test cases for our Hadoop data ingestion pipelines.Ensure the completeness, correctness, and timeliness of data ingested into Hadoop. Validate source to target data mapping and transformations.Evaluate the performance and scalability of our data ingestion processes and...


  • Hyderabad, Telangana, India ValueMomentum Full time

    About ValueMomentum's Engineering CenterAt ValueMomentum, we're a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through a strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery...


  • Hyderabad, Telangana, India Virtusa Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a key member of our engineering team, you will design, develop, and maintain large-scale data processing pipelines using big data technologies such as Hadoop, MapReduce, Hive, and Spark.ResponsibilitiesDesign and implement data processing pipelines using Python...


  • Hyderabad, Telangana, India Nexthire Full time

    We are seeking an experienced Data Engineer to join our team at Nexthire, a company that leverages AI strategies to deliver valuable outcomes for global organizations.Job Description:As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable and robust data pipelines to support various data processing and analytics needs....


  • Hyderabad, Telangana, India Evernorth Health Services Full time

    About Evernorth Health Services:Evernorth Health Services is committed to elevating health for all, recognizing that health is the foundation for human potential and progress. As a champion for affordable, predictable, and simple healthcare, we tackle problems others don't, won't, or can't.Our innovation hub in India enables us to collaborate with the right...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Description:We are seeking a highly skilled Senior Data Engineer to join our team in Remote, Telangana (IN). This is a full-time position with 40 hours per week.About the Role:The successful candidate will design, develop, and maintain scalable data pipelines in the Python ecosystem. They will also participate in regular team ceremonies and contribute to...


  • Hyderabad, Telangana, India Livemindz Full time

    About LivemindzWe are a dynamic company seeking an experienced Data Scientist and Engineer to join our team in developing and maintaining our big data ecosystem. The ideal candidate will have expertise in working with Talend Big Data platform, strong experience in performance tuning of ETL processes, and knowledge on API calling through Talend.About the...


  • Hyderabad, Telangana, India Clean Harbors Full time

    Clean Harbors is seeking a highly skilled Data Engineer to join our team. As an expert in the Azure ecosystem, you will be responsible for designing, implementing, and managing data solutions on Microsoft Azure.We are looking for a talented professional with 5+ years of experience in data engineering, leveraging technologies such as Azure Data Factory, Azure...


  • Hyderabad, Telangana, India SMARTWORK IT SERVICES Full time

    Job SummaryAt SMARTWORK IT SERVICES, we are seeking a skilled Hadoop Developer to join our team. The ideal candidate will have strong expertise in Hadoop, MapReduce, and either Java or Python, along with Data Structures and Algorithms knowledge.Key Responsibilities- Develop and evolve highly scalable, fault-tolerant distributed components using Hadoop...


  • Hyderabad, Telangana, India TravelOperations Full time

    We are seeking an experienced Data Architect to lead our efforts in designing and implementing data management solutions within the Microsoft D365 ecosystem. As a key member of our team, you will be responsible for developing and maintaining data pipelines, ensuring data accuracy, and collaborating with cross-functional teams to drive business growth.This...


  • Hyderabad, Telangana, India Virtusa Full time

    Virtusa seeks a seasoned Senior Big Data Developer to spearhead the development of large-scale data processing systems using Hadoop and Spark. As a key member of our team, you will design, implement, and deploy complex big data solutions that drive business growth and innovation.Job SummaryWe are looking for an experienced Senior Big Data Developer with a...


  • Hyderabad, Telangana, India TEKNIKOZ Full time

    We are seeking a highly skilled Big Data Engineering Professional to join our team at TeknikoZ.As a Senior Associate L2 in Data Engineering, you will be responsible for translating client requirements into technical design and implementing components for data engineering solutions.You will utilize your deep understanding of data integration and big data...


  • Hyderabad, Telangana, India Alp Consulting Ltd. Full time

    About Alp Consulting Ltd.We are a leading consulting firm specializing in data-driven solutions. Our team of experts helps organizations leverage the power of big data to drive business growth and transformation.Job SummaryWe are seeking an experienced Big Data Consultant to join our team. As a key member of our data engineering team, you will be responsible...


  • Hyderabad, Telangana, India Aricent Full time

    Job DescriptionWe are seeking a skilled Senior Big Data Engineer to design and build solutions for a Fortune 500 client program. The project involves creating a data standardized and curation-based Hadoop cluster.About the RoleThis is a high-visibility, fast-paced key initiative that will integrate data across internal and external sources, provide...


  • Hyderabad, Telangana, India ValueMomentum Full time

    About the OpportunityWe are seeking an experienced Data Ingestion Specialist to join our team at ValueMomentum. As a key member of our data-driven decision-making processes, you will play a crucial role in ensuring the quality and reliability of our data pipelines.With a strong background in Hadoop data ingestion and ETL testing, you will be responsible for...