Big Data Engineer with Hadoop and Spark Expertise

1 week ago


Hyderabad, Telangana, India Virtusa Full time
About the Role

We are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a key member of our engineering team, you will design, develop, and maintain large-scale data processing pipelines using big data technologies such as Hadoop, MapReduce, Hive, and Spark.

Responsibilities
  • Design and implement data processing pipelines using Python and Scala programming languages
  • Work with Airflow and Jenkins for workflow automation and continuous integration
  • Collaborate with data and business analysts to implement data solutions that meet business requirements
  • Troubleshoot, debug, and optimize data pipelines for maximum performance and scalability
Requirements

To be successful in this role, you should have:

  • 5+ years of experience in big data technologies including Hadoop, MapReduce, Hive, and Spark
  • Strong understanding of data processing pipelines and workflow automation
  • Experience with Python and Scala programming languages
  • Knowledge of API design principles and Java
Location and Salary

This role is based in Hyderabad, India, and offers an estimated salary of ₹15,00,000 - ₹20,00,000 per annum depending on experience.


  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Mempage Full time

    About the Role : We are seeking a highly skilled Big Data Engineer to contribute to the design, development, and maintenance of our data infrastructure. As a key member of our team, you will be responsible for building and optimizing data pipelines to support our business analytics and machine learning initiatives. Your expertise will be instrumental in...


  • Hyderabad, Telangana, India Virtusa Full time

    Virtusa seeks a seasoned Senior Big Data Developer to spearhead the development of large-scale data processing systems using Hadoop and Spark. As a key member of our team, you will design, implement, and deploy complex big data solutions that drive business growth and innovation.Job SummaryWe are looking for an experienced Senior Big Data Developer with a...


  • Hyderabad, Telangana, India Virtusa Full time

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our Virtusa team. The ideal candidate will have expertise in designing and implementing data processing pipelines using Python and Scala programming languages, as well as big data technologies such as Hadoop, MapReduce, Hive, and Spark.Mandatory Skills:Design and implement data...

  • Big Data Engineer

    2 months ago


    Hyderabad, Telangana, India TECHSTAR SOFTWARE DEVELOPMENT INDIA PVT LTD Full time

    Responsibilities of the Candidate :- Be responsible for the design and development of big data solutions. - Partner with domain experts, product managers, analysts, and data scientists to develop Big Data pipelines in Hadoop- Be responsible for moving all legacy workloads to a cloud platform- Work with data scientists to build Client pipelines using...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...

  • Techstar Software

    2 months ago


    Hyderabad, Telangana, India Techstar Software Development India Pvt. Ltd. Full time

    A Big Data Engineer Lead plays a critical role in managing and guiding the development of big data solutions within an organization. Here's a typical job description for this role.Job Title : Big Data Engineer LeadExp : 5+ YearsLocation : HyderabadNotice Period : Immediate to 30daysJob Summary :The Big Data Engineer Lead is responsible for overseeing the...

  • Data Scientist

    3 days ago


    Hyderabad, Telangana, India Virtusa Full time

    About the Role">Virtusa is seeking an experienced Data Scientist to join our team as a Big Data Engineer. This role will involve designing and implementing data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.">Responsibilities">">Design and implement data processing pipelines using Python programming...

  • Big Data Engineer

    1 month ago


    Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    About the Role:Vidpro Consultancy Services is seeking a highly skilled Big Data Engineer to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing large-scale Big Data architectures using Java and Python.Key Responsibilities:Design and implement Big Data architectures using Hadoop and SparkDevelop...


  • Hyderabad, Telangana, India DBS Bank Full time

    Data Engineer for Big Data PlatformWe are looking for a Data Engineer to join our team and work on our Big Data platform. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data architecture, ensuring data quality, and optimizing data processing pipelines.Key Responsibilities:Design and develop data pipelines using...


  • Hyderabad, Telangana, India Aricent Full time

    Job DescriptionWe are seeking a skilled Senior Big Data Engineer to design and build solutions for a Fortune 500 client program. The project involves creating a data standardized and curation-based Hadoop cluster.About the RoleThis is a high-visibility, fast-paced key initiative that will integrate data across internal and external sources, provide...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job DetailsLocation: Not SpecifiedExperience: 6-10 YearsJob OverviewWe are seeking a highly skilled Data Engineer with expertise in Spark to join our team at Tata Consultancy Services. The successful candidate will have a strong background in data processing and manipulation using Spark transformations and actions.Key Responsibilities  Proficient in...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Devenir Software Private Limited Full time

    Job DescriptionWe are seeking a skilled Big Data Engineer to join our team at Devenir Software Private Limited. The ideal candidate will have hands-on experience with Big Data Hadoop, Spark, and AWS Cloud technologies.Key Responsibilities:Design and develop scalable data pipelines using Big Data Hadoop and Spark.Implement data storage solutions using AWS S3,...


  • Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior Big Data EngineerJob Summary:We are seeking a Senior Big Data Engineer to join our team at Virtusa. The ideal candidate will have a strong background in designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Design and develop complex data applications using Spark, Sqoop, and Hive.Work with...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Pyspark Data Engineer Job Description At Virtusa, we are seeking a skilled Data Engineer with expertise in Pyspark and big data technologies. The ideal candidate will have a strong understanding of data processing pipelines and experience with Python programming. Responsibilities include designing and implementing data processing pipelines using Pyspark,...

  • Senior Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Summary: We are seeking a highly skilled Python Big Data Engineer to join our team at Virtusa. The ideal candidate will have expertise in designing and implementing data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key Responsibilities:Design and implement data processing pipelines: Using Python...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Description:As a Data Processing Specialist at Virtusa, you will be responsible for designing and implementing data processing pipelines using Python and Scala programming languages and big data technologies such as Hadoop, MapReduce, Hive, and Spark. You will work closely with data and business analysts to implement data solutions that meet business...


  • Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job Title: Senior Big Data EngineerJob Summary: Vidpro Consultancy Services is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale big data architectures using Java, Python, and Hadoop technologies.Responsibilities:Design...

  • Big Data Engineer

    1 month ago


    Hyderabad, Telangana, India TechSophy Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Analyze large data sets to identify errors in the map.Design and implement complex...

  • Big Data Engineer

    1 month ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data EngineerJob Summary: We are seeking a skilled Big Data Engineer to design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies.Develop and maintain data assets...


  • Hyderabad, Telangana, India Experian Full time

    Job Description:We are seeking an experienced professional to join our team as a Linux and Big Data Infrastructure Manager. The ideal candidate will have a deep understanding of Linux, networking fundamentals, and security, as well as experience working with AWS cloud platform and infrastructure.Key Responsibilities:Manage large Big Data clusters in...