Big Data Engineer with Hadoop and Spark Expertise
1 week ago
We are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a key member of our engineering team, you will design, develop, and maintain large-scale data processing pipelines using big data technologies such as Hadoop, MapReduce, Hive, and Spark.
Responsibilities- Design and implement data processing pipelines using Python and Scala programming languages
- Work with Airflow and Jenkins for workflow automation and continuous integration
- Collaborate with data and business analysts to implement data solutions that meet business requirements
- Troubleshoot, debug, and optimize data pipelines for maximum performance and scalability
To be successful in this role, you should have:
- 5+ years of experience in big data technologies including Hadoop, MapReduce, Hive, and Spark
- Strong understanding of data processing pipelines and workflow automation
- Experience with Python and Scala programming languages
- Knowledge of API design principles and Java
This role is based in Hyderabad, India, and offers an estimated salary of ₹15,00,000 - ₹20,00,000 per annum depending on experience.
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India Mempage Full timeAbout the Role : We are seeking a highly skilled Big Data Engineer to contribute to the design, development, and maintenance of our data infrastructure. As a key member of our team, you will be responsible for building and optimizing data pipelines to support our business analytics and machine learning initiatives. Your expertise will be instrumental in...
-
Senior Big Data Developer
3 days ago
Hyderabad, Telangana, India Virtusa Full timeVirtusa seeks a seasoned Senior Big Data Developer to spearhead the development of large-scale data processing systems using Hadoop and Spark. As a key member of our team, you will design, implement, and deploy complex big data solutions that drive business growth and innovation.Job SummaryWe are looking for an experienced Senior Big Data Developer with a...
-
Hyderabad, Telangana, India Virtusa Full timeBig Data EngineerWe are seeking a highly skilled Big Data Engineer to join our Virtusa team. The ideal candidate will have expertise in designing and implementing data processing pipelines using Python and Scala programming languages, as well as big data technologies such as Hadoop, MapReduce, Hive, and Spark.Mandatory Skills:Design and implement data...
-
Big Data Engineer
2 months ago
Hyderabad, Telangana, India TECHSTAR SOFTWARE DEVELOPMENT INDIA PVT LTD Full timeResponsibilities of the Candidate :- Be responsible for the design and development of big data solutions. - Partner with domain experts, product managers, analysts, and data scientists to develop Big Data pipelines in Hadoop- Be responsible for moving all legacy workloads to a cloud platform- Work with data scientists to build Client pipelines using...
-
Big Data Systems Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...
-
Techstar Software
2 months ago
Hyderabad, Telangana, India Techstar Software Development India Pvt. Ltd. Full timeA Big Data Engineer Lead plays a critical role in managing and guiding the development of big data solutions within an organization. Here's a typical job description for this role.Job Title : Big Data Engineer LeadExp : 5+ YearsLocation : HyderabadNotice Period : Immediate to 30daysJob Summary :The Big Data Engineer Lead is responsible for overseeing the...
-
Data Scientist
3 days ago
Hyderabad, Telangana, India Virtusa Full timeAbout the Role">Virtusa is seeking an experienced Data Scientist to join our team as a Big Data Engineer. This role will involve designing and implementing data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.">Responsibilities">">Design and implement data processing pipelines using Python programming...
-
Big Data Engineer
1 month ago
Hyderabad, Telangana, India Vidpro Consultancy Services Full timeAbout the Role:Vidpro Consultancy Services is seeking a highly skilled Big Data Engineer to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing large-scale Big Data architectures using Java and Python.Key Responsibilities:Design and implement Big Data architectures using Hadoop and SparkDevelop...
-
Data Engineer for Big Data Platform
3 weeks ago
Hyderabad, Telangana, India DBS Bank Full timeData Engineer for Big Data PlatformWe are looking for a Data Engineer to join our team and work on our Big Data platform. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data architecture, ensuring data quality, and optimizing data processing pipelines.Key Responsibilities:Design and develop data pipelines using...
-
Hyderabad, Telangana, India Aricent Full timeJob DescriptionWe are seeking a skilled Senior Big Data Engineer to design and build solutions for a Fortune 500 client program. The project involves creating a data standardized and curation-based Hadoop cluster.About the RoleThis is a high-visibility, fast-paced key initiative that will integrate data across internal and external sources, provide...
-
Data Engineer with Expertise in Spark
3 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeJob DetailsLocation: Not SpecifiedExperience: 6-10 YearsJob OverviewWe are seeking a highly skilled Data Engineer with expertise in Spark to join our team at Tata Consultancy Services. The successful candidate will have a strong background in data processing and manipulation using Spark transformations and actions.Key Responsibilities Proficient in...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Devenir Software Private Limited Full timeJob DescriptionWe are seeking a skilled Big Data Engineer to join our team at Devenir Software Private Limited. The ideal candidate will have hands-on experience with Big Data Hadoop, Spark, and AWS Cloud technologies.Key Responsibilities:Design and develop scalable data pipelines using Big Data Hadoop and Spark.Implement data storage solutions using AWS S3,...
-
Senior Big Data Engineer
1 month ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior Big Data EngineerJob Summary:We are seeking a Senior Big Data Engineer to join our team at Virtusa. The ideal candidate will have a strong background in designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Design and develop complex data applications using Spark, Sqoop, and Hive.Work with...
-
Data Engineer
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timePyspark Data Engineer Job Description At Virtusa, we are seeking a skilled Data Engineer with expertise in Pyspark and big data technologies. The ideal candidate will have a strong understanding of data processing pipelines and experience with Python programming. Responsibilities include designing and implementing data processing pipelines using Pyspark,...
-
Senior Data Engineer
4 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Summary: We are seeking a highly skilled Python Big Data Engineer to join our team at Virtusa. The ideal candidate will have expertise in designing and implementing data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key Responsibilities:Design and implement data processing pipelines: Using Python...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Description:As a Data Processing Specialist at Virtusa, you will be responsible for designing and implementing data processing pipelines using Python and Scala programming languages and big data technologies such as Hadoop, MapReduce, Hive, and Spark. You will work closely with data and business analysts to implement data solutions that meet business...
-
Senior Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Vidpro Consultancy Services Full timeJob Title: Senior Big Data EngineerJob Summary: Vidpro Consultancy Services is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale big data architectures using Java, Python, and Hadoop technologies.Responsibilities:Design...
-
Big Data Engineer
1 month ago
Hyderabad, Telangana, India TechSophy Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Analyze large data sets to identify errors in the map.Design and implement complex...
-
Big Data Engineer
1 month ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data EngineerJob Summary: We are seeking a skilled Big Data Engineer to design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies.Develop and maintain data assets...
-
Linux and Big Data Infrastructure Manager
3 weeks ago
Hyderabad, Telangana, India Experian Full timeJob Description:We are seeking an experienced professional to join our team as a Linux and Big Data Infrastructure Manager. The ideal candidate will have a deep understanding of Linux, networking fundamentals, and security, as well as experience working with AWS cloud platform and infrastructure.Key Responsibilities:Manage large Big Data clusters in...