
Bigdata
4 weeks ago
Responsibilities Design develop and optimize data pipelines and workflows for big data systems Develop components application interfaces and solution enablers while ensuring principal architecture integrity is maintained Implement and maintain distributed systems using Hadoop Spark or similar technologies Analyze large datasets to extract meaningful insights and patterns Ensure data quality security and governance in all processes Collaborate with data scientists analysts and engineers to implement scalable solutions Monitor and troubleshoot data pipelines in production Participates and guides team in estimating work necessary to realize a story requirement through the software delivery lifecycle Ensures solutions are well designed with maintainability ease of integration and testing built-in from the outset Responsible for developing and delivering complex software requirements to accomplish business goals Ensures that software is developed to meet functional non-functional and compliance requirements Codes solutions Unit testing and ensure the solution can be integrated successfully into the overall application system with clear robust and well-tested interfaces Required Skills 5 years of hands-on experience in designing building and supporting Data Applications using Spark Sqoop and Hive Bachelor or masters degree in computer science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in Unix and Shell scripting Advanced knowledge of the Hadoop ecosystem and its components In-depth knowledge of Hive Shell scripting Python Spark Ability to write MapReduce jobs Experience using Job Schedulers like Autosys Hands on experience in HiveQL Good knowledge on Hadoop Architecture and HDFS Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in Unix and Shell scripting Experience with Jenkins for Continuous Integration Experience using Source Code and Version Control Systems like Bitbucket Git Good to have experience on Agile Development Required Skills Hadoop Hive HDFS Spark Python Unix Nice to Have Skills Experience in international and multicultural environment AML Domain knowledge
-
Chennai, Tamil Nadu, India Diverse Lynx Full timeHiring for BigData and Hadoop Ecosystems-Hyderabad Chennai Bangalore Working experience of Hadoop Hive SQL s Spark Bigdata Eco System Tools o Should be able to tweak queries and work on performance enhancement o The candidate will be responsible for delivering code setting up environment connectivity deploying the code in production after testing o...
-
Data Engineering and Architecture Specialist
1 week ago
Chennai, Tamil Nadu, India beBeeEngineering Full time ₹ 10,00,000 - ₹ 15,00,000Big Data Engineer Job OpportunityAt our organization, we are seeking a highly skilled Big Data Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Job Description:The ideal candidate will have 5+ years of experience with Java + Bigdata as minimum required skill. They...
-
Bigdata Engineer
3 weeks ago
Chennai, Tamil Nadu, India virtusa Full time6 years of hands-on experience in designing building and supporting Data Applications using Spark Sqoop and HiveStrong knowledge of working with large data sets and high-capacity big data processing platformStrong experience in Unix and Shell scriptingAdvanced knowledge of the Hadoop ecosystem and its componentsIn-depth knowledge of Hive Shell scripting ...
-
Bigdata Developer
2 weeks ago
Chennai, Tamil Nadu, India Citi Full time ₹ 1,04,000 - ₹ 1,30,878 per yearWe are seeking a highly motivated and enthusiastic Intermediate Software Developer to join our growing engineering team. This role is ideal for a recent individual with 3-5 years of experience who is eager to learn and grow within a fast-paced environment. You will work on exciting projects involving large-scale data processing, analytics, and software...
-
Bigdata Developer
1 week ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 28,00,000 per yearWe are seeking a highly skilled and motivated Python , AWS, Big Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java. You will be responsible for designing, developing, and optimizing scalable data pipelines and...
-
Big Data Developer
10 hours ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearGreetings from TCSTCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Position:Bigdata DeveloperJob Location:Bangalore, ChennaiExperience:5+Must...
-
3 Days Left GCP Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Mastek Full timeResponsibilities- Work closely with our data science team to help build complex algorithms that provide unique insights into our data- Use agile software development processes to make iterative improvements to our back-end systems- Model front-end and back-end data sources to help draw a more comprehensive picture of user flows throughout the system and to...
-
GCP Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Mastek Full timeResponsibilities Work closely with our data science team to help build complex algorithms that provide unique insights into our data Use agile software development processes to make iterative improvements to our back-end systems Model front-end and back-end data sources to help draw a more comprehensive picture of user flows throughout the system and to...
-
GCP Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Mastek Full timeResponsibilitiesWork closely with our data science team to help build complex algorithms that provide unique insights into our dataUse agile software development processes to make iterative improvements to our back-end systemsModel front-end and back-end data sources to help draw a more comprehensive picture of user flows throughout the system and to enable...
-
Java and Bigdata Lead
2 weeks ago
Chennai, Tamil Nadu, India Citi Full time ₹ 15,00,000 - ₹ 20,00,000 per yearThe Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.Responsibilities:Partner with multiple...