Big Data Developer
1 month ago
Minimum Required Skills & Experience :
1. Big Data Technologies (6+ years) :
- Extensive experience with Big Data frameworks like Hadoop and Spark.
- Deep understanding of Hadoop ecosystem (HDFS, YARN, MapReduce).
- Familiarity with big data schedulers (e.g., Oozie, Airflow).
2. Scala & Spark Expertise (4+ years each) :
- Strong proficiency in Scala programming language.
- In-depth knowledge of Spark APIs for data processing and manipulation.
- Experience in developing scalable and efficient Spark applications.
3. Data Pipeline & API Development :
- Proven experience in designing and building data pipelines using Scala.
- Ability to develop RESTful APIs to expose data to various applications.
Additional Skills :
- Experience with Apache Kafka for real-time data streaming (2+ years).
- Proficiency in SQL for data querying and manipulation (4+ years).
- Strong understanding of Unix/Linux operating systems and shell scripting (2+ years).
- Familiarity with Citi VDI (Virtual Development Infrastructure) is a plus.
Key Responsibilities :
- Design and develop scalable data pipelines using Scala and Spark.
- Implement robust and efficient Spark applications for data processing.
- Develop RESTful APIs to provide access to processed data for various applications.
- Optimize and maintain existing big data infrastructure and pipelines.
- Collaborate with data analysts and scientists to understand data needs and translate them into technical solutions.
- Troubleshoot and debug big data related issues.
- Stay up-to-date with the latest advancements in big data technologies and best practices
-
Big Data Developer
3 weeks ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeJob Title: Big Data DeveloperTata Consultancy Services is seeking a skilled Big Data Developer to join our team.Job Summary:We are looking for a highly motivated and experienced Big Data Developer to design and administer data projects using Big Data Services. The ideal candidate will have a strong background in Hadoop, Spark, Scala, and Hive, and will be...
-
Big Data Developer
2 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeJob Title: Big Data DeveloperJob Summary:RiskInsight Consulting Pvt Ltd is seeking a skilled Big Data Developer to join our team. As a Big Data Developer, you will design, develop, and deploy scalable Big Data applications using Apache Spark.Responsibilities:Data Ingestion: Implement data ingestion processes from various data sources to the Big Data...
-
Big Data Developer
2 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeJob Title: Big Data DeveloperAbout the Role:RiskInsight Consulting Pvt Ltd is seeking a skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and deploying scalable Big Data applications using Hadoop ecosystem technologies.Key Responsibilities:Design and develop scalable Big Data applications...
-
Big Data Developer
2 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeKey ResponsibilitiesRiskInsight Consulting Pvt Ltd is seeking a highly skilled Big Data Developer to join our team. The ideal candidate will have a strong background in designing, developing, and deploying scalable Big Data applications using Apache Spark.Design and Develop Big Data Applications: Collaborate with data scientists and business analysts to...
-
Big Data Developer
19 hours ago
Chennai, Tamil Nadu, India Virtusa Full timeJob DescriptionAs a Data Architecture Specialist at Virtusa, you will have the opportunity to design and build high-performance big data applications using Spark, Sqoop, and Hive.We are seeking a highly experienced and skilled professional with a strong background in big data processing and a bachelor's or master's degree in Computer Science or a related...
-
Big Data Developer
3 weeks ago
Chennai, Tamil Nadu, India Saransh Inc Full timeJob Description:Saransh Inc is seeking a highly skilled Big Data Developer to join our team. The ideal candidate will have a strong background in Java and experience with Big Data technologies such as Spark and Hive.Responsibilities:Design and implement scalable fault-tolerant ETL pipelines on Big Data platforms.Work with the onsite development team to...
-
Big Data Developer
2 days ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeJob Title: Big Data DeveloperDescription:TCS is hiring a Big Data Developer to work on our exciting projects. As a Big Data Developer, you will be responsible for transferring and transforming data with Azure Synapse Analytics pipelines.Responsibilities:Transfer and transform data with Azure Synapse Analytics pipelines.Build a data pipeline in Azure Synapse...
-
Big Data Developer
3 weeks ago
Chennai, Tamil Nadu, India Virtusa Full timeJob Title: Big Data DeveloperAre you a skilled data engineer with a passion for designing and building scalable data applications? Do you have experience with Spark, Sqoop, and Hive? We're looking for a talented Big Data Developer to join our team at Virtusa.Responsibilities:Design and develop data applications using Spark, Sqoop, and HiveCollaborate with...
-
Big Data Developer
3 weeks ago
Chennai, Tamil Nadu, India Virtusa Full timeJob Title: Big Data DeveloperWe are seeking a highly skilled Big Data Developer to join our team at Virtusa. As a Big Data Developer, you will be responsible for designing, building, and supporting Data Applications using Spark, Sqoop, and Hive.Responsibilities:Develop components, application interfaces, and solution enablers while ensuring principal...
-
Big Data Developer
4 days ago
Chennai, Tamil Nadu, India Snaphunt Full timeThe OpportunitySnaphunt is seeking a talented Big Data Developer to join their team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.The RequirementsDesign and implement robust data processing solutions using Kafka, PySpark,...
-
Senior Big Data Developer
1 week ago
Chennai, Tamil Nadu, India Risk Resources LLP Full timeJob Title: Senior Big Data DeveloperRole OverviewThe role of a Senior Big Data Developer is crucial in our organization as they are responsible for developing and maintaining efficient, scalable data processing applications using Pyspark.Key Responsibilities* Experience working in big data platforms for implementing projects with high SLA of data...
-
Big Data Developer
2 weeks ago
Chennai, Tamil Nadu, India Virtusa Full timeJob Description:As a Big Data Developer at Virtusa, you will be responsible for designing, building, and supporting data applications using Spark, Sqoop, and Hive. You will work with large data sets and high-capacity big data processing platforms, leveraging your expertise in Unix and Shell scripting, as well as your knowledge of the Hadoop ecosystem and its...
-
Big Data Developer
2 weeks ago
Chennai, Tamil Nadu, India Virtusa Full timeJob Description:As a Big Data Developer at Virtusa, you will be responsible for designing, building, and supporting data applications using Spark, Sqoop, and Hive. You will work with large data sets and high-capacity big data processing platforms, leveraging your expertise in Unix and Shell scripting, as well as your knowledge of the Hadoop ecosystem and its...
-
Big Data Engineer
5 days ago
Chennai, Tamil Nadu, India Hirexa Solutions Full timeAbout the Role:We're seeking a seasoned Big Data Developer with a strong background in Hadoop, Spark, Scala, and data pipeline development. As a key member of our team, you'll design and implement efficient data pipelines, develop APIs, and maintain large-scale data infrastructure to support data-driven decision-making.Responsibilities:1. Data Pipeline...
-
Big Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India ZF Group Full timeJob Title: Big Data DeveloperJob Summary:At ZF Group, we are searching for a skilled Big Data Developer to contribute to the success of our organization. Responsibilities:- Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5 years in Big Data technologies and platforms.- Strong understanding of distributed...
-
Big Data Developer
2 weeks ago
Chennai, Tamil Nadu, India ZF Group Full timeJob Title: Big Data DeveloperJob Summary:We are seeking a highly skilled Big Data Developer to contribute to the success of our organization. The ideal candidate will have a strong understanding of distributed computing principles and Big Data ecosystem components, as well as proficiency in programming languages and scripting for data processing and...
-
Big Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeJob Title: Big Data DeveloperRiskInsight Consulting Pvt Ltd is seeking a highly skilled Big Data Developer to join our team.ResponsibilitiesDesign, develop, and deploy scalable Big Data applications using Apache Spark.Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions.Write efficient...
-
Big Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Kiash Solutions LLP Full timeJob SummaryWe are seeking a highly skilled Big Data Developer to join our team at Kiash Solutions LLP. The ideal candidate will have a strong background in Big Data technologies, including Spark, Scala, and HDFS.Key Responsibilities Analyze and process raw data using Big Data technologies and Scala Perform data validation, cleaning, and transformation using...
-
Big Data Engineer
1 week ago
Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full timeWe are seeking a skilled Big Data Engineer to join our team at Krishpar Technologies Pvt. Ltd.The ideal candidate will have experience with Big Data technologies, including Hadoop, Hive, and Spark.Responsibilities will include:Designing and implementing Big Data solutions using Hadoop, Hive, and Spark.Developing and maintaining large-scale data processing...
-
Big Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeJob SummaryRiskInsight Consulting Pvt Ltd is seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and deploying scalable Big Data applications using Hadoop ecosystem technologies.Key ResponsibilitiesData Ingestion and ProcessingDesign and implement data ingestion processes...