Hadoop Developer
13 hours ago
Requirements:
- 1+years of overall experience in developing, testing & implementing Big data projects using Hadoop, Spark, Hive.
- Hands-on experience playing lead role in Big data projects, responsible for implementing one or more tracks within projects, identifying and assigning tasks within the team and providing technical guidance to team members.
- Experience in setting up Hadoop services, implementing ETL/ELT pipelines, working with Terabytes of data ingestion & processing from varied systems
- Experience working in onshore/offshore model, leading technical discussions with customers, mentoring and guiding teams on technology, preparing HDD & LDD documents.
Skills:
- Spark, Scala/Pyspark, Hadoop ecosystem including Hive, Sqoop, Impala, Oozie, Hue, Java, Python, SQL, Flume, bash (shell scripting)
- Apache Kafka, Storm, Distributed systems, good understanding of networking, security (platform & data) concepts, Kerberos, Kubernetes
- Understanding of Data Governance concepts and experience implementing metadata capture, lineage capture, business glossary
- Experience implementing CICD pipelines and working experience with tools like SCM tools such as GIT, Bit bucket, etc
- Ability to assign and manage tasks for team members, provide technical guidance, work with architects on HDD, LDD, POCs.
- Hands on experience in writing data ingestion pipelines, data processing pipelines using spark and sql, experience in implementing SCD type 1 & 2, auditing, exception handling mechanism
- Data Warehousing projects implementation with either Java, or Scala based Hadoop programming background.
- Proficient with various development methodologies like waterfall, agile/scrum.
- Exceptional communication, organization, and time management skills
- Collaborative approach to decision-making & Strong analytical skills
- Good To Have - Certifications in any of GCP, AWS or Azure, Cloudera 12. Work on multiple Projects simultaneously, prioritizing appropriately
-
Hadoop Admin Manager
2 weeks ago
Mumbai, Maharashtra, India Smart Analytica Full time ₹ 6,00,000 - ₹ 18,00,000 per yearRole: Hadoop Admin Manager - CDPYears of Experience: 10-15 YrsLocation: Mumbai (Kurla)Shifts: 24*7 (Rotational Shift)Mode: OnsiteExperience: 10+ yrs of experience in IT, with At least 7+ years of experience with cloud and system administration. At least 5 years of experience with and strong understanding of 'big data' technologies in Hadoop ecosystem –...
-
Big Data Developer
5 days ago
Mumbai, Maharashtra, India Progriz Coe Full time ₹ 12,00,000 - ₹ 36,00,000 per yearOur company is seeking to hire a top-level Big Data Developer to help support our Big Data technical consultants within our business. It is a very competitive employment market and we are doing everything we can to improve our technical consultant's chances of succeeding on projects. We are looking for a senior developer to help us support our Big Data...
-
Sr. Python Developer
7 days ago
Navi Mumbai, Maharashtra, India Pert Telecom Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description: Software Data EngineerAs a Software Engineer specializing in Telecom Products, you will be a vital member of our R&D team, contributing to the development of cutting-edge telecommunications solutions. Your role will involve leveraging your extensive experience to design and implement robust software solutions for scalable telecom products...
-
Java Scala Developer
4 days ago
Mumbai, Maharashtra, India Xoriant Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole & responsibilitiesKey Responsibilities:Design, develop, and maintain scalable backend systems using Java and Scala.Build and optimize distributed computing platforms for financial risk and surveillance models.Collaborate with cross-functional teams including business analysts, traders, and other developers.Write clean, efficient, and well-documented...
-
Data Engineer
4 days ago
Mumbai, Maharashtra, India Growel Softech Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year:We are looking for a skilled Data Engineer/Developer with expertise in Snowflake and Spark as primary skills. The ideal candidate should also have a strong understanding of SQL and Hadoop.Primary Skills: Snowflake Spark Secondary Skills:SQL Hadoop Other Requirement:Strong communication skillsAdditional DetailsGlobal Grade : CRemote work possibility :...
-
Wordpress Developer
2 weeks ago
Mumbai, Maharashtra, India RWaltz Software Full time ₹ 2,00,000 - ₹ 6,00,000 per yearCompany DescriptionRWaltz Software excels in delivering end-to-end software development services tailored to the unique needs of its clients. With expertise in AI/ML, Big Data & Hadoop, Data Science, and ERP solutions, RWaltz is committed to innovation and precision in achieving digital excellence. The company's dedicated team focuses on quality,...
-
IN | BUKRFT_TC25_Impariment_Spark\/Scala_C1
4 days ago
Mumbai, Maharashtra, India Growel Softech Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year- Experience in following technologiesHadoop Spark Hive Pig SQL query experience in data application development at scale in the Hadoop ecosystem. Bigdata Spark kafka Java/python/scala Hadoop hive design and architecture problem solving skills Roles and responsibilities Drive the technical design of large scale data platforms utilizing modern and open source...
-
Big Data developer_Ashish_Quest Global
2 days ago
Mumbai, Maharashtra, India Coders Brain Technology Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJD for Big-dataMust have 3 to 7 years of experience in development and relevant 2 years of experiencePrimary Skills: Java/Scala, Spark, Hadoop, HDFS, Spark StreamingSecondary Skills: Cassandra/Nosql Database, Kafka, Airflow
-
Data Platform Engineer
7 days ago
Mumbai, Maharashtra, India Xoriant Full time ₹ 8,00,000 - ₹ 24,00,000 per yearRole & responsibilitiesAs a Big Data Platform Engineer you will be responsible for the technical delivery of our Data Platform's core functionality and strategic solutions. This includes the development of reusable tooling/API's, applications, data stores, and software stack to accelerate our relational data warehousing, big data analytics and data...
-
Data Engineer
2 days ago
Mumbai, Maharashtra, India Green clover Full time ₹ 5,00,000 - ₹ 15,00,000 per yearPrimary areas of responsibility: This role requires the ability to examine complex data and turn it into information and insights to inform business decisions. This role requires collaborating with database developers to implement effective automation processes by developing Access queries in the SQL platform so data can be mined for quality control and...