Big Data Developer
4 months ago
The Offer
- Work within a company with a solid track record of success
- Excellent career development opportunities
- Great work environment
The Job
- Design, develop, and maintain scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.
- Work extensively with the Kafka and Hadoop ecosystem, including HDFS, Hive, and other related technologies.
- Write efficient SQL queries for data extraction, transformation, and analysis.
- Implement and manage Kafka streams for real-time data processing.
- Utilize scheduling tools to automate data workflows and processes.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Ensure data quality and integrity by implementing robust data validation processes.
- Optimize existing data processes for performance and scalability.
The Profile
- Our client is looking for an immediate joiner and experienced Big Data Developer with a strong background in Kafka, PySpark, Python/Scala, Spark, SQL, and the Hadoop ecosystem.
- The ideal candidate should have over 5 years of experience and be ready to join immediately. This role requires hands-on expertise in big data technologies and the ability to design and implement robust data processing solutions.
The Employer
Our client has deep expertise in Technology domains, such as Cognitive Process Automation, Data Engineering, Statistical Analysis and Optimization, Data Science, Natural Language Processing, and Computer Vision, and is well prepared to transform organizations into Intelligent Enterprise.
-
Big Data Developer
1 month ago
Mumbai, Maharashtra, India Tata Consultancy Services Full timeJob Role: Big Data DeveloperWe are looking for a qualified Big Data Developer to join our team at Tata Consultancy Services.Responsibilities:Ingest data from diverse sources and develop ETL jobs using Spark, PySpark, Hive, and HBase.Perform impact analysis and provide estimates.Oversee end-to-end deliverables.Create project plans and work on implementation...
-
Big Data Developer
4 months ago
Mumbai, India krtrimaIQ Cognitive Solutions Full timekrtrimaIQ having deep expertise in Technology domains Cognitive Process Automation, Data Engineering, Statistical Analysis and Optimization, Data Science, Natural Language Processing and Computer Vision, is well prepared to transform organizations to Intelligent Enterprise.The RoleDesign, develop, and maintain scalable data processing pipelines using Kafka,...
-
Big Data Developer
1 month ago
Navi Mumbai, Maharashtra, India Reliance Industries Limited Full timeWe are seeking a highly skilled Big Data Developer to join our team at Reliance Industries Limited. The ideal candidate will have a strong background in data engineering and analytics, with experience in designing and implementing data architectures that meet the needs of large-scale enterprise environments.Key Responsibilities:Collaborate with...
-
Big data developer
1 month ago
Mumbai, India Tata Consultancy Services Full timeRole- Big DataLocation- Mumbai, Pune, ChennaiExperience- 5 to 10 YrsMust Have - Spark, Pyspark, Hive, HbaseResponsibility of / Expectations from the Role1 Ingest data from disparate sources (Structured, unstructured and semi-structured) and develop ETL jobs using the above skills.2 Do impact analysis and come up with estimates3 Take responsibility for...
-
Big Data SME
7 days ago
Mumbai, India Tech Consulting Full time**Onsite Opportunity- In-Office**Mumbai, IndiaOur company is seeking to hire a top-level Big Data Developer to help support our Big Data technical consultants within our business. It is a very competitive employment market and we are doing everything we can to improve our technical consultants’ chances of succeeding on projects. We are looking for a senior...
-
Big Data SME
1 week ago
Mumbai, India Tech Consulting Full time**Onsite Opportunity- In-Office** Mumbai, India Our company is seeking to hire a top-level Big Data Developer to help support our Big Data technical consultants within our business. It is a very competitive employment market and we are doing everything we can to improve our technical consultants’ chances of succeeding on projects. We are looking for...
-
Big Data Developer
2 months ago
mumbai, India Tata Consultancy Services Full timeRole- Big Data Location- Mumbai, Pune, Chennai Experience- 5 to 10 Yrs Must Have - Spark, Pyspark, Hive, Hbase Responsibility of / Expectations from the Role 1 Ingest data from disparate sources (Structured, unstructured and semi-structured) and develop ETL jobs using the above skills. 2 Do impact analysis and come up with estimates 3 Take...
-
Senior Big Data Developer Lead
7 days ago
Mumbai, Maharashtra, India Tech Consulting Full timeLocated in the heart of Mumbai, India, Tech Consulting is seeking a highly skilled Senior Big Data Developer to lead our team of experts. With a competitive salary range of $120,000 - $180,000 per annum, this role offers an exciting opportunity for individuals looking to advance their careers in the IT industry.Job Description:We are searching for a talented...
-
Big Data Engineer
4 weeks ago
navi mumbai, India Pert Telecom Solutions Full timeJob Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...
-
Big Data SME
1 week ago
Mumbai Metropolitan Region, India Tech Consulting Full time**Onsite Opportunity- In-Office** Mumbai, India Our company is seeking to hire a top-level Big Data Developer to help support our Big Data technical consultants within our business. It is a very competitive employment market and we are doing everything we can to improve our technical consultants’ chances of succeeding on projects. We are looking for a...
-
Big Data SME
1 week ago
Mumbai Metropolitan Region, India Tech Consulting Full time**Onsite Opportunity- In-Office**Mumbai, IndiaOur company is seeking to hire a top-level Big Data Developer to help support our Big Data technical consultants within our business. It is a very competitive employment market and we are doing everything we can to improve our technical consultants’ chances of succeeding on projects. We are looking for a senior...
-
Big Data QA
1 month ago
Mumbai, India Brainhunter Recruiting Pvt Ltd Full timeJob Title: Big Data QA Engineer We are seeking a highly skilled and motivated Big Data QA Engineer with expertise in automation testing using Java or Python programming languages. The ideal candidate should possess a strong background in data validation, data verification, PySpark, pipeline monitoring, software...
-
Big Data Developer
2 months ago
Navi Mumbai, India Reliance Industries Limited Full timeWe are looking for a Big Data Engineer with a mindset to solve complex analytics problem and the ability to use the latest tools and technology and build solutions that are reliable and scalable to work with the size and scope of the company, then we would like to connect with you.Roles & Responsibilities: Participate in design and implementation of the...
-
Big Data Engineer
2 weeks ago
Mumbai, Maharashtra, India Novo Tree Minds Full timeJob Title: Data EngineerJob Description:We are seeking an experienced Data Engineer to join our team at Novo Tree Minds. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems.Key Responsibilities:Data Ingestion: Design and implement data ingestion pipelines to handle large volumes of data from various...
-
Big data engineer
5 days ago
Mumbai, India Tata Consultancy Services Full timeRole ; Big Data engineer Location : Pune, Chennai, Mumbai Exp : 3-6 Year Required Technical Skill Set** Hadoop, Python, Py Spark, HIVE Must-Have** · Hands-on experience of Hadoop, Python, Py Spark, Hive, Big Data Eco System Tools. · Should be able to develop, tweak queries and work on performance enhancement. · Solid understanding of...
-
Data Scientist with Big Data Expertise
7 days ago
Mumbai, Maharashtra, India Tata Consultancy Services Full timeAbout the RoleWe are seeking an experienced Data Scientist to join our team as a Big Data Engineer at Tata Consultancy Services. This role involves designing, developing, and maintaining large-scale data processing systems using big data technologies.
-
Big Data Developer
1 month ago
Mumbai, India Impetus Full timeF2F Hiring Drive on 16th Nov in Pune.Location: Impetus Technologies India Pvt. Ltd3rd Floor, We Work, Raheja WoodsKalyani Nagar, Pune – 411006 (Maharashtra)Exp: 3.5-6yrsExperience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL, Scala) as appropriateHands-on expertise with application design, software...
-
Big Data Engineer
4 weeks ago
Navi Mumbai, India Pert Telecom Solutions Full timeJob Description: We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...
-
Data Solutions Developer
2 weeks ago
Mumbai, Maharashtra, India Pegasus InfoCorp Full timeJob DescriptionWe are looking for a skilled Data Solutions Developer to join our team at Pegasus InfoCorp.About the RoleThis is a fantastic opportunity for an experienced Hadoop developer to contribute to the development of innovative big data products and solutions that meet the needs of our customers.As a key member of our team, you will be responsible for...
-
Big Data engineer
6 days ago
Mumbai, India Tata Consultancy Services Full timeRole ; Big Data engineerLocation : Pune, Chennai, MumbaiExp : 3-6 YearRequired Technical Skill Set** Hadoop, Python, PySpark, HIVEMust-Have** · Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools. · Should be able to develop, tweak queries and work on performance enhancement. · Solid understanding of object-oriented programming...