Big Data Engineer
2 weeks ago
Job Description :
We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production :
- Meeting with managers to determine the company's Big Data needs.
- Developing Hadoop systems.
- Loading disparate data sets and conducting pre-processing services using Hive or Pig.
- Finalizing the scope of the system and delivering Big Data solutions.
- Managing the communications between the internal system and the survey vendor.
- Collaborating with the software research and development teams.
- Building cloud platforms for the development of company applications.
- Maintaining production systems.
- Training staff on data resource management.
Requirements :
- Bachelor's degree in computer engineering or computer science.
- Previous experience as a big data engineer.
- In-depth knowledge of Hadoop, Spark, and similar frameworks.
- Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.
- Knowledge of NoSQL and RDBMS databases including Redis and MongoDB.
- Familiarity with Mesos, AWS, and Docker tools.
- Excellent project management skills.
- Good communication skills.
- Ability to solve complex networking, data, and software issues.
-
Senior Big Data Developer
4 weeks ago
Pune, Maharashtra, India NTT DATA Full timeCompany OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...
-
Big Data Engineer
4 weeks ago
Pune, India Flipped.ai Full timeJob Description : Big Data Engineer (PySpark)Years of experience : 6 to 13 yearsLocations : Chennai and Pune ( Candidates from chennai and pune only apply)Notice period : Immediate joiners/15 to 30 days onlyAbout the Role : We are seeking a highly skilled and experienced Big Data Engineer with a strong focus on PySpark to join our dynamic team. As a Big Data...
-
Data Engineer
1 week ago
Pune, Maharashtra, India LTIMindtree Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team at LTIMindtree. As a Data Engineer, you will play a key role in designing and developing big data platforms using Scala and Spark.Responsibilities:Design and develop big data platforms using Scala and Spark.Develop expertise in Data Engineering, including hands-on experience in...
-
Big data engineer
1 month ago
Pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role) HM: Kruna Bharti Location: Pune Team/Key Projects: Play4 Initiative for Data and Analytics Duration: 12 Months Initially Domain: Banking and payment preferred YOE: 5+ Years Shift: 12 – 9 PM IST (2 – 3 hours overlap with US Team) Daily Task: Migrating data from HDFS to Ozone ...
-
Big Data Engineer
1 month ago
pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role)HM: Kruna BhartiLocation: PuneTeam/Key Projects: Play4 Initiative for Data and AnalyticsDuration: 12 Months InitiallyDomain: Banking and payment preferredYOE: 5+ YearsShift: 12 – 9 PM IST (2 – 3 hours overlap with US Team)Daily Task:Migrating data from HDFS to OzoneSRE Automation using PythonNote: It...
-
Scalable Big Data Engineer
3 weeks ago
Pune, Maharashtra, India Virtusa Full timeJob Title: Scalable Big Data EngineerAbout the RoleVirtusa is seeking an experienced Scala and Spark Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Scala and Spark.Key Responsibilities- Design and develop scalable big data...
-
Big Data Engineer
1 month ago
Pune, India Mig Staffing Full timeWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...
-
Big data engineer
1 month ago
Pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role)HM: Kruna BhartiLocation: PuneTeam/Key Projects: Play4 Initiative for Data and AnalyticsDuration: 12 Months InitiallyDomain: Banking and payment preferredYOE: 5+ YearsShift: 12 – 9 PM IST (2 – 3 hours overlap with US Team)Daily Task:Migrating data from HDFS to OzoneSRE Automation using PythonNote: It...
-
Senior Data Engineer
6 months ago
Pune, India Data Axle Full timeJob Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...
-
Big Data Engineer
1 month ago
pune, India UST Full timeDear Candidate , Please share following details over email. To Proceed further . Nitin.patil@ust.com Total Years of Experience – Relevant Experience - Big Data Relevant Experience - hadoop Relevant Experience - Airflow Relevant Experience - Scala in Spark Relevant Experience - Hive Current CTC – Expected CTC – Current Location – Expected Location...
-
Big Data Engineering Specialist
1 week ago
Pune, Maharashtra, India LTIMindtree Full timeWe are seeking a highly skilled Big Data Engineering Specialist to join our team at LTIMindtree. As a key member of our big data engineering team, you will be responsible for designing and developing scalable big data platforms using modern technologies like Scala Spark and Hadoop ecosystem.This role requires a deep understanding of modern data processing...
-
Big Data
6 months ago
Pune, India Virtusa Full time**Duties & Responsibilities**: - Requirement Analysis, Design, Develop and Deploy project/tasks while adhering to existing SDLC standards. - Provide project/task effort estimates. - Provide regular project progress & Issue report. - Partner with multiple teams to deliver projects. - Scope and deliver various Big Data solutions. - Ability to design solutions...
-
GCP Data Engineer
1 week ago
Pune, Maharashtra, India Tata Consultancy Services Full timeWe are looking for a highly skilled GCP Data Engineer - Big Data Expert to join our team at Tata Consultancy Services. As a GCP Data Engineer, you will play a critical role in designing and implementing scalable data processing systems on Google Cloud Platform.About the Role:We are seeking an experienced professional with a strong background in GCP-based big...
-
Big Data Engineer
3 months ago
Pune, India Mig Staffing Full timeJob Description : We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production :- Meeting with managers...
-
Senior Data Engineer
4 weeks ago
Pune, Maharashtra, India TapTalent Full timeTapTalent is a leading player in the job market, and we're looking for a seasoned Data Engineer to join our team. As a senior member of our engineering team, you will play a crucial role in designing and developing our big data platform.We're looking for someone with at least 4 years of experience in working with Scala Spark. If you have expertise in data...
-
Big data developer
7 days ago
Pune, India Recro Full timeTo be successful in this role, you should possess• Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.• Design and...
-
Big Data Engineer Specialist
2 weeks ago
Pune, Maharashtra, India Consulting Pandits Full timeAbout Consulting PanditsWe are a leading consulting firm specializing in data-driven solutions.Job OverviewWe are seeking an experienced Big Data Engineer to join our team. This role will involve designing, developing, and deploying end-to-end data storage and processing pipelines using big data technologies.Estimated Salary Range$120,000 - $180,000 per year...
-
Big Data Engineer
1 month ago
pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role) HM: Kruna Bharti Location: Pune Team/Key Projects: Play4 Initiative for Data and Analytics Duration: 12 Months Initially Domain: Banking and payment preferred YOE: 5+ Years Shift: 12 – 9 PM IST (2 – 3 hours overlap with US Team) Daily Task: Migrating data from HDFS to Ozone SRE Automation using...
-
Highly Scalable Big Data Engineer
1 week ago
Pune, Maharashtra, India Recro Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Recro.Job DescriptionIn this role, you will be responsible for designing and implementing scalable data pipelines using distributed processing tools like Akka and Spark.You will work closely with Product Management and Engineering leadership to devise and build the right...
-
Big Data Developer
7 days ago
Pune, India Recro Full timeTo be successful in this role, you should possess• Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.• Design and...