Big Data Engineer
2 months ago
Position : Big Data Engineer
Experience : 3-5 years
Location : Pune
Notice Period : Immediate joiner preferred
Key Responsibilities :
- Design, develop, and maintain scalable data processing systems using Hadoop and PySpark.
- Implement data pipelines to process large datasets efficiently.
- Work with data warehousing solutions to ensure proper storage and retrieval of data.
- Perform ETL tasks and optimize performance for data ingestion and transformation.
- Collaborate with data scientists, analysts, and other stakeholders to meet business objectives.
- Ensure data security and integrity during processing and storage.
- Hadoop : Strong experience with Hadoop ecosystem (HDFS, MapReduce, HBase, Hive, Pig, etc.).
- PySpark : Hands-on experience in developing and optimizing large-scale data processing using PySpark.
- Experience with data ingestion, processing, and storage in distributed systems.
Preferred Skills :
- Knowledge of data warehousing concepts and tools.
- Familiarity with cloud platforms like AWS, GCP, or Azure for Big Data solutions.
- Proficiency in SQL and NoSQL databases.
- Understanding of CI/CD pipelines for Big Data applications.
Qualifications :
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Excellent problem-solving skills and ability to handle large datasets efficiently.
(ref:hirist.tech)
-
Senior Big Data Developer
4 weeks ago
Pune, Maharashtra, India NTT DATA Full timeCompany OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...
-
Big Data Engineer
4 weeks ago
Pune, India Flipped.ai Full timeJob Description : Big Data Engineer (PySpark)Years of experience : 6 to 13 yearsLocations : Chennai and Pune ( Candidates from chennai and pune only apply)Notice period : Immediate joiners/15 to 30 days onlyAbout the Role : We are seeking a highly skilled and experienced Big Data Engineer with a strong focus on PySpark to join our dynamic team. As a Big Data...
-
Data Engineer
7 days ago
Pune, Maharashtra, India LTIMindtree Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team at LTIMindtree. As a Data Engineer, you will play a key role in designing and developing big data platforms using Scala and Spark.Responsibilities:Design and develop big data platforms using Scala and Spark.Develop expertise in Data Engineering, including hands-on experience in...
-
Big data engineer
1 month ago
Pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role) HM: Kruna Bharti Location: Pune Team/Key Projects: Play4 Initiative for Data and Analytics Duration: 12 Months Initially Domain: Banking and payment preferred YOE: 5+ Years Shift: 12 – 9 PM IST (2 – 3 hours overlap with US Team) Daily Task: Migrating data from HDFS to Ozone ...
-
Big Data Engineer
1 month ago
pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role)HM: Kruna BhartiLocation: PuneTeam/Key Projects: Play4 Initiative for Data and AnalyticsDuration: 12 Months InitiallyDomain: Banking and payment preferredYOE: 5+ YearsShift: 12 – 9 PM IST (2 – 3 hours overlap with US Team)Daily Task:Migrating data from HDFS to OzoneSRE Automation using PythonNote: It...
-
Scalable Big Data Engineer
3 weeks ago
Pune, Maharashtra, India Virtusa Full timeJob Title: Scalable Big Data EngineerAbout the RoleVirtusa is seeking an experienced Scala and Spark Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Scala and Spark.Key Responsibilities- Design and develop scalable big data...
-
Big Data Engineer
1 month ago
Pune, India Mig Staffing Full timeWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...
-
Big data engineer
1 month ago
Pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role)HM: Kruna BhartiLocation: PuneTeam/Key Projects: Play4 Initiative for Data and AnalyticsDuration: 12 Months InitiallyDomain: Banking and payment preferredYOE: 5+ YearsShift: 12 – 9 PM IST (2 – 3 hours overlap with US Team)Daily Task:Migrating data from HDFS to OzoneSRE Automation using PythonNote: It...
-
Big Data Engineer
1 month ago
pune, India UST Full timeDear Candidate , Please share following details over email. To Proceed further . Nitin.patil@ust.com Total Years of Experience – Relevant Experience - Big Data Relevant Experience - hadoop Relevant Experience - Airflow Relevant Experience - Scala in Spark Relevant Experience - Hive Current CTC – Expected CTC – Current Location – Expected Location...
-
Big Data Engineering Specialist
1 week ago
Pune, Maharashtra, India LTIMindtree Full timeWe are seeking a highly skilled Big Data Engineering Specialist to join our team at LTIMindtree. As a key member of our big data engineering team, you will be responsible for designing and developing scalable big data platforms using modern technologies like Scala Spark and Hadoop ecosystem.This role requires a deep understanding of modern data processing...
-
Senior Data Engineer
6 months ago
Pune, India Data Axle Full timeJob Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...
-
Big Data
6 months ago
Pune, India Virtusa Full time**Duties & Responsibilities**: - Requirement Analysis, Design, Develop and Deploy project/tasks while adhering to existing SDLC standards. - Provide project/task effort estimates. - Provide regular project progress & Issue report. - Partner with multiple teams to deliver projects. - Scope and deliver various Big Data solutions. - Ability to design solutions...
-
GCP Data Engineer
1 week ago
Pune, Maharashtra, India Tata Consultancy Services Full timeWe are looking for a highly skilled GCP Data Engineer - Big Data Expert to join our team at Tata Consultancy Services. As a GCP Data Engineer, you will play a critical role in designing and implementing scalable data processing systems on Google Cloud Platform.About the Role:We are seeking an experienced professional with a strong background in GCP-based big...
-
Big Data Engineer
3 months ago
Pune, India Mig Staffing Full timeJob Description : We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production :- Meeting with managers...
-
Big Data Engineer
2 weeks ago
Pune, India Mig Staffing Full timeJob Description : We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production : - Meeting with...
-
Senior Data Engineer
4 weeks ago
Pune, Maharashtra, India TapTalent Full timeTapTalent is a leading player in the job market, and we're looking for a seasoned Data Engineer to join our team. As a senior member of our engineering team, you will play a crucial role in designing and developing our big data platform.We're looking for someone with at least 4 years of experience in working with Scala Spark. If you have expertise in data...
-
Big data developer
7 days ago
Pune, India Recro Full timeTo be successful in this role, you should possess• Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.• Design and...
-
Big Data Engineer Specialist
2 weeks ago
Pune, Maharashtra, India Consulting Pandits Full timeAbout Consulting PanditsWe are a leading consulting firm specializing in data-driven solutions.Job OverviewWe are seeking an experienced Big Data Engineer to join our team. This role will involve designing, developing, and deploying end-to-end data storage and processing pipelines using big data technologies.Estimated Salary Range$120,000 - $180,000 per year...
-
Big Data Engineer
1 month ago
pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role) HM: Kruna Bharti Location: Pune Team/Key Projects: Play4 Initiative for Data and Analytics Duration: 12 Months Initially Domain: Banking and payment preferred YOE: 5+ Years Shift: 12 – 9 PM IST (2 – 3 hours overlap with US Team) Daily Task: Migrating data from HDFS to Ozone SRE Automation using...
-
Highly Scalable Big Data Engineer
1 week ago
Pune, Maharashtra, India Recro Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Recro.Job DescriptionIn this role, you will be responsible for designing and implementing scalable data pipelines using distributed processing tools like Akka and Spark.You will work closely with Product Management and Engineering leadership to devise and build the right...