Big Data Engineer
1 week ago
Position : Big Data Engineer
Experience : 3-5 years
Location : Pune
Notice Period : Immediate joiner preferred
Key Responsibilities :
- Design, develop, and maintain scalable data processing systems using Hadoop and PySpark.
- Implement data pipelines to process large datasets efficiently.
- Work with data warehousing solutions to ensure proper storage and retrieval of data.
- Perform ETL tasks and optimize performance for data ingestion and transformation.
- Collaborate with data scientists, analysts, and other stakeholders to meet business objectives.
- Ensure data security and integrity during processing and storage.
- Hadoop : Strong experience with Hadoop ecosystem (HDFS, MapReduce, HBase, Hive, Pig, etc.).
- PySpark : Hands-on experience in developing and optimizing large-scale data processing using PySpark.
- Experience with data ingestion, processing, and storage in distributed systems.
Preferred Skills :
- Knowledge of data warehousing concepts and tools.
- Familiarity with cloud platforms like AWS, GCP, or Azure for Big Data solutions.
- Proficiency in SQL and NoSQL databases.
- Understanding of CI/CD pipelines for Big Data applications.
Qualifications :
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Excellent problem-solving skills and ability to handle large datasets efficiently.
(ref:hirist.tech)
-
Senior Big Data Developer
3 weeks ago
Pune, Maharashtra, India NTT DATA Full timeCompany OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...
-
Big Data Engineer
3 weeks ago
Pune, India Flipped.ai Full timeJob Description : Big Data Engineer (PySpark)Years of experience : 6 to 13 yearsLocations : Chennai and Pune ( Candidates from chennai and pune only apply)Notice period : Immediate joiners/15 to 30 days onlyAbout the Role : We are seeking a highly skilled and experienced Big Data Engineer with a strong focus on PySpark to join our dynamic team. As a Big Data...
-
Big Data Engineer
1 month ago
Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full timeBig Data EngineerWe are seeking a skilled Big Data Engineer to contribute to building backend data applications and services. This role requires expertise in various technologies to drive our data initiatives.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather...
-
Data Engineer
24 hours ago
Pune, Maharashtra, India LTIMindtree Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team at LTIMindtree. As a Data Engineer, you will play a key role in designing and developing big data platforms using Scala and Spark.Responsibilities:Design and develop big data platforms using Scala and Spark.Develop expertise in Data Engineering, including hands-on experience in...
-
Big data engineer
4 weeks ago
Pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role) HM: Kruna Bharti Location: Pune Team/Key Projects: Play4 Initiative for Data and Analytics Duration: 12 Months Initially Domain: Banking and payment preferred YOE: 5+ Years Shift: 12 – 9 PM IST (2 – 3 hours overlap with US Team) Daily Task: Migrating data from HDFS to Ozone ...
-
Big Data Engineer
4 weeks ago
pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role)HM: Kruna BhartiLocation: PuneTeam/Key Projects: Play4 Initiative for Data and AnalyticsDuration: 12 Months InitiallyDomain: Banking and payment preferredYOE: 5+ YearsShift: 12 – 9 PM IST (2 – 3 hours overlap with US Team)Daily Task:- Migrating data from HDFS to Ozone- SRE Automation using PythonNote: It is a...
-
Big Data Engineer
1 month ago
pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role)HM: Kruna BhartiLocation: PuneTeam/Key Projects: Play4 Initiative for Data and AnalyticsDuration: 12 Months InitiallyDomain: Banking and payment preferredYOE: 5+ YearsShift: 12 – 9 PM IST (2 – 3 hours overlap with US Team)Daily Task:Migrating data from HDFS to OzoneSRE Automation using PythonNote: It...
-
Scalable Big Data Engineer
2 weeks ago
Pune, Maharashtra, India Virtusa Full timeJob Title: Scalable Big Data EngineerAbout the RoleVirtusa is seeking an experienced Scala and Spark Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Scala and Spark.Key Responsibilities- Design and develop scalable big data...
-
Data Engineer Leader
1 month ago
Pune, Maharashtra, India DATAECONOMY Full timeAbout the RoleDataEconomy is seeking a Senior Data Engineer to lead our team in designing and implementing big data solutions using PySpark.Key ResponsibilitiesLead the design and implementation of scalable and robust data pipelines using PySpark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Mentor and...
-
Big Data Engineer
3 months ago
Pune, India Mig Staffing Full timeWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...
-
Big Data Engineer
1 month ago
Pune, India Mig Staffing Full timeWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...
-
Big data engineer
1 month ago
Pune, India PRI Global Full timePosition: Sr. Big Data Engineer (Support Role)HM: Kruna BhartiLocation: PuneTeam/Key Projects: Play4 Initiative for Data and AnalyticsDuration: 12 Months InitiallyDomain: Banking and payment preferredYOE: 5+ YearsShift: 12 – 9 PM IST (2 – 3 hours overlap with US Team)Daily Task:Migrating data from HDFS to OzoneSRE Automation using PythonNote: It...
-
Senior Data Engineer
6 months ago
Pune, India Data Axle Full timeJob Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...
-
Big Data Engineer
4 weeks ago
pune, India UST Full timeDear Candidate , Please share following details over email. To Proceed further . Nitin.patil@ust.com Total Years of Experience – Relevant Experience - Big Data Relevant Experience - hadoop Relevant Experience - Airflow Relevant Experience - Scala in Spark Relevant Experience - Hive Current CTC – Expected CTC – Current Location – Expected Location...
-
Big Data Engineering Specialist
2 days ago
Pune, Maharashtra, India LTIMindtree Full timeWe are seeking a highly skilled Big Data Engineering Specialist to join our team at LTIMindtree. As a key member of our big data engineering team, you will be responsible for designing and developing scalable big data platforms using modern technologies like Scala Spark and Hadoop ecosystem.This role requires a deep understanding of modern data processing...
-
Big Data Specialist
5 months ago
Pune, India Cybage Software Full timeAbout CybageCybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...
-
Big Data Specialist
2 months ago
pune, India Cybage Software Full timeAbout CybageCybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...
-
Big Data Specialist
1 month ago
Pune, India Cybage Software Full timeAbout CybageCybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...
-
Big Data Specialist
2 months ago
Pune, India Cybage Software Full timeAbout Cybage Cybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...
-
Big data specialist
2 months ago
Pune, India Cybage Software Full timeAbout Cybage Cybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies...