Big Data Engineer

1 week ago


Pune, India SGS Technical Services Pvt. Ltd Full time

Position : Big Data Engineer

Experience : 3-5 years

Location : Pune

Notice Period : Immediate joiner preferred

Key Responsibilities :

- Design, develop, and maintain scalable data processing systems using Hadoop and PySpark.


- Implement data pipelines to process large datasets efficiently.


- Work with data warehousing solutions to ensure proper storage and retrieval of data.


- Perform ETL tasks and optimize performance for data ingestion and transformation.


- Collaborate with data scientists, analysts, and other stakeholders to meet business objectives.


- Ensure data security and integrity during processing and storage.


Mandatory Skills :

- Hadoop : Strong experience with Hadoop ecosystem (HDFS, MapReduce, HBase, Hive, Pig, etc.).


- PySpark : Hands-on experience in developing and optimizing large-scale data processing using PySpark.


- Experience with data ingestion, processing, and storage in distributed systems.


Preferred Skills :

- Knowledge of data warehousing concepts and tools.


- Familiarity with cloud platforms like AWS, GCP, or Azure for Big Data solutions.


- Proficiency in SQL and NoSQL databases.


- Understanding of CI/CD pipelines for Big Data applications.


Qualifications :

- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.


- Excellent problem-solving skills and ability to handle large datasets efficiently.


(ref:hirist.tech)

  • Pune, Maharashtra, India NTT DATA Full time

    Company OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...

  • Big Data Engineer

    3 weeks ago


    Pune, India Flipped.ai Full time

    Job Description : Big Data Engineer (PySpark)Years of experience : 6 to 13 yearsLocations : Chennai and Pune ( Candidates from chennai and pune only apply)Notice period : Immediate joiners/15 to 30 days onlyAbout the Role : We are seeking a highly skilled and experienced Big Data Engineer with a strong focus on PySpark to join our dynamic team. As a Big Data...

  • Big Data Engineer

    1 month ago


    Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full time

    Big Data EngineerWe are seeking a skilled Big Data Engineer to contribute to building backend data applications and services. This role requires expertise in various technologies to drive our data initiatives.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather...

  • Data Engineer

    24 hours ago


    Pune, Maharashtra, India LTIMindtree Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at LTIMindtree. As a Data Engineer, you will play a key role in designing and developing big data platforms using Scala and Spark.Responsibilities:Design and develop big data platforms using Scala and Spark.Develop expertise in Data Engineering, including hands-on experience in...

  • Big data engineer

    4 weeks ago


    Pune, India PRI Global Full time

    Position: Sr. Big Data Engineer (Support Role) HM: Kruna Bharti Location: Pune Team/Key Projects: Play4 Initiative for Data and Analytics Duration: 12 Months Initially Domain: Banking and payment preferred YOE: 5+ Years Shift: 12 – 9 PM IST (2 – 3 hours overlap with US Team) Daily Task: Migrating data from HDFS to Ozone ...

  • Big Data Engineer

    4 weeks ago


    pune, India PRI Global Full time

    Position: Sr. Big Data Engineer (Support Role)HM: Kruna BhartiLocation: PuneTeam/Key Projects: Play4 Initiative for Data and AnalyticsDuration: 12 Months InitiallyDomain: Banking and payment preferredYOE: 5+ YearsShift: 12 – 9 PM IST (2 – 3 hours overlap with US Team)Daily Task:- Migrating data from HDFS to Ozone- SRE Automation using PythonNote: It is a...

  • Big Data Engineer

    1 month ago


    pune, India PRI Global Full time

    Position: Sr. Big Data Engineer (Support Role)HM: Kruna BhartiLocation: PuneTeam/Key Projects: Play4 Initiative for Data and AnalyticsDuration: 12 Months InitiallyDomain: Banking and payment preferredYOE: 5+ YearsShift: 12 – 9 PM IST (2 – 3 hours overlap with US Team)Daily Task:Migrating data from HDFS to OzoneSRE Automation using PythonNote: It...


  • Pune, Maharashtra, India Virtusa Full time

    Job Title: Scalable Big Data EngineerAbout the RoleVirtusa is seeking an experienced Scala and Spark Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Scala and Spark.Key Responsibilities- Design and develop scalable big data...

  • Data Engineer Leader

    1 month ago


    Pune, Maharashtra, India DATAECONOMY Full time

    About the RoleDataEconomy is seeking a Senior Data Engineer to lead our team in designing and implementing big data solutions using PySpark.Key ResponsibilitiesLead the design and implementation of scalable and robust data pipelines using PySpark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Mentor and...

  • Big Data Engineer

    3 months ago


    Pune, India Mig Staffing Full time

    We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...

  • Big Data Engineer

    1 month ago


    Pune, India Mig Staffing Full time

    We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...

  • Big data engineer

    1 month ago


    Pune, India PRI Global Full time

    Position: Sr. Big Data Engineer (Support Role)HM: Kruna BhartiLocation: PuneTeam/Key Projects: Play4 Initiative for Data and AnalyticsDuration: 12 Months InitiallyDomain: Banking and payment preferredYOE: 5+ YearsShift: 12 – 9 PM IST (2 – 3 hours overlap with US Team)Daily Task:Migrating data from HDFS to OzoneSRE Automation using PythonNote: It...

  • Senior Data Engineer

    6 months ago


    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Big Data Engineer

    4 weeks ago


    pune, India UST Full time

    Dear Candidate , Please share following details over email. To Proceed further . Nitin.patil@ust.com Total Years of Experience – Relevant Experience - Big Data Relevant Experience - hadoop Relevant Experience - Airflow Relevant Experience - Scala in Spark Relevant Experience - Hive Current CTC – Expected CTC – Current Location – Expected Location...


  • Pune, Maharashtra, India LTIMindtree Full time

    We are seeking a highly skilled Big Data Engineering Specialist to join our team at LTIMindtree. As a key member of our big data engineering team, you will be responsible for designing and developing scalable big data platforms using modern technologies like Scala Spark and Hadoop ecosystem.This role requires a deep understanding of modern data processing...

  • Big Data Specialist

    5 months ago


    Pune, India Cybage Software Full time

    About CybageCybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...

  • Big Data Specialist

    2 months ago


    pune, India Cybage Software Full time

    About CybageCybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...

  • Big Data Specialist

    1 month ago


    Pune, India Cybage Software Full time

    About CybageCybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...

  • Big Data Specialist

    2 months ago


    Pune, India Cybage Software Full time

    About Cybage Cybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...

  • Big data specialist

    2 months ago


    Pune, India Cybage Software Full time

    About Cybage Cybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies...