Big Data Engineer

2 months ago


Pune, Maharashtra, India Mig Staffing Full time

We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.

To ensure success as a big data engineer, you should have in-depth knowledge of Hadoop technologies, excellent project management skills, and high-level problem-solving skills. A top-notch Big Data Engineer understands the needs of the company and institutes scalable data solutions for its current and future needs.

Responsibilities :

- Meeting with managers to determine the company's Big Data needs.

- Developing Hadoop systems.

- Loading disparate data sets and conducting pre-processing services using Hive or Pig.

- Finalizing the scope of the system and delivering Big Data solutions.

- Managing the communications between the internal system and the survey vendor.

- Collaborating with the software research and development teams.

- Building cloud platforms for the development of company applications.

- Maintaining production systems.

- Training staff on data resource management.

Requirements :

- Bachelor's degree in computer engineering or computer science.

- 5+Years experience as a Big data engineer.

- In-depth knowledge of Hadoop, Spark, and similar frameworks.

- Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.

- Knowledge of NoSQL and RDBMS databases including Redis and MongoDB.

- Familiarity with AWS, and Docker tools.

- Excellent project management skills.

- Good communication skills.

- Ability to solve complex networking, data, and software issues.

(ref:hirist.tech)
  • Data Engineer

    1 month ago


    Pune, Maharashtra, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...

  • Data Engineer

    3 weeks ago


    Pune, Maharashtra, India Virtusa Full time

    About the RoleAt Virtusa, we are seeking a highly skilled Data Engineer (Big Data) to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Apache Spark, Hadoop, and Hive.Responsibilities• Design, develop, and...


  • Pune, Maharashtra, India NTT DATA Full time

    Company OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...


  • Pune, Maharashtra, India Virtusa Full time

    About the RoleAt Virtusa, we are looking for a skilled Senior Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark, Hadoop, Hive, and Impala.Key Responsibilities• Develop and implement data pipelines using...

  • Big Data Engineer

    4 weeks ago


    Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full time

    Job SummaryF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...

  • Data Engineer

    3 weeks ago


    Pune, Maharashtra, India NR Consulting - India Full time

    Job Title: Data Engineer - Java and Big DataJob Description:Data Engineer - Java and Big DataPython – advanced concepts (add on if candidate have Java background)Problem SolvingHadoop/Spark/HiveKafkaSpring Boot PL/SQL – derive a pseudocode, write a queryAbout the Role:This role requires a strong background in Java and Big Data technologies. The ideal...

  • Big Data Engineer

    1 month ago


    Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full time

    About the RoleF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...


  • Pune, Maharashtra, India Huquo Full time

    Job Overview :Huquo is seeking a highly skilled Data Architect and Engineer to lead our data engineering team. As a key member of our team, you will design and implement scalable, secure, and high-performance data architectures.Key Responsibilities :Design and develop data pipelines using Hadoop, Spark, and other big data technologies.Collaborate with...

  • Data Engineer Lead

    3 weeks ago


    Pune, Maharashtra, India DATAECONOMY Full time

    Job Profile:At DATAECONOMY, we are seeking a highly skilled Data Engineer Lead to lead our team in designing and implementing big data solutions using PySpark. As a key member of our team, you will be responsible for collaborating with cross-functional teams to understand business needs and develop data-driven solutions.Key Responsibilities:Design and...

  • Senior Data Engineer

    1 month ago


    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. is a leading provider of data, marketing solutions, sales, and research. With a 50-year history in the US, the company has established a strategic global centre of excellence in Pune, delivering mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...


  • Pune, Maharashtra, India Virtusa Full time

    Job Title: Scalable Big Data EngineerAbout the RoleVirtusa is seeking an experienced Scala and Spark Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Scala and Spark.Key Responsibilities- Design and develop scalable big data...

  • Data Engineer

    3 weeks ago


    Pune, Maharashtra, India NTT DATA Full time

    Job Title:Data EngineerJob Summary:NTT DATA is seeking a Data Engineer to join our team in Pune, India. The successful candidate will have demonstrable experience and expertise in at least one programming language, whether it's Python, Java, Scala, or another technology. We value attitude and aptitude and are seeking bright, highly motivated individuals to...

  • Data Engineer Leader

    3 weeks ago


    Pune, Maharashtra, India DATAECONOMY Full time

    About the RoleDataEconomy is seeking a Senior Data Engineer to lead our team in designing and implementing big data solutions using PySpark.Key ResponsibilitiesLead the design and implementation of scalable and robust data pipelines using PySpark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Mentor and...

  • Big Data Engineer

    3 weeks ago


    Pune, Maharashtra, India PRI Global Full time

    Job Title: Big Data Engineer - Data Migration SpecialistJob Summary: We are seeking a highly skilled Big Data Engineer to join our team at PRI Global. As a Big Data Engineer - Data Migration Specialist, you will be responsible for migrating data from HDFS to Ozone, ensuring seamless data transfer and minimizing downtime.Key Responsibilities:Migrate data from...


  • Pune, Maharashtra, India Xoriant Full time

    Job OverviewXoriant is seeking a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have expertise in Apache Spark and Scala, with a strong background in big data processing and analytics.Key ResponsibilitiesDesign and develop scalable big data architectures using Apache SparkDevelop and maintain high-performance data...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for over five decades in the US. Our global centre of excellence in Pune delivers mission-critical data services to our customers worldwide, leveraging our proprietary cloud-based technology platform and business & consumer databases.Job SummaryWe are...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data Axle Data Axle Inc. has been a leading provider of data, marketing solutions, sales and research for decades in the US. We have established a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers through our proprietary cloud-based technology platform and leveraging our proprietary...


  • Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full time

    About the RoleWe are seeking a motivated Big Data Cloud Engineer to join our team at F337 Deutsche India Private Limited, Pune Branch. This role will be part of the Technology, Data and Innovation (TDI) department, working on the central client reference data system in Germany.Key ResponsibilitiesDesign and implement big data solutions using Cloudera,...


  • Pune, Maharashtra, India PubMatic Full time

    We are seeking a highly skilled Senior Big Data Engineer to join our team at PubMatic-Pune.Key Responsibilities:Design, implement, and deliver complex, scalable, and resilient big data platforms and services.Develop and maintain high-throughput big data platforms using modern technology stacks such as Apache Spark, Apache Kafka, and Hadoop.Collaborate with...

  • Big Data Engineer

    2 months ago


    Pune, Maharashtra, India Mig Staffing Full time

    Job Description : We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production :- Meeting with managers to...