Big Data Engineer

2 months ago


Pune, India Mig Staffing Full time

We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.

To ensure success as a big data engineer, you should have in-depth knowledge of Hadoop technologies, excellent project management skills, and high-level problem-solving skills. A top-notch Big Data Engineer understands the needs of the company and institutes scalable data solutions for its current and future needs.

Responsibilities :

- Meeting with managers to determine the company's Big Data needs.

- Developing Hadoop systems.

- Loading disparate data sets and conducting pre-processing services using Hive or Pig.

- Finalizing the scope of the system and delivering Big Data solutions.

- Managing the communications between the internal system and the survey vendor.

- Collaborating with the software research and development teams.

- Building cloud platforms for the development of company applications.

- Maintaining production systems.

- Training staff on data resource management.

Requirements :

- Bachelor's degree in computer engineering or computer science.

- 5+Years experience as a Big data engineer.

- In-depth knowledge of Hadoop, Spark, and similar frameworks.

- Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.

- Knowledge of NoSQL and RDBMS databases including Redis and MongoDB.

- Familiarity with AWS, and Docker tools.

- Excellent project management skills.

- Good communication skills.

- Ability to solve complex networking, data, and software issues.

(ref:hirist.tech)
  • Data Engineer

    3 weeks ago


    Pune, Maharashtra, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...

  • Big Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Seven N Half Full time

    Job Title: Lead Big Data DeveloperThis is an exciting opportunity to join our team at Seven N Half as a Lead Big Data Developer. We are a fast-paced software company that partners with innovative B2B and B2C SaaS companies for their digital transformation needs.Job Summary:We are seeking a highly skilled and experienced Big Data Developer to lead our team in...

  • Data Engineer

    7 days ago


    Pune, Maharashtra, India Virtusa Full time

    About the RoleAt Virtusa, we are seeking a highly skilled Data Engineer (Big Data) to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Apache Spark, Hadoop, and Hive.Responsibilities• Design, develop, and...

  • Big Data Engineer

    4 weeks ago


    Pune, India SGS Technical Services Pvt. Ltd Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at SGS Technical Services Pvt. Ltd. The successful candidate will be responsible for designing, developing, and maintaining scalable data processing systems using Hadoop and PySpark.Key Responsibilities:Design and develop data processing systems using...


  • Pune, Maharashtra, India Circana Full time

    Job DescriptionCircana is seeking a highly skilled Senior Big Data Engineer to lead our big data initiatives and drive innovation in data engineering.Key ResponsibilitiesDesign and develop scalable big data architectures using Hadoop and Spark frameworks.Lead a team of data engineers to develop and deploy big data solutions.Collaborate with cross-functional...

  • Data Engineer

    3 months ago


    Pune, India Rao Career Solutions Full time

    Job Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...

  • Big Data Engineer

    4 weeks ago


    Pune/Maharashtra, India Talent Sketchers Full time

    Job Title: Big Data EngineerAt Talent Sketchers, we are seeking a highly skilled Big Data Engineer to join our team.Key Responsibilities:Design and develop scalable data processing systems using Apache Spark.Work with various programming languages such as Java and Scala.Expertise in database modeling and working with SQL and NoSQL databases.Experience with...

  • Big Data Engineer

    2 months ago


    Pune, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full time

    Job Summary:We are seeking a skilled and innovative Big Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems. You will work with large datasets and implement data pipelines to ensure data quality and availability for analytics and business intelligence...


  • Pune, Maharashtra, India Huquo Full time

    Job Title: Big Data Engineer/ManagerAbout the Role:We are seeking a highly skilled Big Data Engineer/Manager to join our team at Huquo. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL databases.Key...

  • Big Data Engineer

    41 minutes ago


    Pune, India Flipped.ai Full time

    Job Description : Big Data Engineer (PySpark)Years of experience : 6 to 13 yearsLocations : Chennai and Pune ( Candidates from chennai and pune only apply)Notice period : Immediate joiners/15 to 30 days onlyAbout the Role : We are seeking a highly skilled and experienced Big Data Engineer with a strong focus on PySpark to join our dynamic team. As a Big Data...


  • Pune, Maharashtra, India Virtusa Full time

    About the RoleAt Virtusa, we are looking for a skilled Senior Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark, Hadoop, Hive, and Impala.Key Responsibilities• Develop and implement data pipelines using...

  • Big Data Engineer

    3 weeks ago


    Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full time

    Job SummaryF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...

  • Big Data Engineer

    2 weeks ago


    Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full time

    Big Data EngineerWe are seeking a skilled Big Data Engineer to contribute to building backend data applications and services. This role requires expertise in various technologies to drive our data initiatives.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather...

  • Data Engineer

    1 week ago


    Pune, Maharashtra, India NR Consulting - India Full time

    Job Title: Data Engineer - Java and Big DataJob Description:Data Engineer - Java and Big DataPython – advanced concepts (add on if candidate have Java background)Problem SolvingHadoop/Spark/HiveKafkaSpring Boot PL/SQL – derive a pseudocode, write a queryAbout the Role:This role requires a strong background in Java and Big Data technologies. The ideal...

  • Big Data Engineer

    3 weeks ago


    Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full time

    About the RoleF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...

  • Big Data Engineer

    4 weeks ago


    Pune/Gurgaon/Gurugram, India Huquo Full time

    Job Title: Big Data EngineerAt Huquo, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable data pipelines using Spark and other big data...

  • Big Data Engineer

    4 weeks ago


    Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full time

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team and contribute to building backend data applications and services that support our analytics platforms.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather requirements and...

  • Big Data Engineer

    4 weeks ago


    Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full time

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team and contribute to building backend data applications and services that support our analytics platforms.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather requirements and...

  • Big Data Engineer

    3 weeks ago


    Hyderabad/Pune/Delhi NCR, India Ace Recruit Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Ace Recruit. As a Big Data Engineer, you will be responsible for designing and building scalable data ingestion pipelines, conceptualizing and executing high-performance data processing, and scheduling and orchestrating pipelines.Key...

  • Big data engineer

    6 days ago


    Pune, India PRI Global Full time

    Position: Sr. Big Data Engineer (Support Role) HM: Kruna Bharti Location: Pune Team/Key Projects: Play4 Initiative for Data and Analytics Duration: 12 Months Initially Domain: Banking and payment preferred YOE: 5+ Years Shift: 12 – 9 PM IST (2 – 3 hours overlap with US Team) Daily Task: Migrating data from HDFS to Ozone ...