Big Data Engineer

1 month ago

Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

Big Data Engineer

Must-Have :

- 5+ years of experience in Software and IT industry

- 3 + years of relevant work experience in data engineering

- Hands on in Python/Scala data engineering application development

- Hands on in developing streaming application.

- Knowledge on Test automation and scripting

- Experience with CI/CD process and tools (GIT, Jenkins, SonarQube)

- Good track record in system architecture and design

- Good aptitude, strong problem-solving abilities, and analytical skills, ability to take ownership as appropriate.

- Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.

- Experience working in Agile Methodology

- Ability to learn and help the team learn new technologies quickly.

- Excellent communication and coordination skills

- Must be able to integrate quickly into the team and work independently towards team goals.

- Should be comfortable working in a Hybrid model from the Bangalore office of the client.

Nice to Have :

- Any prior experience in working on a migration project.

- Any experience with GCP or any cloud is preferred.

Role & Responsibilities:

- Build spark data pipelines from existing legacy pipelines.

- Build CI, CD pipelines.

- Take complete responsibility for the project execution.

- Be accountable for the delivery of the project within the defined timelines with good quality.

- Define and follow the processes for project execution and delivery.

- Drive and motivate the team to be agile and follow agile methodology.

- Help the team technically and give the team direction on how to plan, design, implement, and deliver the projects.

- Involve the team during the brainstorming sessions as appropriate.

- Work with the clients and counterparts (in the US) to drive the project execution.

- Keep all the stakeholders updated about the project status/risks/issues if there are any.

- Work closely with the management wherever and whenever required, to ensure smooth execution and delivery of the project.

- Should be comfortable working in a Hybrid model from the Bangalore office of the client.

Key Skills : Spark, Scala, Hive, Map Reduce, Kafka, Python, Unix shell scripting, Spark streaming, Oracle PL/SQL, Store procedure, CI/CD Process and Tools, Airflow

Education : BE/B.Tech from a reputed institute.

Every individual comes with a different set of skills and qualities so even if you don't tick all the boxes for the role today, we urge you to apply as there might be a suitable/unique role for you tomorrow

(ref:hirist.tech)

  • Big Data Developer

    1 month ago

    Gurugram, India IntraEdge Full time

    Big Data Engineer Position Available in Gurgaon We are looking for a Big Data Engineer to join our team in Gurgaon. The ideal candidate should have a Bachelor's degree in engineering or computer science (or equivalent) OR a Master's in computer applications (or equivalent).The candidate will work closely with the engineering team and product owners, so...

  • Big Data Developer

    1 month ago

    Gurugram, India IntraEdge Full time

    🔴 Big Data Engineer Position Available in Gurgaon 🔴We are looking for a Big Data Engineer to join our team in Gurgaon. The ideal candidate should have a Bachelor's degree in engineering or computer science (or equivalent) OR a Master's in computer applications (or equivalent).The candidate will work closely with the engineering team and product owners,...

  • Big Data Developer

    1 month ago

    gurugram, India IntraEdge Full time

    Big Data Engineer Position Available in Gurgaon We are looking for a Big Data Engineer to join our team in Gurgaon. The ideal candidate should have a Bachelor's degree in engineering or computer science (or equivalent) OR a Master's in computer applications (or equivalent). The candidate will work closely with the engineering team and product owners, so...

  • Paisabazaar - Data Engineer - Big Data Technologies

    2 weeks ago

    Gurugram, India Paisabazaar.com Full time

    Job Description :Qualifications for Data Engineer :3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.Strong analytic skills to understand and...

  • Paisabazaar - Data Engineer - Big Data Technologies

    1 month ago

    gurugram, India Paisabazaar.com Full time

    Job Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand and create...

  • Lead Big Data Software Engineer

    1 month ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Senior Big Data Software Engineer

    1 month ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Big Data Engineer

    5 days ago

    Gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...

  • Big Data Engineer

    2 days ago

    gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...

  • Paisabazaar - Data Engineer - Big Data Technologies

    2 weeks ago

    Gurgaon/Gurugram, India Paisabazaar.com Full time

    Job Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand...

  • Paisabazaar - Data Engineer - Big Data Technologies

    4 weeks ago

    Gurgaon/Gurugram, IN Paisabazaar.com Full time

    Job Description :Qualifications for Data Engineer :3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.Strong analytic skills to understand and...

  • Big Data Developer

    1 month ago

    gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    2 weeks ago

    Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Senior Big Data Engineer

    3 days ago

    Gurugram, India dunnhumby Full time

    We’re looking for a Sr Big Data Engineer who expects more from their career. It’s chance to extend and improve dunnhumby’s Data Engineering Team. It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers.  What we expect from you • 5+ years of experience in Information...

  • Senior Big Data Engineer

    1 month ago

    gurugram, India dunnhumby Full time

    We’re looking for a Sr Big Data Engineer who expects more from their career. It’s chance to extend and improve dunnhumby’s Data Engineering Team. It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers.  What we expect from you • 5+ years of experience in...

  • Big Data Engineer

    2 weeks ago

    Bangalore/Gurgaon/Gurugram, India HR BIZ HUB Full time

    Job Title : Big Data DeveloperJob Description :- Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent.- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 4+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core,...

  • Big Data/Scala Developer

    2 weeks ago

    Gurugram, India Waytogo Consultants Full time

    Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data/Scala Developer

    1 month ago

    gurugram, India Waytogo Consultants Full time

    Job Description : In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data Developer

    4 weeks ago

    Gurgaon/Gurugram, IN Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    2 weeks ago

    Gurgaon/Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...