Big Data Engineer

1 week ago


Pune, Maharashtra, India Huntsmen & Barons Full time

Job description :

Role : Data Engineer

Location : Pune,chennai,noida,delhi

1. Overall 5+ Years of IT experience and 2+ Years of relevant experience with Big Data Technologies (such as - Spark Scala, Hadoop, Hive, HBase, Python, Kafka)

2. Hands on experience in Basic & Advance Java

3. Hands on experience in Apache Spark - Scala and deep understanding of distributed systems

4. Hands on experience in Core Spark API and Spark Streaming APIs

5. Relevant experience with handling different file formats - JSON, Avro, Parquet, CSV, XML, Text files

6. Experience working with HDFS, Hive, S3, Mongo DB and SQL database integration

7. Hands on experience in creating Scala/Spark Jobs for data transformation & aggregation

8. Sound exposure to ETL pipelines implementation, batch scheduling and automation

9. Proficient in writing hive queries and understand hive internals

10. Have good work exposure with Data integration/Data acquisition framework or similar kind of framework

11. Strong understanding of big data concepts and distributed computing

12. Experience with source control management like git , bitbucket

13. Familiar with all phases of development life cycle and agile development methodologies

14. Excellent problem-solving skills and attention to details

15. Strong communication and collaboration skills

16. Strong exposure to Unix commands and Unix shell scripting

17. Strong exposure to Oracle/SQL database

18. Must be able to code, and assist of other team members

(ref:hirist.tech)
  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India beBee Careers Full time

    Big Data EngineerWe are seeking a highly skilled engineer to join our big data team. As a key member, you will be responsible for designing and implementing big data solutions using Big Query, Big Data, Hadoop, and Snowflake.The ideal candidate will have:Hands-on experience in designing and implementing big data solutions.Strong knowledge of machine learning...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India beBee Careers Full time

    Big Data EngineerWe are looking for a Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for developing and maintaining large-scale data processing systems using big data technologies.Responsibilities:Develop and maintain clean, efficient, and well-tested Scala/Spark code.Perform in-depth data analysis to support development...

  • Big Data Engineer

    7 days ago


    Pune, Maharashtra, India beBee Careers Full time

    Job Title: Big Data EngineerJob Overview:We are seeking a highly skilled big data engineer to join our team. As a big data engineer, you will be responsible for designing, implementing, and optimizing large-scale data processing systems using technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design, implement, and optimize...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India beBee Careers Full time

    Our ideal candidate will have a strong background in big data technologies, data engineering, and distributed systems. The main responsibilities of this role include designing, developing, and implementing scalable big data solutions using Hadoop, Spark, and other data processing frameworks.Skill Set:Hadoop Ecosystem (HDFS, Hive, HBase, YARN)Apollo...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India beBee Careers Full time

    About this Role:We are looking for a talented Big Data Engineer to join our team. As a Spark Scala Developer, you will play a key role in designing and implementing scalable data pipelines using distributed systems and Big Data technologies.

  • Big Data Engineer

    7 days ago


    Pune, Maharashtra, India beBee Careers Full time

    Job Title: Big Data EngineerJob Summary:We are seeking an experienced Big Data Engineer to design and develop business-critical backend systems using stream processors and high-quality data pipelines.This role involves assembling large, complex data sets that meet functional / non-functional business requirements. You will build the infrastructure required...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India beBee Careers Full time

    Data Engineering ExpertiseWe are seeking an experienced Data Engineer to lead the design and implementation of our data infrastructure. The successful candidate will have a deep understanding of big data tools, experience with data pipeline and workflow management tools, and excellent problem-solving skills.ResponsibilitiesLead the design and implementation...

  • Big Data Engineer

    4 weeks ago


    Pune, Maharashtra, India WorkiFicient Technologies Pvt Ltd Full time

    Job Title- Lead Big Data Engineer.Location- Pune.Experience- 8 to 10 years.Notice Period- Looking for immediate joiners/30 days.To be successful in this role, you should possess:Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.Participate in Design discussions and brainstorming sessions to select,...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India beBee Careers Full time

    Job Description:- Develop Big Data Engineering solutions for on-premises systems, with a focus on Spark development and streaming experience.- Collaborate on ETL implementation and migration to Spark, utilizing programming knowledge in Java, Scala, and Python.- Design and implement data pipelines using Apache Kafka, HDFS, Hive, and Spark Streaming (DStream...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India beBee Careers Full time

    Job Title: Big Data EngineerAbout the RoleWe are seeking an experienced Big Data Engineer to design, build, and maintain large-scale data processing systems on cloud platforms such as AWS/Azure Stack.Key ResponsibilitiesAs a Big Data Engineer, you will be responsible for:Designing and developing data warehouses and ETL pipelines using Databricks and...