Sr. Spark Big Data Developer

2 weeks ago


Kothrud Pune Maharashtra, India CRUTZ LEELA ENTERPRISES Full time ₹ 1,00,000 - ₹ 15,00,000 per year

PFB the detailed JD:

�� Experience: 5 to 7+ years (Hands-on)

�� Notice Period: 0-30 Days

Must Have:

 Proficiency in at least one of the following programming languages:

Java/Scala/Python

 Good understanding of SQL

 Experience of development and deployment of at least one end-to-end data

storage/processing pipeline

 Strong Experience in Spark development with batch and streaming

 Intermediate level expertise in HDFS and Hive

 Experience with Pyspark and Data Engineering

 ETL implementation and migration to spark

 Experience of working with Hadoop cluster

 Python, PySpark, Data Bricks developer with knowledge of cloud

 Experience with Kafka and Spark streaming (Dstream and Structured Streaming)

 Experience with using Jupyter notebooks or any other developer tool

 Experience with Airflow or other workflow engines

 Good communication skills and logical skills

Good to Have Skills:

 Prior experience of writing Spark jobs using Java is highly appreciated

 Prior experience of working with Cloudera Data Platform (CDP)

 Hands-on experience with NoSQL databases like HBase, Cassandra,

Elasticsearch, etc.

 Experience of using maven and git

 Agile scrum methodologies

 Flink and Kudu streaming

 Automation of workflows CI/CD

 Nifi streaming and transformation

Job Types: Full-time, Permanent

Pay: ₹100, ₹1,500,000.00 per year

Benefits:

  • Provident Fund

Work Location: In person



  • Kothrud Depot, Bus Stop, India CRUTZ LEELA ENTERPRISES Full time

    PFB the detailed JD: �� Experience: 5 to 7+ years (Hands-on) �� Notice Period: 0-30 Days Must Have:  Proficiency in at least one of the following programming languages: Java/Scala/Python  Good understanding of SQL  Experience of development and deployment of at least one end-to-end data storage/processing pipeline  Strong Experience in...

  • Sr. Big Data Engineer

    23 hours ago


    Pune, India Synechron Technologies Private Limited Full time

    Job Description Job Summary: We are looking for a highly skilled Sr. Big Data Engineer professional to join our team. This role will focus on designing, developing, and maintaining large-scale data processing systems. The ideal candidate will have extensive experience in Big Data technologies, Java programming, and a strong understanding of data...

  • Big Data Architect

    2 weeks ago


    Kothrud, Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time

    Position - Big Data Architect Experience: 10-12 years Key Responsibilities: - Data Architecture Design: Designing and implementing scalable and resilient data architectures for both batch and streaming data processing. - Data Modeling: Developing data models and database structures to ensure efficient data storage and retrieval. - Data Security and...


  • Pune, India Consulting Pandits Full time

    Spark Rockstar Wanted!Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing...

  • Big Data Architect

    5 days ago


    Pune, India Consulting Pandits Full time

    Big Data Architect - Build the Future of Data ManagementAre you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of...


  • Pune, India Devlats Pvt Ltd Full time

    Sr. Big Data EngineerLocation : PuneExperience : 8+ years overall; 6+ years relevantMode : HybridRole Overview :We are seeking a talented Sr. Big Data Engineer to design, develop, and support a highly scalable, distributed SaaS-based Security Risk Prioritization product. You will lead the design and evolution of our data platform and pipelines, providing...

  • Big Data Engineer

    23 hours ago


    Pune, India Synechron Technologies Private Limited Full time

    Job Description As a Big Data Engineer, you will be responsible for translating application storyboards and use cases into functional applications, designing and building efficient and reliable Java code. You will ensure optimal performance, quality, and responsiveness of applications, while also identifying bottlenecks and devising solutions. Your role...

  • Lead Big Data

    23 hours ago


    Pune, India Synechron Technologies Private Limited Full time

    Job Description s a Lead Big Data, you will be responsible for translating application storyboards and use cases into functional applications, designing and building efficient and reliable Java code. You will ensure optimal performance, quality, and responsiveness of applications, while also identifying bottlenecks and devising solutions. Your role will...

  • Big Data Engineer

    3 days ago


    Pune, India WorkiFicient Full time

    Roles and Responsibility :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement systems to cleanse,...


  • Pune, India Recro Full time

    Responsibilities :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement systems to cleanse, process, and...