Sr. Spark Big Data Developer

24 hours ago


Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time ₹ 5,00,000 - ₹ 15,00,000 per year

Sr. Spark Big Data Developer

PFB the detailed JD:

�� Experience: 5 to 7+ years (Hands-on)

�� Notice Period: 0-30 Days

Must Have:

 Proficiency in at least one of the following programming languages:

Java/Scala/Python

 Good understanding of SQL

 Experience of development and deployment of at least one end-to-end data

storage/processing pipeline

 Strong Experience in Spark development with batch and streaming

 Intermediate level expertise in HDFS and Hive

 Experience with Pyspark and Data Engineering

 ETL implementation and migration to spark

 Experience of working with Hadoop cluster

 Python, PySpark, Data Bricks developer with knowledge of cloud

 Experience with Kafka and Spark streaming (Dstream and Structured Streaming)

 Experience with using Jupyter notebooks or any other developer tool

 Experience with Airflow or other workflow engines

 Good communication skills and logical skills

Good to Have Skills:

 Prior experience of writing Spark jobs using Java is highly appreciated

 Prior experience of working with Cloudera Data Platform (CDP)

 Hands-on experience with NoSQL databases like HBase, Cassandra,

Elasticsearch, etc.

 Experience of using maven and git

 Agile scrum methodologies

 Flink and Kudu streaming

 Automation of workflows CI/CD

 Nifi streaming and transformation

Job Types: Full-time, Permanent

Pay: ₹500, ₹1,500,000.00 per year

Benefits:

  • Provident Fund

Work Location: In person


  • Big Data Developer

    1 week ago


    Pune, Maharashtra, India airtel Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title:Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...

  • Big Data Developer

    7 days ago


    Pune, Maharashtra, India Populace World Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Description : Big Data DeveloperLocation : Pune, IndiaExperience : 7 YearsAbout the Role : We are seeking a highly experienced and technically proficient Big Data Developer to join our team in Pune. In this role, you will be responsible for designing, developing, and optimizing large-scale data processing pipelines and platforms. The ideal candidate...

  • Big Data Lead

    2 weeks ago


    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...

  • Big Data Lead

    23 hours ago


    Pune, Maharashtra, India Populace World Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Designation: Big Data LeadLocation: PuneExperience: 8-10 yearsReports To – Product Engineering HeadJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with...


  • Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Spark Rockstar Wanted Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing scalable data...

  • Big Data Engineer

    3 days ago


    Pune, Maharashtra, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: For queries, contact via WhatsApp: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale,...

  • Big Data Developer

    20 hours ago


    Pune, Maharashtra, India Uplers Full time ₹ 60,000 - ₹ 1,80,000 per year

    Experience: yearsSalary: Confidential (based on experience)Expected Notice Period: 15 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: Office (Pune)Placement Type: Full Time Permanent position(Payroll and Compliance to be managed by: Nexus Cognitive)**(*Note: This is a requirement for one of Uplers' client - Nexus Cognitive)**What do you need for...


  • Pune, Maharashtra, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Our is Client is a largest Top 5 Software giant in India, with over 11.3 USD billion dollars revenue, Global work force 2,40,000 employees, It delivers end-to-end technology, consulting, and business process services to clients across the globe, Presence: 60+ countries and Publicly traded company NSE & BSE (India), NYSE (USA).· Job Title: Big Data Developer...

  • Big Data Architect

    1 week ago


    Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Architect - Build the Future of Data Management Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of data...

  • Bigdata - Spark

    1 day ago


    Pune, Maharashtra, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    7+ years of experience in Big Data with strong expertise in Spark and ScalaMandatory Skills\: Big Data Primarily Spark and ScalaStrong Knowledge in HDFS, Hive, Impala with knowledge on Unix , Oracle, Autosys, Good to Have \: Agile Methodology and Banking ExpertiseStrong Communication SkillsNot limited to Spark batch, need Spark streaming experience No SQL...