Senior Spark Developer

1 day ago


Pune, India Consulting Pandits Full time

Spark Rockstar WantedImagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing scalable data pipelines, we want to hear from youResponsibilities :- Lead the charge in building and maintaining our Spark-based data ecosystem, with a focus on batch and streaming processing- Collaborate with our team of data wizards to design and implement ETL workflows that migrate seamlessly to Spark- Whip up Python, Scala, and Java code like a pro, and use your expertise to integrate Spark with Hadoop, HDFS, YARN, and Kafka- Streamline our workflows using Airflow or other workflow engines, and make Jupyter notebooks do your bidding- Bonus points if you can conjure up workflows with NiFi, Flink, and Kudu streamingQualifications :- 5+ years of experience in Spark development, with a strong portfolio of projects that showcase your expertise- Hands-on experience with Spark, Hadoop, HDFS, YARN, Kafka, and Airflow (or other workflow engines)- Programming prowess in Python, Scala, and Java- Experience with ETL implementation and migration to Spark- Good to have : Flink and Kudu streaming, automation of workflows CI/CD, Nifi streaming and transformation, and Informatica workflow migration (ref:hirist.tech)



  • Pune, India Ixceed Solutions Full time

    Description :Job Description :We are looking for an experienced Senior Spark Developer with a strong background in Scala, Java, and Big Data technologies. The ideal candidate will have 5+ years of development experience, including expertise in Spark-based data processing, Java server-side development, and working in fast-paced, low-latency environments. A...

  • Spark Developer

    7 hours ago


    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...

  • Spark Developer

    11 hours ago


    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewThe Applications Development Intermediate Programmer Analyst is an...


  • Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewThe Applications Development Senior Programmer Analyst is an...

  • Spark/Scala

    2 weeks ago


    Pune, Maharashtra, India Tata Consultancy Services (TCS) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role:Senior DeveloperRequired Technical Skill Set: Spark/Scala/UnixExperience Range: 5-8 yearsLocation of Requirement : PuneMust-HaveMinimum 4+ years of experience in development of Spark ScalaExperience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata components like HDFS, Spark, Hive...

  • Spark Developer

    9 hours ago


    Pune, Maharashtra, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Educational RequirementsBachelor of EngineeringService LineData & Analytics UnitResponsibilitiesTeam Management: Lead and manage a team of technical professionals Data Engineer and Application Developers, ensuring effective collaboration and productivity.Client Interaction: Serve as the primary point of contact for clients, understanding their needs and...


  • Pune, Maharashtra, India Barclays Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Join us as a Senior Spark Data Engineer at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. As a part of the team, you will deliver technology stack, using strong analytical...


  • Pune, India Deutsche Bank Full time

    Description Spark/Python/Pentaho Developer. Need to work on Data Integration project. Mostly batch oriented using Python/Pyspark/Pentaho. What we’ll offer you As part of our flexible scheme, here are just some of the benefits that you’ll enjoy Best in class leave policy Gender neutral parental leaves 100% reimbursement under childcare assistance benefit...


  • Pune, Maharashtra, India Mark & Spark Solutions Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    Company DescriptionMark & Spark Solutions, owned by ITvia Data Solutions, is a top-tier market research and consulting firm dedicated to driving business success through data-driven insights. With expertise in market dynamics and consumer behavior, the company supports clients across diverse industries by providing actionable intelligence. Mark & Spark...

  • Spark Developer

    4 weeks ago


    Pune, India Infosys Full time

    Job Description Spark, Scala, Bigdata - Team Management: Lead and manage a team of technical professionals Data Engineer and Application Developers, ensuring effective collaboration and productivity. - Client Interaction: Serve as the primary point of contact for clients, understanding their needs and ensuring successful project delivery. - Status Reporting:...