Senior Spark Developer

6 days ago


Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Spark Rockstar Wanted

Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing scalable data pipelines, we want to hear from you

Responsibilities :

- Lead the charge in building and maintaining our Spark-based data ecosystem, with a focus on batch and streaming processing

- Collaborate with our team of data wizards to design and implement ETL workflows that migrate seamlessly to Spark

- Whip up Python, Scala, and Java code like a pro, and use your expertise to integrate Spark with Hadoop, HDFS, YARN, and Kafka

- Streamline our workflows using Airflow or other workflow engines, and make Jupyter notebooks do your bidding

- Bonus points if you can conjure up workflows with NiFi, Flink, and Kudu streaming

Qualifications :

years of experience in Spark development, with a strong portfolio of projects that showcase your expertise

- Hands-on experience with Spark, Hadoop, HDFS, YARN, Kafka, and Airflow (or other workflow engines)

- Programming prowess in Python, Scala, and Java

- Experience with ETL implementation and migration to Spark

- Good to have : Flink and Kudu streaming, automation of workflows CI/CD, Nifi streaming and transformation, and Informatica workflow migration


  • Spark Developer

    3 days ago


    Pune, Maharashtra, India Infosys Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Spark DeveloperSpark, Scala, Bigdata • Ability to develop value-creating strategies and models that enable clients to innovate, drive growth and increase their business profitability • Good knowledge on software configuration management systems • Awareness of latest technologies and Industry trends • Logical thinking and problem-solving skills along...


  • Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Duration of contract*12 monthsTotal Yrs. of Experience*3+Relevant Yrs. of experience*3+Detailed JD *(Roles and Responsibilities)Develop and maintain legacy application and new platform(Roleswap, Migration, Patching, Mandatory upgrades)Mandatory skills*Python,Spark,Spark SQL,GIT,PostgreSQL,Airflow,Jenkins,KubernetesDesired skills*Camunda knowledge of Camunda...


  • Pune, Maharashtra, India Barclays Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Join us as a Senior Spark Data Engineer at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. As a part of the team, you will deliver technology stack, using strong analytical...


  • Pune, Maharashtra, India Barclays Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Join us as a Senior Big Data/Spark Engineer at Barclays, where you will be responsible for supporting the successful delivery of location strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to...

  • Spark SQL Developer

    6 days ago


    Pune, Maharashtra, India Tech Mahindra Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Roles and ResponsibilitiesCollaborate with cross-functional teams to gather requirements and design ETL processes for extracting, transforming, and loading (ETL) of large datasets from various sources into the target database.Develop complex SQL queries to optimize performance of existing databases and troubleshoot issues related to query execution...

  • UiPath RPA Developer

    2 weeks ago


    Pune, Maharashtra, India Spark Consultancy Full time ₹ 5,00,000 - ₹ 22,00,000 per year

    Dear Candidate,We are hiring a UiPath RPA Developer for the Pune location.(To Confirm Please Drop a Whatsapp or call on Harsh )( In case The Number Is Busy, Please Drop A Whatsapp @ Harsh )Any graduate can apply."ONLINE INTERVIEW"Job Title: RPA DeveloperDepartment: ITReports To: IT ManagerSummary:We are seeking a highly skilled and experienced RPA Developer...


  • Pune, Maharashtra, India Deutsche Telekom Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Your Role : We are looking for a Senior Cloudera Developer (Data Engineer) with extensive experience in Spark, the Hadoop ecosystem, and GCP services to design and implement data solutions. Responsibilities : - Design, develop, and implement data solutions using Cloudera technologies such as Hadoop, Spark, and Hive. - Collaborate with data engineers to...

  • Java Senior Developer

    18 hours ago


    Pune, Maharashtra, India Infosys Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Java Senior DeveloperExperienced in Core Java & Spring boot  Design, develop, and implement Kafka-based microservices using Spring Boot.  Build data pipelines for ingesting, processing, and analyzing large-scale data sets.  Optimize Kafka configurations for performance and reliability.  Work with Big Data technologies such as Hadoop, Spark, and...


  • Pune, Maharashtra, India Citi Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...


  • Pune, Maharashtra, India NICE Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    So, what's the role all about?Within Actimize, the AI and Analytics Team is developing the next generation advanced analytical cloud platform that will harness the power of data to provide maximum accuracy for our clients' Financial Crime programs. As part of the PaaS/SaaS development group, you will be responsible for developing this platform for Actimize...