Senior Spark Developer

2 weeks ago

Pune, India Consulting Pandits Full time

Spark Rockstar WantedImagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing scalable data pipelines, we want to hear from youResponsibilities :- Lead the charge in building and maintaining our Spark-based data ecosystem, with a focus on batch and streaming processing- Collaborate with our team of data wizards to design and implement ETL workflows that migrate seamlessly to Spark- Whip up Python, Scala, and Java code like a pro, and use your expertise to integrate Spark with Hadoop, HDFS, YARN, and Kafka- Streamline our workflows using Airflow or other workflow engines, and make Jupyter notebooks do your bidding- Bonus points if you can conjure up workflows with NiFi, Flink, and Kudu streamingQualifications :- 5+ years of experience in Spark development, with a strong portfolio of projects that showcase your expertise- Hands-on experience with Spark, Hadoop, HDFS, YARN, Kafka, and Airflow (or other workflow engines)- Programming prowess in Python, Scala, and Java- Experience with ETL implementation and migration to Spark- Good to have : Flink and Kudu streaming, automation of workflows CI/CD, Nifi streaming and transformation, and Informatica workflow migration (ref:hirist.tech)

  • Senior Spark Developer

    1 week ago

    Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Spark Rockstar Wanted Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing scalable data...

  • Senior Cloudera Developer

    1 week ago

    Pune, India Deutsche Telekom Full time

    Your Role :We are looking for a Senior Cloudera Developer (Data Engineer) with extensive experience in Spark, the Hadoop ecosystem, and GCP services to design and implement data :- Design, develop, and implement data solutions using Cloudera technologies such as Hadoop, Spark, and Hive.- Collaborate with data engineers to optimize data pipelines and data...

  • Spark Developer

    6 days ago

    Pune, Maharashtra, India Infosys Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Spark DeveloperSpark, Scala, Bigdata • Ability to develop value-creating strategies and models that enable clients to innovate, drive growth and increase their business profitability • Good knowledge on software configuration management systems • Awareness of latest technologies and Industry trends • Logical thinking and problem-solving skills along...

  • Spark/Scala Developer

    4 weeks ago

    Pune, India Cyanous Software Private Limited Full time

    Detailed JD (Roles and Responsibilities) :- At least 8+ years of experience and strong knowledge in Scala programming language.- Able to write clean, maintainable and efficient Scala code following best practices.- Good knowledge on the fundamental Data Structures and their usage - At least 8+ years of experience in designing and developing large scale,...

  • Python and Spark developer

    1 week ago

    Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Duration of contract*12 monthsTotal Yrs. of Experience*3+Relevant Yrs. of experience*3+Detailed JD *(Roles and Responsibilities)Develop and maintain legacy application and new platform(Roleswap, Migration, Patching, Mandatory upgrades)Mandatory skills*Python,Spark,Spark SQL,GIT,PostgreSQL,Airflow,Jenkins,KubernetesDesired skills*Camunda knowledge of Camunda...

  • Scala/Spark Developer

    4 days ago

    Bengaluru, Chennai, Pune, India Photon Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    About The Role   Develop, test, and deploy data processing applications using Apache Spark and Scala.Optimize and tune Spark applications for better performance on large-scale data sets.Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.Collaborate with data scientists, business...

  • Senior Spark Data Engineer

    4 days ago

    Pune, Maharashtra, India Barclays Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Join us as a Senior Spark Data Engineer at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. As a part of the team, you will deliver technology stack, using strong analytical...

  • Senior Spark Data Engineer

    3 weeks ago

    Pune, India Barclays Full time

    Job Description Join us as a Senior Spark Data Engineer at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. As a part of the team, you will deliver technology stack, using...

  • Spark/Python/Pentaho Developer

    2 weeks ago

    Pune, India Deutsche Bank Full time

    Job Title: Spark/Python/Pentaho Developer Location: Pune, India Role Description Spark/Python/Pentaho Developer. Need to work on Data Integration project. Mostly batch oriented using Python/Pyspark/Pentaho. What we'll offer you As part of our flexible scheme, here are just some of the benefits that you'll enjoy Best in class leave policy Gender neutral...

  • Spark/Python/Pentaho Developer, AS

    3 weeks ago

    Pune, India Deutsche Bank Full time

    Job Title: Spark/Python/Pentaho Developer Location: Pune, India Role Description Spark/Python/Pentaho Developer. Need to work on Data Integration project. Mostly batch oriented using Python/Pyspark/Pentaho. What we'll offer you As part of our flexible scheme, here are just some of the benefits that you'll enjoy Best in class leave policy Gender neutral...