Senior Spark Developer

9 hours ago

Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Spark Rockstar Wanted

Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing scalable data pipelines, we want to hear from you

Responsibilities :

- Lead the charge in building and maintaining our Spark-based data ecosystem, with a focus on batch and streaming processing

- Collaborate with our team of data wizards to design and implement ETL workflows that migrate seamlessly to Spark

- Whip up Python, Scala, and Java code like a pro, and use your expertise to integrate Spark with Hadoop, HDFS, YARN, and Kafka

- Streamline our workflows using Airflow or other workflow engines, and make Jupyter notebooks do your bidding

- Bonus points if you can conjure up workflows with NiFi, Flink, and Kudu streaming

Qualifications :

years of experience in Spark development, with a strong portfolio of projects that showcase your expertise

- Hands-on experience with Spark, Hadoop, HDFS, YARN, Kafka, and Airflow (or other workflow engines)

- Programming prowess in Python, Scala, and Java

- Experience with ETL implementation and migration to Spark

- Good to have : Flink and Kudu streaming, automation of workflows CI/CD, Nifi streaming and transformation, and Informatica workflow migration

  • Java Spark Developer

    1 week ago

    Pune, Maharashtra, India Wipro Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Java+SparkPrimary skill - Apache Spark Secondary skill - JavaStrong knowledge in Apache Spark framework Core Spark, Spark Data Frames, Spark streamingHands-on experience in any one of the programming languages (Java)Good understanding of distributed programming concepts.Experience in optimizing Spark DAG, and Hive queries on TezExperience using tools like...

  • Spark/Scala Developer

    1 week ago

    Pune, Maharashtra, India Cyanous Software Private Limited Full time US$ 1,50,000 - US$ 2,00,000 per year

    Detailed JD (Roles And Responsibilities)At least 8+ years of experience and strong knowledge in Scala programming language.Able to write clean, maintainable and efficient Scala code following best practices.Good knowledge on the fundamental Data Structures and their usageAt least 8+ years of experience in designing and developing large scale, distributed...

  • Senior Big Data/Spark Engineer

    6 days ago

    Pune, Maharashtra, India Barclays Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Join us as a Senior Big Data/Spark Engineer at Barclays, where you will be responsible for supporting the successful delivery of location strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to...

  • Spark SQL Developer

    9 hours ago

    Pune, Maharashtra, India Tech Mahindra Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Roles and ResponsibilitiesCollaborate with cross-functional teams to gather requirements and design ETL processes for extracting, transforming, and loading (ETL) of large datasets from various sources into the target database.Develop complex SQL queries to optimize performance of existing databases and troubleshoot issues related to query execution...

  • UiPath RPA Developer

    6 days ago

    Pune, Maharashtra, India Spark Consultancy Full time ₹ 5,00,000 - ₹ 22,00,000 per year

    Dear Candidate,We are hiring a UiPath RPA Developer for the Pune location.(To Confirm Please Drop a Whatsapp or call on Harsh )( In case The Number Is Busy, Please Drop A Whatsapp @ Harsh )Any graduate can apply."ONLINE INTERVIEW"Job Title: RPA DeveloperDepartment: ITReports To: IT ManagerSummary:We are seeking a highly skilled and experienced RPA Developer...

  • Scala, Spark

    1 week ago

    Pune, Maharashtra, India Citi Full time ₹ 8,00,000 - ₹ 20,00,000 per year

    The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...

  • Spark Scala Applications Development Technology Lead Analyst

    2 weeks ago

    Pune, Maharashtra, India Citi Full time US$ 1,50,000 - US$ 2,00,000 per year

    This position is under ICG TTS Operations Technology (OpsTech) Group , to help the implementation of next generation Digital Automation Platform and Imaging Workflow Technologies. The Candidate is required to possess relevant experience in managing development teams in the distributed systems Eco-System and should be a strong team player.It is expected that...

  • Spark Scala Applications Development Technology Lead Analyst

    2 weeks ago

    Pune, Maharashtra, India Citi Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewThis position is under ICG TTS Operations Technology (OpsTech)...

  • Senior Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Early Career Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...

  • Senior Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...