Senior Spark Developer

3 weeks ago

Pune, India Consulting Pandits Full time

Spark Rockstar WantedImagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing scalable data pipelines, we want to hear from youResponsibilities :- Lead the charge in building and maintaining our Spark-based data ecosystem, with a focus on batch and streaming processing- Collaborate with our team of data wizards to design and implement ETL workflows that migrate seamlessly to Spark- Whip up Python, Scala, and Java code like a pro, and use your expertise to integrate Spark with Hadoop, HDFS, YARN, and Kafka- Streamline our workflows using Airflow or other workflow engines, and make Jupyter notebooks do your bidding- Bonus points if you can conjure up workflows with NiFi, Flink, and Kudu streamingQualifications :- 5+ years of experience in Spark development, with a strong portfolio of projects that showcase your expertise- Hands-on experience with Spark, Hadoop, HDFS, YARN, Kafka, and Airflow (or other workflow engines)- Programming prowess in Python, Scala, and Java- Experience with ETL implementation and migration to Spark- Good to have : Flink and Kudu streaming, automation of workflows CI/CD, Nifi streaming and transformation, and Informatica workflow migration (ref:hirist.tech)

  • Senior Spark Developer

    3 weeks ago

    Pune, India Ixceed Solutions Full time

    Description :Job Description :We are looking for an experienced Senior Spark Developer with a strong background in Scala, Java, and Big Data technologies. The ideal candidate will have 5+ years of development experience, including expertise in Spark-based data processing, Java server-side development, and working in fast-paced, low-latency environments. A...

  • Spark Developer

    1 day ago

    Pune, Maharashtra, India Citi Full time

    The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...

  • Spark Developer

    1 day ago

    Pune, Maharashtra, India Citi Full time

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewThe Applications Development Intermediate Programmer Analyst is an...

  • Java Spark Senior Lead Developer

    5 hours ago

    Pune, India Citi Full time

    The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.Responsibilities: Partner with multiple...

  • Spark/Scala

    2 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services (TCS) Full time

    Role:Senior DeveloperRequired Technical Skill Set: Spark/Scala/UnixExperience Range: 5-8 yearsLocation of Requirement : PuneMust-HaveMinimum 4+ years of experience in development of Spark ScalaExperience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata components like HDFS, Spark, Hive...

  • Java Spark Senior Developer

    3 days ago

    Pune, Maharashtra, India Citi Full time

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewThe Applications Development Senior Programmer Analyst is an...

  • Spark Developer

    3 days ago

    Pune, Maharashtra, India Infosys Full time

    Spark, Scala, BigdataTeam Management: Lead and manage a team of technical professionals – Data Engineer and Application Developers, ensuring effective collaboration and productivity.Client Interaction: Serve as the primary point of contact for clients, understanding their needs and ensuring successful project delivery.Status Reporting: Prepare and present...

  • Business Development Executive

    3 days ago

    Pune, Maharashtra, India Mark & Spark Solutions Full time

    Company DescriptionMark & Spark Solutions, owned by ITvia Data Solutions, is a top-tier market research and consulting firm dedicated to driving business success through data-driven insights. With expertise in market dynamics and consumer behavior, the company supports clients across diverse industries by providing actionable intelligence. Mark & Spark...

  • Apache Spark Developer

    3 weeks ago

    Pune, India People Prime Worldwide Full time

    About Client :- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is...

  • Spark Admin

    3 days ago

    Pune, Maharashtra, India Virtusa Full time

    Spark Administration: Install, configure, and manage Apache Spark 3.x. clusters. Monitor and optimize Spark cluster performance. Troubleshoot and resolve Spark-related issues. Manage Spark job scheduling and resource allocation. Ensure high availability and reliability of Spark clusters. DevOps Practices: Implement and manage CI/CD pipelines using tools like...