Senior Apache Spark Developer

4 weeks ago


Bengaluru India BairesDev Full time

Job Description

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Apache Spark Developer at BairesDev

We are seeking a Senior Apache Spark Developer to work on distributed data processing systems and real-time analytics. You'll contribute to Apache Spark and related ecosystem projects (Kafka, Hive, Iceberg), focusing on performance optimization and scalable architecture.

What You'll Do:

- Contribute actively to Apache Spark and related open source projects as a core contributor.

- Develop and optimize distributed data processing engines for batch and real-time analytical workloads.

- Develop streaming analytics capabilities using Spark Structured Streaming and integration with Apache Kafka.

- Enhance Spark SQL catalyst optimizer and distributed query execution systems.

- Collaborate with engineering teams on system integration and deployment.

What we are looking for:

- 10+ years of experience in software development.

- Strong expertise in distributed computing and large-scale data processing systems.

- Understanding of Apache Spark architecture, including RDDs, DataFrames, and streaming.

- Proficiency in Scala, Java, and Python (primary Spark development languages).

- Experience in tuning of distributed systems at scale.

- Core contributions to Apache open source projects (Spark, Kafka, Hive, or similar).

- Advanced level of English.

How we make your work (and your life) easier:

- Excellent compensation in USD or your local currency if preferred.

- Paid parental leave, vacation, & national holidays.

- Innovative and multicultural work environment.

- Collaborate and learn from the global Top 1% of talent in each area.

- Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact

Apply now


  • Apache Spark E0

    1 week ago


    Bengaluru, India Teamware Solutions Full time

    Job Description We are looking for a motivated Apache Spark Developer (Entry Level) to join our data engineering team. The ideal candidate will learn to design, develop, and maintain large-scale data processing applications using Apache Spark and related big data technologies. Key Responsibilities: - Assist in developing batch and real-time data processing...


  • Bengaluru, India BairesDev Full time

    Job Description At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this...

  • Apache Spark

    2 weeks ago


    Bengaluru, India Coppergate Consultancy Pvt.Ltd Full time

    Process Apache Spark is an open-source, distributed processing system used for big data workloads. It utilizes in-memory caching, and optimized query execution for fast analytic queries against data of any size. No of Openings 3 Gender male/female About Process Apache Spark is a data processing framework that can quickly perform processing tasks on very...

  • Spark/Scala Developer

    3 weeks ago


    Bengaluru, India HARP Technologies and Services Full time

    Notice Period : Immediate to 30 DaysJob Summary :We are looking for experienced Spark Scala Developers to join our growing team. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.Key Responsibilities...

  • Apache Spark

    1 week ago


    Bengaluru, India Teamware Solutions Full time

    Job Description Responsibilities: - Develop and maintain data processing workflows using Apache Spark and Scala - Implement batch and streaming data pipelines - Optimize Spark jobs for better performance and scalability - Collaborate with data engineers and analysts to deliver data solutions - Debug and resolve issues in production big data environments -...


  • Bengaluru, India BairesDev Full time

    Job Description At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this...


  • Bengaluru, India BairesDev Full time

    Job Description At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this...

  • Senior Java Developer

    4 weeks ago


    Bengaluru, India BairesDev Full time

    Job Description At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this...

  • Sr Backline Engineer

    4 weeks ago


    Bengaluru, India Databricks Full time

    Mission Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...

  • Sr Backline Engineer

    4 weeks ago


    Bengaluru, India Databricks Full time

    Mission Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...