Senior Apache Spark Developer

12 hours ago


Bengaluru India BairesDev Full time

Job Description

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Apache Spark Developer at BairesDev

We are seeking a Senior Apache Spark Developer to work on distributed data processing systems and real-time analytics. You'll contribute to Apache Spark and related ecosystem projects (Kafka, Hive, Iceberg), focusing on performance optimization and scalable architecture.

What You'll Do:

- Contribute actively to Apache Spark and related open source projects as a core contributor.

- Develop and optimize distributed data processing engines for batch and real-time analytical workloads.

- Develop streaming analytics capabilities using Spark Structured Streaming and integration with Apache Kafka.

- Enhance Spark SQL catalyst optimizer and distributed query execution systems.

- Collaborate with engineering teams on system integration and deployment.

What we are looking for:

- 10+ years of experience in software development.

- Strong expertise in distributed computing and large-scale data processing systems.

- Understanding of Apache Spark architecture, including RDDs, DataFrames, and streaming.

- Proficiency in Scala, Java, and Python (primary Spark development languages).

- Experience in tuning of distributed systems at scale.

- Core contributions to Apache open source projects (Spark, Kafka, Hive, or similar).

- Advanced level of English.

How we make your work (and your life) easier:

- Excellent compensation in USD or your local currency if preferred.

- Paid parental leave, vacation, & national holidays.

- Innovative and multicultural work environment.

- Collaborate and learn from the global Top 1% of talent in each area.

- Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact

Apply now


  • Apache Spark

    5 days ago


    Bengaluru, Chennai, Hyderabad, India Advent Global Solutions Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    *Please read complete JD if matching only apply and #Whatsappme *Must have skills : Apache SparkGood to have skills : NAMinimum 5 year(s) of experience is requiredEducational Qualification : 15 years full time educationSummary: As an Application Developer, you will be involved in designing, building, and configuring applications to meet business process and...


  • Bengaluru, Chennai, Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled professional with expertise in Apache Spark to join our team. The ideal candidate will have 7-10 years of experience and be based in Pune, Bangalore, GNDc, Chennai, Coimbatore, or Hyderabad.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Apache Spark.Collaborate with...

  • Senior Java Developer

    12 hours ago


    Bengaluru, India BairesDev Full time

    Job Description At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this...

  • Sr Backline Engineer

    15 hours ago


    Bengaluru, India Databricks Full time

    Mission Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...

  • Sr Backline Engineer

    9 hours ago


    Bengaluru, India Databricks Full time

    Mission Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...


  • Bengaluru, India Databricks Full time

    P-1377 Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the original...


  • Bengaluru, India Databricks Full time

    P-1377 Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...


  • Bengaluru, India BairesDev Full time

    Job Description At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this...


  • Bengaluru, Chennai, Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled professional with expertise in Apache Spark and cloud technologies to join our team. The ideal candidate will have 5-7 years of experience.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Apache Spark.Collaborate with cross-functional teams to integrate Spark applications with cloud...


  • Bengaluru, India BairesDev Full time

    Job Description At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this...