
Apache Spark Data Processing Specialist
2 weeks ago
We are seeking a skilled Apache Spark developer to join our team. The ideal candidate will possess expertise in designing, developing, and maintaining large-scale data processing applications using Apache Spark and related big data technologies.
Key Responsibilities:- Assist in creating efficient batch and real-time data processing pipelines using Apache Spark.
- Write high-performance Spark jobs utilizing Scala, Java, or Python (PySpark).
- Collaborate with data engineers and analysts to comprehend data requirements.
- Optimize Spark jobs for performance and scalability.
- Participate in data cleansing, transformation, and aggregation tasks.
- Leverage best practices for coding, testing, and debugging.
- Support the deployment and monitoring of Spark applications.
- Deep understanding of Spark architecture and components (RDD, DataFrame, Dataset)
- Advanced experience in Spark programming (Scala/Java/Python)
- Familiarity with Spark SQL and DataFrame API
- Knowledge of batch and streaming data processing
- A collaborative work environment
- Opportunities for professional growth and development
- A competitive compensation package
This is an excellent opportunity for individuals passionate about big data and machine learning to contribute to cutting-edge projects.
-
Apache Spark/Trino Support Engineer
2 weeks ago
Bengaluru, Karnataka, India Bharat Head Hunters Full timeJob Title : Support Engineer Apache Spark with Druid/Trino (L1 Support)Location : Bangalore, Chennai, HyderabadExperience : 4 to 11 YearsEmployment Type : Full-time We are seeking a dedicated Support Engineer with strong experience in Apache Spark along with Druid or Trino to provide Level 1 production support in a high-performance big data environment....
-
Senior Data Engineer
6 days ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000Job Summary:We are seeking a Senior Data Engineer with expertise in Apache Spark to join our team. As a Senior Data Engineer, you will be responsible for designing and developing scalable data processing solutions using AWS EMR and Apache Spark.About the Role:This is an exciting opportunity to work with a talented team of data engineers and scientists to...
-
Data Engineer – Scala + Spark
7 days ago
Bengaluru, Karnataka, India Axheleon IT Services Private Limited Full timeJob DescriptionJob Title: Data Engineer Scala + SparkLocation: Bangalore (Hybrid/On-site)Experience: 5 to 8 Years (Minimum 4 Years of Relevant Experience in Scala & Spark)Budget: Up to 25 LPANotice Period: Immediate to 30 Days MaxAbout the Role:We are looking for a skilled and experienced Data Engineer with strong expertise in Scala, Apache Spark, and SQL to...
-
Senior Data Processing Specialist
2 weeks ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878Big Data EngineerThe role of a Big Data Engineer is to design, build and maintain large-scale data processing systems. Our ideal candidate will have hands-on experience with AWS EMR and Apache Spark, as well as a strong understanding of distributed systems architecture and cluster resource management.Key Responsibilities:Design and implement scalable data...
-
Apache Druid Specialist
2 weeks ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Apache Druid Data EngineerAbout the Role:We seek an experienced Apache Druid engineer to design, implement and maintain large-scale data processing systems.A strong understanding of real-time analytics, OLAP systems, and columnar storage is essential for success in this role.The ideal candidate will be proficient in SQL, query optimization, and data modeling...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000Job Title: Data Engineering Specialist We are seeking a skilled Data Engineering Specialist to design, develop and maintain big data applications using Apache Spark with Scala. The ideal candidate will have hands-on expertise in workflow management tools like Oozie and data flow platforms such as Apache NiFi. The successful candidate will be responsible...
-
Data Engineering Specialist
2 weeks ago
Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 20,00,000Job Title:Data Engineering SpecialistWe are seeking an experienced professional to lead the design and implementation of data processing solutions. The ideal candidate will have a strong background in working with Apache Spark and PySpark, with hands-on experience in coding, testing, and deployment.Key Responsibilities:Design efficient data processing...
-
Scalable Data Processing Specialist
2 weeks ago
Bengaluru, Karnataka, India beBeeDataExpert Full time ₹ 15,00,000 - ₹ 25,00,000Are you a seasoned data expert with expertise in scalable system design and Apache Spark development?Data Systems ExpertWe are seeking a highly skilled individual to lead the design and development of our data processing systems.The ideal candidate will have experience with big data technologies, cloud-based architectures, and agile...
-
Senior Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India beBeeData Full timeBig Data Processing with Spark TechnologyThis is a challenging role that requires the candidate to have hands-on experience in working with large datasets and Big Data technologies such as Apache Spark.The ideal candidate should have a solid understanding of data processing, distributed computing, and data storage.We are looking for highly skilled...
-
Senior Java/Spark Developer
1 week ago
Bengaluru, Karnataka, India EdgeVerve Full timeOrganization : Infosys LimitedExperience : 5+ YrsMust Have skills : Java, Apache Spark, Spark Streaming, Database/SQLDesirable Skills : UNIX shell scriptingJob Description :- Minimum 6+ years of experience and strong knowledge in Java and related frameworks.- Expertise in building robust, scalable and maintainable applications with Java and Spark.- Able to...