Apache Spark
4 days ago
Job Description Responsibilities: - Develop and maintain data processing workflows using Apache Spark and Scala - Implement batch and streaming data pipelines - Optimize Spark jobs for better performance and scalability - Collaborate with data engineers and analysts to deliver data solutions - Debug and resolve issues in production big data environments - Integrate with data storage systems like HDFS, Kafka, and NoSQL databases - Write clean, maintainable code with best practices in mind Required Skills: - Strong programming skills in Scala and hands-on experience with Apache Spark - Knowledge of Spark Core, Spark SQL, Spark Streaming, and MLlib - Experience with Hadoop ecosystem components (HDFS, Hive, Kafka) - Familiarity with functional programming concepts - Experience with data serialization formats (Parquet, Avro, ORC) - Version control (Git) and CI/CD understanding - Good problem-solving and communication skills
-
Apache Spark E0
4 days ago
Bengaluru, India Teamware Solutions Full timeJob Description We are looking for a motivated Apache Spark Developer (Entry Level) to join our data engineering team. The ideal candidate will learn to design, develop, and maintain large-scale data processing applications using Apache Spark and related big data technologies. Key Responsibilities: - Assist in developing batch and real-time data processing...
-
Apache Spark
7 days ago
Bengaluru, India Coppergate Consultancy Pvt.Ltd Full timeProcess Apache Spark is an open-source, distributed processing system used for big data workloads. It utilizes in-memory caching, and optimized query execution for fast analytic queries against data of any size. No of Openings 3 Gender male/female About Process Apache Spark is a data processing framework that can quickly perform processing tasks on very...
-
Apache Spark Professional
2 weeks ago
Bengaluru, Chennai, Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled professional with expertise in Apache Spark to join our team. The ideal candidate will have 7-10 years of experience and be based in Pune, Bangalore, GNDc, Chennai, Coimbatore, or Hyderabad.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Apache Spark.Collaborate with...
-
Spark/Scala Developer
2 weeks ago
Bengaluru, India HARP Technologies and Services Full timeNotice Period : Immediate to 30 DaysJob Summary :We are looking for experienced Spark Scala Developers to join our growing team. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.Key Responsibilities...
-
Principal Scala Engineer
15 hours ago
Bengaluru, India BairesDev Full timeJob Description At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this...
-
Senior Apache Spark Expert
2 weeks ago
Bengaluru, Karnataka, India Relanto Full time ₹ 20,00,000 - ₹ 25,00,000 per yearPosition - Senior Apache Spark ExpertExperience:6 + yearsLocation:Bangalore (WFO only)Qualification:Bachelor's degree in computer science, Engineering, or a related field (preferred)Immediate joiners onlyJob DescriptionStrong knowledge of Spark architecture, able to set up, manage and admin Spark cluster with Kubernetes, Strong on Scala, build efficient ETL...
-
Sr Backline Engineer
4 weeks ago
Bengaluru, India Databricks Full timeMission Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...
-
Sr Backline Engineer
3 weeks ago
Bengaluru, India Databricks Full timeMission Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...
-
Apache spark with cloud Professional
1 week ago
Bengaluru, Chennai, Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled professional with expertise in Apache Spark and cloud technologies to join our team. The ideal candidate will have 5-7 years of experience.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Apache Spark.Collaborate with cross-functional teams to integrate Spark applications with cloud...
-
Data Engineer
2 days ago
Bengaluru, India Ixceed Solutions Full timeResponsibilities :- Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.- Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency.- Optimize Spark applications for performance and cost-efficiency within the Databricks...