Scala/Spark Developer

17 hours ago

Bengaluru Chennai Pune, India Photon Full time ₹ 6,00,000 - ₹ 8,00,000 per year

About The Role  

  • Develop, test, and deploy data processing applications using Apache Spark and Scala.

  • Optimize and tune Spark applications for better performance on large-scale data sets.

  • Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.
  • Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions.
  • Design and implement high-performance data processing and analytics solutions.
  • Ensure data integrity, accuracy, and security across all processing tasks.
  • Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies.
  • Implement version control and CI/CD pipelines for Spark applications.
  • Required Skills & Experience:
  • Minimum 8 years of experience in application development.
  • Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing.
  • Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
  • Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi.
  • Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data.
  • Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL.
  • Knowledge of data warehousing concepts, dimensional modeling, and data lakes.
  • Ability to troubleshoot and optimize Spark and Cloudera platform performance.
  • Familiarity with version control tools like Git and CI/CD tools (e.g., Jenkins, GitLab).

  • Scala Spark Developer

    4 days ago

    Chennai, India Path Mentors Staffing Solution Full time

    Scala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions Required Candidate profile Scala/Spark Developer with 5+ years' experience in building scalable data...

  • Spark Scala Developer

    20 hours ago

    Chennai, Tamil Nadu, India Infotel UK Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position: Spark Scala DeveloperCompany: Infotel IndiaAt Infotel UK, a premier technology consulting firm, we are seeking a skilled Spark Scala Developer to join our dynamic team. In this role, you will leverage your expertise in Spark and Scala to design and implement advanced data processing solutions that drive insights and provide value to our clients....

  • Spark/Scala Developer

    2 weeks ago

    Chennai, Tamil Nadu, India HARP Technologies and Services Full time

    Notice Period : Immediate to 30 DaysJob Summary :We are looking for experienced Spark Scala Developers to join our growing team. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.Key Responsibilities...

  • Spark Scala

    5 days ago

    Bengaluru, India Techys Digital Full time

    **Experience**:4-8 Years of Exp. **Location -** Bangalore / Pune **(Multiple Positions) | Immediate to 30 days notice joining need to apply** **Description**: - In depth understanding/knowledge of Hadoop & spark Architecture and its components such as HDFS, Job Tracker, Task Tracker,executor cores and memory params. - Experience in Hadoop development,...

  • Spark Scala Developer

    5 days ago

    Bengaluru, Chennai, India Mwidm Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Location: Bengaluru/ChennaiExperience: 6+ Years Skill requires:Spark, Scala, Apache, SQL, Hive, Hadoop, Shell Scripting Good to have: Control-M, Tableau

  • Spark & Scala Developer

    1 week ago

    Chennai, Tamil Nadu, India Dinoxo IT Consulting Full time

    Responsibilities :- At least 8+ years of experience and strong knowledge in Scala programming language.- Able to write clean, maintainable and efficient Scala code following best practices.- Good knowledge on the fundamental Data Structures and their usage- At least 8+ years of experience in designing and developing large scale, distributed data processing...

  • Spark/Scala Developer

    2 weeks ago

    Bengaluru, Karnataka, India Cyanous Software Private Limited Full time

    Detailed JD (Roles and Responsibilities) :- At least 8+ years of experience and strong knowledge in Scala programming language.- Able to write clean, maintainable and efficient Scala code following best practices.- Good knowledge on the fundamental Data Structures and their usage - At least 8+ years of experience in designing and developing large scale,...

  • Senior Apache Spark Scala Developer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDevelopment Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Apache Spark Scala DeveloperJob Description:We are seeking a skilled and experienced Senior Apache Spark Scala developer to join our team. The successful candidate will have expertise in designing, developing, and deploying scalable data pipelines using Apache Spark Core, SQL, Streaming, MLlib, etc., with Scala.Key Responsibilities:Design and develop...

  • Spark-Scala Professional

    4 days ago

    Pune, India IDESLABS PRIVATE LIMITED Full time

    skills Spark-Scala Experience 6+ Years Location PAN INDIA Job type Contract to Hire Work Model Hybrid Hands on experience of 4-5 years on Spark-Scala combination Awareness of Hive DB Awareness and experience of working on Hadoop platform Good SQL knowledge NP

  • Scala Spark

    3 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Scala Spark Exp: 5 to 9 yrs Location: Bengaluru, Pune, Mumbai & Chennai Notice period: Less than 30 days Thanks & Regards, Indumati N