Spark, Scala

4 days ago

Hyderabad, Telangana, India Cognizant Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Key skills: Spark, Scala

Experience: 6 to 12 years

Location: AIA Hyderabad

Job description

  • Develop, test, and deploy data processing applications using Apache Spark and Scala.

  • Optimize and tune Spark applications for better performance on large-scale data sets.

  • Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.

  • Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions.

  • Design and implement high-performance data processing and analytics solutions.

  • Ensure data integrity, accuracy, and security across all processing tasks.

  • Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies.

  • Implement version control and CI/CD pipelines for Spark applications.

Required Skills & Experience:

  • Minimum 8 years of experience in application development.

  • Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing.

  • Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.

  • Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi.

  • Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data.

  • Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL.

  • Knowledge of data warehousing concepts, dimensional modeling, and data lakes.

  • Ability to troubleshoot and optimize Spark and Cloudera platform performance.

  • Familiarity with version control tools like Git and CI/CD tools (e.g., Jenkins, GitLab).

  • Spark Scala Developer

    2 weeks ago

    Hyderabad, Telangana, India Unify Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesWe are looking for a candidate with strong experience into Spark Core/Streaming, Spark RDD API, Spark Dataframes API  with Scala with Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good...

  • Scala Spark Bigdata Engineer

    2 weeks ago

    Hyderabad, Telangana, India Talent21 Full time ₹ 7,00,000 - ₹ 16,00,000 per year

    Scala & Spark - Intermediate/Advanced level is a mandate.Data structures and algorithms in Scala.Minimum 4+ years of experience in Scala/Spark.4. Need to have a big-data background

  • Spark/Scala Developer

    2 weeks ago

    Hyderabad, Telangana, India Unify Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job DescriptionWe are looking for a candidate with strong experience intoSparkwithScalawith Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good understanding of Big Data (Hadoop, MapReduce, Kafka, Cassandra)...

  • Scala Developer

    4 days ago

    Hyderabad, Telangana, India Wroots Global Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Skill : Scala + SparkExp : 5 to 9YearsLoc : HyderabadNotice : Immediate to 30DaysKey Qualifications5+ years of experience working in a software product development organization building modern and scalable big data applicationsExpertise with functional programming, preferably ScalaFluency in Hadoop technologies and big data processing technologies,...

  • Scala Java Developer

    6 days ago

    Hyderabad, Telangana, India vave technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Position: Scala Developer with Strong Java ExperienceLocation: Madhapur HyderabadPosition Type: Permanent , Night ShiftSalary: DOEExperience: Min. 7+ years requiredLooking for Full Stack Eng Offshore with below skill sets.Git Spark - for batch(scheduled) jobsSpark Streaming - for streaming jobsKafka - source/sink for jobs, used by Spark/Spark StreamingKafka...

  • Scala Developer

    2 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Desired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not bemore than 3-5) Hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting Should be comfortable with Unix File system as well as HDFS commands Should have worked on query languages such as...

  • Scala Developer with Java

    7 days ago

    Hyderabad, Telangana, India NMK Global Incorporation Full time ₹ 4,22,000 - ₹ 20,00,000 per year

    NMK Global Incorporation is hiring – Scala Engineer/Developer with JavaLocation: Hitech City, Hyderabad, Telangana (Offshore)Experience : 7+ YearsDuration : FulltimeWe are seeking a Scala Developer / Engineer with strong Java expertise to design and build scalable, high-performance data and backend solutions for enterprise applications.Key...

  • Scala Developer

    2 weeks ago

    Hyderabad, Telangana, India Talent21 Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Scala/Play - 5+ years experienceLocation: HYD onlyScala/Spark/PlayJob SummaryWe are looking for engineering leads who can be part of the team building massive, scalable, distributed systems that process geospatial data at scale to power our products.Key Qualifications• years of experience working in a software product development organization building...

  • Java Developer With Scala

    1 week ago

    Hyderabad, Telangana, India NMK Global Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Skills:Scala, Java, Apache Spark, Spark Streaming, Kafka, Databricks, Azure Data Factory, SQL, Maven/Gradle, Grafana, Collibra.If Interested:Share your resume to , WhatsApp

  • Scala Developer(AWS)

    2 days ago

    Hyderabad, Telangana, India Viraaj HR Solutions Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Primary title:Scala DeveloperAbout The OpportunityA technology services organisation in the IT & Cloud Software sector building scalable, data-intensive backend platforms and real-time analytics pipelines on AWS. We are hiring an on-site Scala Developer in India to own backend services and streaming solutions that deliver low-latency, high-throughput...