Spark Scala

18 hours ago

Bengaluru, India Techys Digital Full time

**Experience**:4-8 Years of Exp.

**Location -** Bangalore / Pune

**(Multiple Positions) | Immediate to 30 days notice joining need to apply**

**Description**:

- In depth understanding/knowledge of Hadoop & spark Architecture and its components such as HDFS, Job Tracker, Task Tracker,executor cores and memory params.
- Experience in Hadoop development, working experience on SPARK, SCALA is mandatory and Database exposure is must
- Expertise in writing Hadoop/spark Jobs for analyzing data using Spark, Scala, Hive, Kafka and Python
- Experienced with streaming work flow operations.
- Integration with Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions. Experience in Data Warehousing and ETL processes.
- Strong database, SQL, ETL and data analysis skills.
- Knowledge in Maintaining the Log and Audit information in Hive/SQL tables, Experienced in providing Logging, Error Handling
- Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
- Configured Spark Streaming to receive real time data from the Apache Kafka and store the stream data to HDFS using Scala.
- Experienced Scheduling jobs using Airflow/ESP.
- Experienced in developing scripts for doing transformations using Scala.
- Involved in developing Shell scripts to orchestrate execution of all other scripts and move the data files within and outside of HDFS.
- Using Kafka on publish-subscribe messaging as a distributed commit log, have experienced in its fast, scalable and durability.
- Implemented Kerberos Security Authentication protocol for existing cluster
- To be able to understand existing business logic & implement the business changes
- Working with business and peers to define, estimate, and deliver functionality.
- Should have gone through entire development life cycle including system integration testing
- Provide Production Support for any issues raised by the Business and experience on Production/Integration release management
- Experience with GIT, Jenkins, test frameworks.

**TECHNICAL SKILLS**:

- Hadoop/Big Data/ HDFS/ Scala/ Spark/ Hive/ Python/ Kafka
- Zookeeper/ Shell Scripting
- Java experience is a plus
- GIT Version control tool knowledge, Jenkins and Scheduling tools Airflow & ESP

  • spark scala

    2 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Hi,Greetings from TCS Team!Role Spark Scala DeveloperRequired Technical Skill Set Spark Scala - Coding knowledge expectedDesired Experience Range 6-9 YearsLocation of Requirement TCS - Chennai, Bangalore, Kochi, Pune, BhubaneswarIf you’re interested in the role if the experience, location and skillset match your profile then please share your updated...

  • spark scala

    1 day ago

    Bengaluru, India Tata Consultancy Services Full time

    Hi, Greetings from TCS Team! Role Spark Scala Developer Required Technical Skill Set Spark Scala - Coding knowledge expected Desired Experience Range 6-9 Years Location of Requirement TCS - Chennai, Bangalore, Kochi, Pune, Bhubaneswar If you’re interested in the role if the experience, location and skillset match your profile then please share your updated...

  • spark scala

    2 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Hi, Greetings from TCS Team! Role Spark Scala Developer Required Technical Skill Set Spark Scala - Coding knowledge expected Desired Experience Range 6-9 Years Location of Requirement TCS - Chennai, Bangalore, Kochi, Pune, Bhubaneswar If you’re interested in the role if the experience, location and skillset match your profile then please share your updated...

  • spark scala

    3 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Hi,Greetings from TCS Team!Role Spark Scala DeveloperRequired Technical Skill Set Spark Scala - Coding knowledge expectedDesired Experience Range 6-9 YearsLocation of Requirement TCS - Chennai, Bangalore, Kochi, Pune, BhubaneswarIf you’re interested in the role if the experience, location and skillset match your profile then please share your updated...

  • spark scala

    1 day ago

    Bengaluru, India Tata Consultancy Services Full time

    Hi,Greetings from TCS Team!Role Spark Scala DeveloperRequired Technical Skill Set Spark Scala - Coding knowledge expectedDesired Experience Range 6-9 YearsLocation of Requirement TCS - Chennai, Bangalore, Kochi, Pune, BhubaneswarIf you’re interested in the role if the experience, location and skillset match your profile then please share your updated...

  • spark scala

    2 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Hi,Greetings from TCS Team!Role Spark Scala DeveloperRequired Technical Skill Set Spark Scala - Coding knowledge expectedDesired Experience Range 6-9 YearsLocation of Requirement TCS - Chennai, Bangalore, Kochi, Pune, BhubaneswarIf you’re interested in the role if the experience, location and skillset match your profile then please share your updated...

  • spark scala

    3 days ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Hi,Greetings from TCS Team!Role Spark Scala DeveloperRequired Technical Skill Set Spark Scala - Coding knowledge expectedDesired Experience Range 6-9 YearsLocation of Requirement TCS - Chennai, Bangalore, Kochi, Pune, BhubaneswarIf you’re interested in the role if the experience, location and skillset match your profile then please share your updated...

  • Scala/Spark developer

    1 week ago

    Bengaluru, India People Prime Worldwide Full time

    Our client is a global technology company headquartered in Santa Clara, California. it focuses on helping organisations harness the power of data to drive digital transformation, enhance operational efficiency, and achieve sustainability. over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the power of data from...

  • Scala/Spark Developer

    1 week ago

    Bengaluru, India People Prime Worldwide Full time

    Our client is a global technology company headquartered in Santa Clara, California. it focuses on helping organisations harness the power of data to drive digital transformation, enhance operational efficiency, and achieve sustainability. over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the power of data from...

  • Scala/Spark developer

    2 weeks ago

    Bengaluru, India People Prime Worldwide Full time

    Our client is a global technology company headquartered in Santa Clara, California. it focuses on helping organisations harness the power of data to drive digital transformation, enhance operational efficiency, and achieve sustainability. over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the power of data from...