Spark Scala

2 days ago

Bengaluru, India Techys Digital Full time

**Experience**:4-8 Years of Exp.

**Location -** Bangalore / Pune

**(Multiple Positions) | Immediate to 30 days notice joining need to apply**

**Description**:

- In depth understanding/knowledge of Hadoop & spark Architecture and its components such as HDFS, Job Tracker, Task Tracker,executor cores and memory params.
- Experience in Hadoop development, working experience on SPARK, SCALA is mandatory and Database exposure is must
- Expertise in writing Hadoop/spark Jobs for analyzing data using Spark, Scala, Hive, Kafka and Python
- Experienced with streaming work flow operations.
- Integration with Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions. Experience in Data Warehousing and ETL processes.
- Strong database, SQL, ETL and data analysis skills.
- Knowledge in Maintaining the Log and Audit information in Hive/SQL tables, Experienced in providing Logging, Error Handling
- Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
- Configured Spark Streaming to receive real time data from the Apache Kafka and store the stream data to HDFS using Scala.
- Experienced Scheduling jobs using Airflow/ESP.
- Experienced in developing scripts for doing transformations using Scala.
- Involved in developing Shell scripts to orchestrate execution of all other scripts and move the data files within and outside of HDFS.
- Using Kafka on publish-subscribe messaging as a distributed commit log, have experienced in its fast, scalable and durability.
- Implemented Kerberos Security Authentication protocol for existing cluster
- To be able to understand existing business logic & implement the business changes
- Working with business and peers to define, estimate, and deliver functionality.
- Should have gone through entire development life cycle including system integration testing
- Provide Production Support for any issues raised by the Business and experience on Production/Integration release management
- Experience with GIT, Jenkins, test frameworks.

**TECHNICAL SKILLS**:

- Hadoop/Big Data/ HDFS/ Scala/ Spark/ Hive/ Python/ Kafka
- Zookeeper/ Shell Scripting
- Java experience is a plus
- GIT Version control tool knowledge, Jenkins and Scheduling tools Airflow & ESP

  • Scala Spark

    3 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Scala Spark Exp: 5 to 9 yrs Location: Bengaluru, Pune, Mumbai & Chennai Notice period: Less than 30 days Thanks & Regards, Indumati N

  • Scala Spark

    2 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Scala Spark Exp: 5 to 9 yrs Location: Bengaluru, Pune, Mumbai & Chennai Notice period: Less than 30 days Thanks & Regards, Indumati N

  • Scala Spark

    2 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Scala SparkExp: 5 to 9 yrsLocation: Bengaluru, Pune, Mumbai & ChennaiNotice period: Less than 30 daysThanks & Regards,Indumati NIndumati.nakate@alphacom.inhttps://www.linkedin.com/company/alphacom-systems-and-solutions-pvt-ltd/www.alphacom.in

  • Scala Spark

    2 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Scala SparkExp: 5 to 9 yrsLocation: Bengaluru, Pune, Mumbai & ChennaiNotice period: Less than 30 daysThanks & Regards,Indumati NIndumati.nakate@alphacom.inwww.alphacom.in

  • Scala Spark

    2 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Scala SparkExp: 5 to 9 yrsLocation: Bengaluru, Pune, Mumbai & ChennaiNotice period: Less than 30 daysThanks & Regards,Indumati NIndumati.nakate@alphacom.inwww.alphacom.in

  • Spark-Scala Position

    2 weeks ago

    Bengaluru, Chennai, Pune, India Orcapod Consulting Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position: Spark-ScalaWork location : Bangalore , Chennai, Hyderabad, Pune, Chandigarh.Type: C2H (Convert into Full-Time Employment (FTE) within 90 days)Experience: 8-10 yrs.Skillsets:Mandatory skills - Spark & ScalaDesired skills - Spark Streaming, Hadoop, Hive, SQL, Sqoop, ImpalaJoining: Immediate joiner or 15 to 30 days

  • Scala Spark

    2 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Scala SparkExp: 5 to 9 yrsLocation: Bengaluru, Pune, Mumbai & ChennaiNotice period: Less than 30 daysThanks & Regards,Indumati NIndumati.nakate@alphacom.inhttps://www.linkedin.com/company/alphacom-systems-and-solutions-pvt-ltd/www.alphacom.in

  • Data Engineer – Scala + Spark

    6 days ago

    Bengaluru, Karnataka, India Axheleon IT Services Private Limited Full time

    Job DescriptionJob Title: Data Engineer Scala + SparkLocation: Bangalore (Hybrid/On-site)Experience: 5 to 8 Years (Minimum 4 Years of Relevant Experience in Scala & Spark)Budget: Up to 25 LPANotice Period: Immediate to 30 Days MaxAbout the Role:We are looking for a skilled and experienced Data Engineer with strong expertise in Scala, Apache Spark, and SQL to...

  • Scala and Spark Developer Opportunities

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataProcessor Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Opportunity:We are seeking a highly skilled Scala and Spark developer to join our team. Main Responsibilities:Design, develop, and maintain large-scale data processing systems using Scala and Spark.Analyze and optimize system performance, scalability, and reliability.Collaborate with cross-functional teams to identify business requirements and implement...

  • Spark/Scala Developer

    2 weeks ago

    Bengaluru, Karnataka, India Cyanous Software Private Limited Full time

    Detailed JD (Roles and Responsibilities) :- At least 8+ years of experience and strong knowledge in Scala programming language.- Able to write clean, maintainable and efficient Scala code following best practices.- Good knowledge on the fundamental Data Structures and their usage - At least 8+ years of experience in designing and developing large scale,...