Spark Scala

1 month ago

Bengaluru, India Cognizant Full time

**Technical Lead**

**Qualification**:
Bachelors in science, engineering or equivalent
**Responsibility**:
**Project Planning and Setup**:

- Understand the project scope, identify activities/ tasks, task level estimates, schedule, dependencies, risks and provide inputs to Module Lead for review.
- Provide inputs to testing strategy, configuration, deployment, hardware/software requirement etc.
- Review plan and provide feedback on gaps, timeline and execution feasibility etc as required in the project.
- Participate in KT sessions conducted by customer/ other business teams and provide feedback on requirements.

**Requirement Understanding and Analysis**:
Strong hands on experience on Spark/Scala
Good Understanding experience in Hadoop, Hive, Oozie, HDFS, YARN, Sqoop
Good understanding in AWS services
Should have experience/understanding of AWS design and architectural concepts

**Design**:

- Prepare the LLD/ detailed design documents based on HLD and briefing from Module Lead.
- Seek inputs from the developers on specific modules as applicable.
- Consolidate all modules and provide to Module Lead/ Architects/ Designers for review.
- Suggest changes in design on technical grounds.
- Develop components inventory for the code to be developed tying it to the nonfunctional requirements.
- Perform sampling of data to understand the character/ quality of the data (project dependent in the absence of data analyst or designer).
- Identify tools and technologies to be used in the project as well as reusable objects that could be customized for the project.

**Coding**:

- Follow coding standards and best practices to develop code and check code quality.
- Share developed code with supervisor for review.
- Rework on the code based on inputs if required.
- Perform complex integration.
- Guide the developers in identifying, preparing and conducting unit test cases and fixing defects based on results.
- Consolidate the test results and share with supervisor.
- Provide periodic status update to supervisor and highlight / recommend any changes in design based on challenges faced.
- Anticipate unreported defects and raise the same to supervisor.
- Conduct technical troubleshooting.
- Conduct reviews for codes created by team.

**Testing Management**:

- Develop unit test case for each module.
- Conduct/ guide conducting of unit and integration testing and fix defects.
- Review/ approve code to be moved to testing environment.
- Provide support to the QA team and coordinate for various phases of testing.
- Address queries raised by QA within defined timelines.
- Investigate critical defects and establish need for fixing.
- Raise issues to leads/QA.
- Report defect status as per project standard process within agreed timelines.
- Share revised code with supervisor for review.
- Assist team lead and project manager on estimates around defect fixes.

**Configuration Management**:

- Maintain versions of the code or consolidate version maintained by the Developers.
- Provide support as required to the Administrators during configuration, code backups, deployment etc.

**Deployment**:

- Assess and create deployment/ roll back plan.
- Validate if all the components have been migrated and the right version is checked in.
- Maintain deployment tracker.
- Perform sanity checks post deployment to ensure smooth production.
- Share activity status with supervisor and highlight concerns if any.

**Project Execution Monitoring & closure (Support to Project Management activities)**:

- Monitor work of the developers and share work achieved with them.
- Provide guidance through SDLC.
- Provide status of progress to leads.
- In case of change requests, provide inputs on the plan.

**Knowledge Management**:

- Post release participate in project review call and discuss points on what went well and what didn't.
- Create and update knowledge articles (case studies, lessons learnt) in the knowledge management repository.
- Guide developers in creating such documents.
- Publish white papers/ blogs/ articles (if required).

**Must Have Skills**

Spark, Scala

**Employee Status **:Full Time Employee

**Shift **:Day Job

**Travel **:No

**Job Posting **:Mar 24 2023

**About Cognizant

  • Spark+ Scala+ SQL

    1 month ago

    Bengaluru, India RARR Technologies Full time

    **Job Details - Spark+ Scala+ SQL**: **Job ID**: - RARR Job 2943**Job Title**: - Spark+ Scala+ SQL**Job Type**: - Permanent**Job Location**: - BENGALURU / BANGALORE, CHENNAI, HYDERABAD, MUMBAI, PUNE**Total Experience**: - 6 - 12 Years**Skills**: - SCALA, SPARK**Posted - **01/02/2023 **Job Description**: **JD Details**: - Should have at least 6 to 12...

  • Bigdata, Spark, Scala, SQL

    1 month ago

    Bengaluru, India RARR Technologies Full time

    **Job Details - Bigdata, Spark, Scala, SQL**: **Job ID**: - RARR Job 2937**Job Title**: - Bigdata, Spark, Scala, SQL**Job Type**: - Permanent**Job Location**: - BENGALURU / BANGALORE, CHENNAI, HYDERABAD, KOLKATA, MUMBAI, PUNE**Total Experience**: - 3 - 12 Years**Skills**: - BIGDATA, SCALA, SPARK, SQL**Posted - **31/01/2023 **Job...

  • Big Data Consultant

    4 weeks ago

    Bengaluru, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Big Data

    1 month ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Good work experience & Proven experience working on Python (Data Engineering), Spark/Scala. Qualifications :Undergraduate

  • Scala/Spark Developer

    4 weeks ago

    Bengaluru, India Edge In Asia Recruitment Private Limited Full time

    Our client is a global investment banking company having its headquarters in the US with 75000+ employees globally and is looking for a Scala / Spark to join their Bangalore regional team.Note : Looking for candidates who can join within 30daysWork Mode : Hybrid Experience : 5 to 8 yearsSome of the key responsibilities will include :- Understand and...

  • Data Lead Engineer

    4 weeks ago

    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    Job Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...

  • Principal Consultant

    3 weeks ago

    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Data Engineer III

    4 weeks ago

    Bengaluru, India Freelance Full time

    Job Description :Key Responsibilities :- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)- Build high-quality data pipelines using Spark/Scala- Implement best software engineering practices, including Git version control, code reviews, and unit testing- Collaborate with data scientists and architects...

  • Data Engineer

    4 weeks ago

    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    Role : Data EngineerLocation : BangaloreExperience : 3+ Yrs.Responsibilities :- Develop and maintain scalable data pipelines for batch processing using Apache Spark in Big Data projects.- Utilize Scala programming language to implement efficient data processing solutions.- Collaborate with cross-functional teams to understand data requirements and design...

  • Big Data

    1 month ago

    Bengaluru, India Riverforest Connections Full time

    **Job Description**: **Strong proficiency Scala + Spark (Hadoop) with Java (mandatory)** Database experience preferably with DB2, Sybase, or Oracle - Complete SDLC process and Agile Methodology (Scrum) - Version control - Git - Spring Skill Desired: - Previous experience in Trade Surveillance or working with data from the order lifecycle - High quality...

  • Principal Consultant

    3 weeks ago

    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Quantexa Developer

    4 weeks ago

    Bengaluru, India IBU Consulting Full time

    Roles And Responsibilities :- Quantexa ETL and Scoring Development, configuration, and enhancements.- Technical delivery of Quantexa implementation utilizing the below support tools and methods.- Agile / DevOps delivery mode.- CI/CD pipelines.- Work with Kubernetes.- Basic understanding of MS Azure and Azure DevOps is a plus .- Hands-on experience with Scala...

  • Senior Data Engineers

    1 month ago

    Bengaluru, India NodeFlair Full time

    JD - primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus.Location: WFH from India1x headcount in 7-10 yrs band (should be flexible for either Malaysia Time Zone or Europe Time Zone)1x...

  • Senior Data Engineers

    2 months ago

    Bengaluru, India NodeFlair Full time

    JD - primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location: WFH from India1x headcount in 7-10 yrs band (should be flexible for either Malaysia Time Zone or Europe Time Zone)1x...

  • Spark, Scala/Java/Python, AWS

    1 week ago

    Bengaluru, India Alp Consulting Limited Full time

    Spark, Scala/Java/Python, AWS (EKS, Lambda, S3)Job Title:Hi Applicants!!!Hiring for a Job in a Reputed Organization (Product and Service based company) .Here is a Gateway to it, through ALP Consulting.RecruitingEmployment Type: PermanentExperience:Skills Required:Excellent Communication SkillsStrong Experience in :Job Location: Pan IndiaNote: Maximum 60 Days...

  • Scala Developer

    4 weeks ago

    Bengaluru, India NUSTAR TECHNOLOGIES INDIA PRIVATE LIMITED Full time

    Job Description- Must have 4+ years of IT experience- Must have good experience in Spark and Scala- Develop and maintain big data applications using Spark and Scala, ensuring high performance, reliability, and scalability.- Implement Spark data processing techniques, performance tuning, memory management, fault tolerance mechanisms, and scalability...

  • Senior Bigdata Engineer with Scala

    2 weeks ago

    Bengaluru, India HTC Global Services Full time

    Job Details:• Should have hands on experience in Software development • Responsible for designing, deploying, and managing high quality data • Create and maintain optimal data architecture pipeline. • Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements and implement data solutions....

  • Senior Bigdata Engineer with Scala

    2 weeks ago

    Bengaluru, India HTC Global Services Full time

    Job Details:• Should have hands on experience in Software development • Responsible for designing, deploying, and managing high quality data • Create and maintain optimal data architecture pipeline. • Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements and implement data solutions....

  • Principal Consultant, Scala

    2 weeks ago

    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Principal Consultant, Scala

    2 weeks ago

    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...