Senior Spark/Scala Developer

7 days ago

Chennai, Tamil Nadu, India BNP Paribas Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Position Purpose

The Senior Spark Developer will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand underlying data. Additionally, the candidate should have an interest in exploring open-source applications distributed by Apache, Kubernetes, OpenSearch and Oracle.

Responsibilities

Direct Responsibilities

  • Integrate and upgrade the Quantexa tool with our existing systems for enhanced anti-money laundering measures.
  • Develop and maintain Spark-based applications deployed on Kubernetes clusters.
  • Conduct data analysis to understand and interpret underlying data structures.
  • Collaborate with cross-functional teams to ensure seamless integration and functionality.
  • Stay updated with the latest trends and best practices in Spark development and Kubernetes.

Contributing Responsibilities

  • Work on tasks assigned by Lead independently. Take ownership of tasks assigned.
  • Adhering to the given timelines by Lead with first time right
  • Develop programs in optimal manner without compromising core architecture/design
  • Work on the technologies efficiently and produce best fit deliveries
  • Be proactive and provide status to the team lead.
  • Adheres to all compliance & project related processes
  • Gain functional knowledge on applications worked upon
  • Upgrade Technical skill by self-learning/taking

Technical & Behavioral Competencies

Key Responsibilities

  • Integrate and upgrade the Quantexa tool with our existing systems for enhanced anti-money laundering measures.
  • Develop and maintain Spark-based applications deployed on Kubernetes clusters.
  • Conduct data analysis to understand and interpret underlying data structures.
  • Collaborate with cross-functional teams to ensure seamless integration and functionality.
  • Stay updated with the latest trends and best practices in Spark development and Kubernetes.

Required Qualifications

  • 5+ years of experience in development
  • Extensive experience in Hadoop, Spark, Scala development (5 years min).
  • Strong analytical skills and experience in data analysis (SQL), data processing (such as ETL), parsing, data mapping and handling real-life data quality issues.
  • Excellent problem-solving abilities and attention to detail.
  • Strong communication and collaboration skills.
  • Experience in Agile development

  • High quality coding skill, incl. code control, unit testing, design, and documentation (code, test). Experience with tools such as sonar. Experience with GIT, Jenkins.

    Specific Qualifications (if required)
    - Experience with development and deployment of spark application and deployment on Kubernetes clusters
    - Hands-on development experience (Java, Scala, etc.) via system integration projects, Python, Elastic (optional).

  • Scala Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Path Mentors Staffing Solution Full time ₹ 12,50,000 - ₹ 25,00,000 per year

    Scala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions Required Candidate profileScala/Spark Developer with 5+ years' experience in building scalable data...

  • Spark Scala Developer

    4 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS!!!!TCS is looking for Spark Scala DeveloperExperience: 6-8 yearsLocation: ChennaiMUST HAVE SKILLS:Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow.Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration and cluster...

  • BigData- Spark/Scala

    6 days ago

    Chennai, Tamil Nadu, India Prodapt Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Overview Big Data, Spark Scala strong  Responsibilities Big Data, Spark Scala strong  Requirements Big Data, Spark Scala strong 

  • Spark Scala Python

    4 days ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal...

  • Scala Lead Engineer

    3 days ago

    Chennai, Tamil Nadu, India Techominds Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Summary:Skills: Lead Data Eng with Scala, Spark, Pyspark & DatabricksJob Title: Data Engineer (Scala, Spark, Pyspark, Databricks)Location: ChennaiResponsibilities:Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data...

  • Scala Developer

    3 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Role : Scala DeveloperExp : 4+ year Location : Pune,Chennai, Kolkata, Hyderabad, Gurgoan, Functional Skills: Experience in Credit Risk/Regulatory risk domain Technical Skills: Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix shell scripting Good to Have Skills: Exposure to Machine Learning TechniquesJob Description:4+ Years of experience with...

  • Data Engineer with Spark and Scala

    2 weeks ago

    Chennai, Tamil Nadu, India KRG Technologies Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Roles and ResponsibilitiesDesign, develop, test, deploy, and maintain large-scale data pipelines using Scala programming language.Collaborate with cross-functional teams to gather requirements and deliver high-quality ETL solutions.Develop complex SQL queries to extract insights from various databases (Oracle, Postgres) and transform them into actionable...

  • Senior Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per year

    Role: Senior Data Engineer (Scala Specialist)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and...

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 40,00,000 per year

    Role: Lead Data EngineerLocation: ChennaiMode: HybridType: PermanentJob Description:ob Description:We are looking for a Senior Data Engineer with strong expertise in Scala, Apache Spark, and PySpark to join our team for a high-impact project. The ideal candidate will play a leading role in developing and optimizing big data solutions on cloud-based platforms...

  • Scala Developer

    3 days ago

    Chennai, Tamil Nadu, India GEETHA TECHNOLOGY SOLUTIONS PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking an experienced Scala/Akka Microservices Developer to join our team in building robust, scalable, and high-performance distributed systems. The ideal candidate will have strong hands-on experience in Scala programming, Akka framework (including Akka Streams), and microservices design principles. You will be working on event-driven...