Senior Spark/Scala Developer

5 days ago

Chennai, Tamil Nadu, India BNP Paribas Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Position Purpose

The Senior Spark Developer will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand underlying data. Additionally, the candidate should have an interest in exploring open-source applications distributed by Apache, Kubernetes, OpenSearch and Oracle.

Responsibilities

Direct Responsibilities

  • Integrate and upgrade the Quantexa tool with our existing systems for enhanced anti-money laundering measures.
  • Develop and maintain Spark-based applications deployed on Kubernetes clusters.
  • Conduct data analysis to understand and interpret underlying data structures.
  • Collaborate with cross-functional teams to ensure seamless integration and functionality.
  • Stay updated with the latest trends and best practices in Spark development and Kubernetes.

Contributing Responsibilities

  • Work on tasks assigned by Lead independently. Take ownership of tasks assigned.
  • Adhering to the given timelines by Lead with first time right
  • Develop programs in optimal manner without compromising core architecture/design
  • Work on the technologies efficiently and produce best fit deliveries
  • Be proactive and provide status to the team lead.
  • Adheres to all compliance & project related processes
  • Gain functional knowledge on applications worked upon
  • Upgrade Technical skill by self-learning/taking

Technical & Behavioral Competencies

Key Responsibilities

  • Integrate and upgrade the Quantexa tool with our existing systems for enhanced anti-money laundering measures.
  • Develop and maintain Spark-based applications deployed on Kubernetes clusters.
  • Conduct data analysis to understand and interpret underlying data structures.
  • Collaborate with cross-functional teams to ensure seamless integration and functionality.
  • Stay updated with the latest trends and best practices in Spark development and Kubernetes.

Required Qualifications

  • 5+ years of experience in development
  • Extensive experience in Hadoop, Spark, Scala development (5 years min).
  • Strong analytical skills and experience in data analysis (SQL), data processing (such as ETL), parsing, data mapping and handling real-life data quality issues.
  • Excellent problem-solving abilities and attention to detail.
  • Strong communication and collaboration skills.
  • Experience in Agile development

  • High quality coding skill, incl. code control, unit testing, design, and documentation (code, test). Experience with tools such as sonar. Experience with GIT, Jenkins.

    Specific Qualifications (if required)
    - Experience with development and deployment of spark application and deployment on Kubernetes clusters
    - Hands-on development experience (Java, Scala, etc.) via system integration projects, Python, Elastic (optional).

  • BigData- Spark/Scala

    7 days ago

    Chennai, Tamil Nadu, India Prodapt Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Overview Big Data, Spark Scala strong  Responsibilities Big Data, Spark Scala strong  Requirements Big Data, Spark Scala strong 

  • Spark Scala Python

    3 days ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal...

  • Scala Developer

    2 weeks ago

    Chennai, Tamil Nadu, India NoblQ Full time ₹ 13,57,901 per year

    Job Title: Scala DeveloperLocation: Chennai, IndiaAbout Propel At Propel, we don't just build software — we build intelligent, human-centered digital platforms that solve real-world problems. As a design-led technology firm, we combine deep engineering expertise with a passion for scalable, elegant solutions. Join a team where innovation, ownership, and...

  • Scala Lead Engineer

    1 day ago

    Chennai, Tamil Nadu, India Techominds Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Summary:Skills: Lead Data Eng with Scala, Spark, Pyspark & DatabricksJob Title: Data Engineer (Scala, Spark, Pyspark, Databricks)Location: ChennaiResponsibilities:Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data...

  • Senior Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per year

    Role: Senior Data Engineer (Scala Specialist)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and...

  • Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    ETL Developer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) using Apache Spark and Python. This role required deep understanding of data engineering principles, proficiency in Python and hands-on experience with Spark and Hadoop ecosystems....

  • Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewETL Developer will be responsible for designing, implementing, and...

  • Senior Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India MOURI Tech Foundation Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions. Candidates with prior exposure to the Ericsson Wallet Platform will be given preference.Key ResponsibilitiesDevelop, test, and deploy high-performance data pipelines using Hadoop, Spark, Kudu, and HBase.Implement ETL/ELT workflows and ensure data...

  • Senior Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Barclays Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Join us as a Senior Developer at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. As a part of the team, you will deliver technology stack, using strong analytical and problem...

  • Senior Data Engineer

    7 days ago

    Chennai, Tamil Nadu, India Info Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title: Senior Data EngineerJob SummaryWe are looking for a highly skilledSenior Data Engineerwith expertise in designing, building, and optimizing large-scale data pipelines and integration frameworks. The ideal candidate will have strong experience inbatch and near real-time data processingwithin theAWS ecosystem, with hands-on exposure toDatabricks,...