Spark Scala Python

3 days ago

Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Job Summary

Join our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal advancements through data-driven insights.

Responsibilities

  • Develop and implement scalable data processing solutions using Spark and Scala to enhance data analytics capabilities.
  • Collaborate with data scientists and analysts to optimize data workflows and ensure efficient data processing.
  • Design and maintain data pipelines using SparkSQL and Python to support business intelligence initiatives.
  • Troubleshoot and resolve technical issues related to Spark applications to ensure seamless data operations.
  • Conduct code reviews and provide feedback to team members to maintain high-quality code standards.
  • Participate in agile development processes to deliver projects on time and within scope.
  • Analyze complex data sets to identify trends and insights that drive business decisions.
  • Document technical specifications and processes to ensure knowledge sharing and continuity.
  • Stay updated with the latest industry trends and technologies to continuously improve data solutions.
  • Work closely with stakeholders to understand requirements and translate them into technical solutions.
  • Ensure data security and compliance with company policies and industry regulations.
  • Provide technical support and guidance to junior developers to foster a collaborative team environment.
  • Contribute to the companys mission by delivering data-driven solutions that positively impact society.

Qualifications

  • Possess a strong background in Spark Scala Python and SparkSQL with a minimum of 5 years of experience.
  • Demonstrate proficiency in designing and implementing data pipelines and workflows.
  • Exhibit excellent problem-solving skills and the ability to troubleshoot complex technical issues.
  • Show experience in working within agile development environments and delivering projects on time.
  • Have a keen understanding of data security and compliance requirements.
  • Display strong communication skills to effectively collaborate with cross-functional teams.
  • Be committed to continuous learning and staying updated with industry advancements.

Certifications Required

Certified Spark Developer Python for Data Science Certification

  • BigData- Spark/Scala

    7 days ago

    Chennai, Tamil Nadu, India Prodapt Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Overview Big Data, Spark Scala strong  Responsibilities Big Data, Spark Scala strong  Requirements Big Data, Spark Scala strong 

  • Senior Spark/Scala Developer

    5 days ago

    Chennai, Tamil Nadu, India BNP Paribas Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Position Purpose The Senior Spark Developer will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand...

  • Scala Developer

    2 weeks ago

    Chennai, Tamil Nadu, India NoblQ Full time ₹ 13,57,901 per year

    Job Title: Scala DeveloperLocation: Chennai, IndiaAbout Propel At Propel, we don't just build software — we build intelligent, human-centered digital platforms that solve real-world problems. As a design-led technology firm, we combine deep engineering expertise with a passion for scalable, elegant solutions. Join a team where innovation, ownership, and...

  • Scala Lead Engineer

    1 day ago

    Chennai, Tamil Nadu, India Techominds Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Summary:Skills: Lead Data Eng with Scala, Spark, Pyspark & DatabricksJob Title: Data Engineer (Scala, Spark, Pyspark, Databricks)Location: ChennaiResponsibilities:Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data...

  • Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    ETL Developer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) using Apache Spark and Python. This role required deep understanding of data engineering principles, proficiency in Python and hands-on experience with Spark and Hadoop ecosystems....

  • Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewETL Developer will be responsible for designing, implementing, and...

  • Data Engineer with Bigdata, Spark, Hive and Airflow | Basic knowledge working with Kubernetes IRC273751

    2 weeks ago

    Chennai, Tamil Nadu, India GlobalLogic Full time ₹ 40,00,000 - ₹ 1,20,00,000 per year

    DescriptionData engineer with 4 to 6 years of hands on experience working on Big Data PlatformsExperience building and optimizing Big data data pipelines and data sets ranging from Data ingestion to Processing to Data Visualization.Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and steaming data...

  • Big Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewResponsible for designing, developing, and optimizing data...

  • Azure Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job descriptionRole: Azure Data EngineerExperience: 3-5 YearsSkill set:Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory Roles and Responsibilities: Should have programming skills with the ability to write optimized and reusable high-quality code. Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark,...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Greetings from Colan InfotechWe are hiring Azure Data Engineer urgent basisJob Location - Chennai / Bangalore (WFO only)Role: Azure Data EngineerExperience: 3-5 YearsSkill set:Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory Roles and Responsibilities: Should have programming skills with the ability to write optimized and reusable...