Spark Scala Python

4 days ago

Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Job Summary

Join our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal advancements through data-driven insights.

Responsibilities

  • Develop and implement scalable data processing solutions using Spark and Scala to enhance data analytics capabilities.
  • Collaborate with data scientists and analysts to optimize data workflows and ensure efficient data processing.
  • Design and maintain data pipelines using SparkSQL and Python to support business intelligence initiatives.
  • Troubleshoot and resolve technical issues related to Spark applications to ensure seamless data operations.
  • Conduct code reviews and provide feedback to team members to maintain high-quality code standards.
  • Participate in agile development processes to deliver projects on time and within scope.
  • Analyze complex data sets to identify trends and insights that drive business decisions.
  • Document technical specifications and processes to ensure knowledge sharing and continuity.
  • Stay updated with the latest industry trends and technologies to continuously improve data solutions.
  • Work closely with stakeholders to understand requirements and translate them into technical solutions.
  • Ensure data security and compliance with company policies and industry regulations.
  • Provide technical support and guidance to junior developers to foster a collaborative team environment.
  • Contribute to the companys mission by delivering data-driven solutions that positively impact society.

Qualifications

  • Possess a strong background in Spark Scala Python and SparkSQL with a minimum of 5 years of experience.
  • Demonstrate proficiency in designing and implementing data pipelines and workflows.
  • Exhibit excellent problem-solving skills and the ability to troubleshoot complex technical issues.
  • Show experience in working within agile development environments and delivering projects on time.
  • Have a keen understanding of data security and compliance requirements.
  • Display strong communication skills to effectively collaborate with cross-functional teams.
  • Be committed to continuous learning and staying updated with industry advancements.

Certifications Required

Certified Spark Developer Python for Data Science Certification

  • Spark Scala Developer

    4 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS!!!!TCS is looking for Spark Scala DeveloperExperience: 6-8 yearsLocation: ChennaiMUST HAVE SKILLS:Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow.Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration and cluster...

  • Scala Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Path Mentors Staffing Solution Full time ₹ 12,50,000 - ₹ 25,00,000 per year

    Scala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions Required Candidate profileScala/Spark Developer with 5+ years' experience in building scalable data...

  • BigData- Spark/Scala

    6 days ago

    Chennai, Tamil Nadu, India Prodapt Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Overview Big Data, Spark Scala strong  Responsibilities Big Data, Spark Scala strong  Requirements Big Data, Spark Scala strong 

  • Senior Spark/Scala Developer

    6 days ago

    Chennai, Tamil Nadu, India BNP Paribas Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Position Purpose The Senior Spark Developer will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand...

  • Scala Developer

    3 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Role : Scala DeveloperExp : 4+ year Location : Pune,Chennai, Kolkata, Hyderabad, Gurgoan, Functional Skills: Experience in Credit Risk/Regulatory risk domain Technical Skills: Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix shell scripting Good to Have Skills: Exposure to Machine Learning TechniquesJob Description:4+ Years of experience with...

  • Scala Lead Engineer

    3 days ago

    Chennai, Tamil Nadu, India Techominds Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Summary:Skills: Lead Data Eng with Scala, Spark, Pyspark & DatabricksJob Title: Data Engineer (Scala, Spark, Pyspark, Databricks)Location: ChennaiResponsibilities:Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data...

  • Data Engineer with Spark and Scala

    2 weeks ago

    Chennai, Tamil Nadu, India KRG Technologies Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Roles and ResponsibilitiesDesign, develop, test, deploy, and maintain large-scale data pipelines using Scala programming language.Collaborate with cross-functional teams to gather requirements and deliver high-quality ETL solutions.Develop complex SQL queries to extract insights from various databases (Oracle, Postgres) and transform them into actionable...

  • Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    ETL Developer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) using Apache Spark and Python. This role required deep understanding of data engineering principles, proficiency in Python and hands-on experience with Spark and Hadoop ecosystems....

  • Scala Developer

    3 days ago

    Chennai, Tamil Nadu, India GEETHA TECHNOLOGY SOLUTIONS PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking an experienced Scala/Akka Microservices Developer to join our team in building robust, scalable, and high-performance distributed systems. The ideal candidate will have strong hands-on experience in Scala programming, Akka framework (including Akka Streams), and microservices design principles. You will be working on event-driven...

  • Big Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Responsible for designing, developing, and optimizing data processing solutions using a combination of Big Data technologies. Focus on building scalable and efficient data pipelines for handling large datasets and enabling batch & real-time data streaming and processing. Responsibilities:> Develop Spark applications using Scala or Python (Pyspark) for data...