Spark Scala Python

6 days ago


Chennai Tamil Nadu, India Cognizant Full time

**Job Summary**

Join our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal advancements through data-driven insights.

**Responsibilities**
- Develop and implement scalable data processing solutions using Spark and Scala to enhance data analytics capabilities.
- Collaborate with data scientists and analysts to optimize data workflows and ensure efficient data processing.
- Design and maintain data pipelines using SparkSQL and Python to support business intelligence initiatives.
- Conduct code reviews and provide feedback to team members to maintain high-quality code standards.
- Participate in agile development processes to deliver projects on time and within scope.
- Analyze complex data sets to identify trends and insights that drive business decisions.
- Document technical specifications and processes to ensure knowledge sharing and continuity.
- Stay updated with the latest industry trends and technologies to continuously improve data solutions.
- Work closely with stakeholders to understand requirements and translate them into technical solutions.
- Ensure data security and compliance with company policies and industry regulations.
- Provide technical support and guidance to junior developers to foster a collaborative team environment.
- Contribute to the companys mission by delivering data-driven solutions that positively impact society.

**Qualifications**
- Possess a strong background in Spark Scala Python and SparkSQL with a minimum of 5 years of experience.
- Demonstrate proficiency in designing and implementing data pipelines and workflows.
- Exhibit excellent problem-solving skills and the ability to troubleshoot complex technical issues.
- Show experience in working within agile development environments and delivering projects on time.
- Have a keen understanding of data security and compliance requirements.
- Display strong communication skills to effectively collaborate with cross-functional teams.
- Be committed to continuous learning and staying updated with industry advancements.

**Certifications Required**

Certified Spark Developer Python for Data Science Certification


  • Spark Scala Python

    2 weeks ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal...


  • Chennai, Noida, Pune, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled professional with expertise in Spark and Scala to join our team. The ideal candidate will have 4 to 10 years of experience.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Spark and Scala.Collaborate with cross-functional teams to identify and prioritize project requirements.Develop...

  • Lead Data Engineer

    4 weeks ago


    Chennai, India Ixceed Solutions Full time

    About the Role :We are seeking a highly skilled and experienced Lead Data Engineer/Scala Developer with strong hands-on expertise in Scala programming, Apache Spark, Databricks, Python, and PySpark. The ideal candidate will lead the design, development, and deployment of scalable big data solutions, working closely with cross-functional teams to deliver...


  • Bengaluru, Bhubaneswar, Chennai, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Skills:Scala , MVC framework, functional programming using Scala, RESTful web services in Java, Scala, Python, or similar languages, NoSQL and SQL databases. big data using Scala spark, ML, Kafka, Elasticsearch will be a plusExperience:5+ years of experience building modern and scalable REST-based microservices using Scala, preferably with Play as MVC...

  • BigData- Spark/Scala

    2 weeks ago


    Chennai, Tamil Nadu, India Prodapt Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Overview Big Data, Spark Scala strong  Responsibilities Big Data, Spark Scala strong  Requirements Big Data, Spark Scala strong 

  • BigData- Spark/Scala

    3 weeks ago


    Chennai, India Jobted IN C2 Full time

    Overview: We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data...


  • tamil nadu, India Tata Consultancy Services Full time

    Role - Spark / Scala Data EngineerExperience - 8 to 10 yrsLocation - Bangalore/Chennai/Hyderabad/Delhi/PuneMust Have- Big Data Hadoop - Hive and Spark/Scala solid experience- SQL advance knowledge - Been able to test changes and issues properly, replicating the code functionality into SQL- Worked with Code Repositories as GIT, Maven, ...- DevOps Knowledge...


  • Chennai, Tamil Nadu, India Prodapt Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Overview   We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data...


  • Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Overview:We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data...

  • Data Engineer

    5 days ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from Tata Consulting ServicesTCS is Hiring for Data Engineer (Spark / Scala)Experience: 7-10 yearsLocation: Bangalore/ ChennaiNotice Period: 0-15/30 DaysPlease find the JD belowRequired Technical Skill - Scala/Spark , Hadoop, Hive