Spark Scala Python

5 days ago

Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Job Summary

Join our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal advancements through data-driven insights.

Responsibilities

  • Develop and implement scalable data processing solutions using Spark and Scala to enhance data analytics capabilities.
  • Collaborate with data scientists and analysts to optimize data workflows and ensure efficient data processing.
  • Design and maintain data pipelines using SparkSQL and Python to support business intelligence initiatives.
  • Troubleshoot and resolve technical issues related to Spark applications to ensure seamless data operations.
  • Conduct code reviews and provide feedback to team members to maintain high-quality code standards.
  • Participate in agile development processes to deliver projects on time and within scope.
  • Analyze complex data sets to identify trends and insights that drive business decisions.
  • Document technical specifications and processes to ensure knowledge sharing and continuity.
  • Stay updated with the latest industry trends and technologies to continuously improve data solutions.
  • Work closely with stakeholders to understand requirements and translate them into technical solutions.
  • Ensure data security and compliance with company policies and industry regulations.
  • Provide technical support and guidance to junior developers to foster a collaborative team environment.
  • Contribute to the companys mission by delivering data-driven solutions that positively impact society.

Qualifications

  • Possess a strong background in Spark Scala Python and SparkSQL with a minimum of 5 years of experience.
  • Demonstrate proficiency in designing and implementing data pipelines and workflows.
  • Exhibit excellent problem-solving skills and the ability to troubleshoot complex technical issues.
  • Show experience in working within agile development environments and delivering projects on time.
  • Have a keen understanding of data security and compliance requirements.
  • Display strong communication skills to effectively collaborate with cross-functional teams.
  • Be committed to continuous learning and staying updated with industry advancements.

Certifications Required

Certified Spark Developer Python for Data Science Certification

  • Spark Scala Developer

    6 days ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS!!!!TCS is looking for Spark Scala DeveloperExperience: 6-8 yearsLocation: ChennaiMUST HAVE SKILLS:Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow.Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration and cluster...

  • Scala Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Path Mentors Staffing Solution Full time ₹ 12,50,000 - ₹ 25,00,000 per year

    Scala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions Required Candidate profileScala/Spark Developer with 5+ years' experience in building scalable data...

  • Spark & Scala Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Dinoxo IT Consulting Full time

    Responsibilities :- At least 8+ years of experience and strong knowledge in Scala programming language.- Able to write clean, maintainable and efficient Scala code following best practices.- Good knowledge on the fundamental Data Structures and their usage- At least 8+ years of experience in designing and developing large scale, distributed data processing...

  • Scala Developer

    2 days ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Role : Scala DeveloperExp : 4+ year Location : Pune,Chennai, Kolkata, Hyderabad, Gurgoan, Functional Skills: Experience in Credit Risk/Regulatory risk domain Technical Skills: Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix shell scripting Good to Have Skills: Exposure to Machine Learning TechniquesJob Description:4+ Years of experience with...

  • Python Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Rarr Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Well versed with:Very good proficiency in Python and Spark programming.Pandas: Experience with data manipulation and analysis using Pandas.Implementation experience of Spark Core, Spark SQL and Spark StreamingWorking with Spark in combination Hadoop EcosystemDesign and implementation of low-latency, high-availability, and performance applications.Should lead...

  • Scala Lead Engineer

    3 days ago

    Chennai, Tamil Nadu, India Techominds Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Summary:Skills: Lead Data Eng with Scala, Spark, Pyspark & DatabricksJob Title: Data Engineer (Scala, Spark, Pyspark, Databricks)Location: ChennaiResponsibilities:Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data...

  • Python+ Spark Developer@ Chennai- F2F

    2 weeks ago

    Chennai, Tamil Nadu, India Innovatz Global Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role: Python+Spark Developer(Relavant exp must be 5+ years)Location: ChennaiDuration: Full timeJob Description –Through and hands on knowledge on Python and Spark Programming and writing efficient, reusable, and reliable Python code.Well versed with:· Very good proficiency in Python and Sparkprogramming.· Pandas: Experience with data manipulation and...

  • Data Engineer with Spark and Scala

    2 weeks ago

    Chennai, Tamil Nadu, India KRG Technologies Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Roles and ResponsibilitiesDesign, develop, test, deploy, and maintain large-scale data pipelines using Scala programming language.Collaborate with cross-functional teams to gather requirements and deliver high-quality ETL solutions.Develop complex SQL queries to extract insights from various databases (Oracle, Postgres) and transform them into actionable...

  • Hiring For Spark with Python development-Tech M-Chennai

    1 week ago

    Chennai, Tamil Nadu, India Glauben Technologies Full time US$ 90,000 - US$ 1,20,000 per year

    Role & responsibilitiesVery good proficiency in Python and Spark programming.Pandas: Experience with data manipulation and analysis using Pandas.Implementation experience of Spark Core, Spark SQL and Spark StreamingWorking with Spark in combination Hadoop EcosystemDesign and implementation of low-latency, high-availability, and performance...

  • Scala Developer

    3 days ago

    Chennai, Tamil Nadu, India GEETHA TECHNOLOGY SOLUTIONS PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking an experienced Scala/Akka Microservices Developer to join our team in building robust, scalable, and high-performance distributed systems. The ideal candidate will have strong hands-on experience in Scala programming, Akka framework (including Akka Streams), and microservices design principles. You will be working on event-driven...