Python Spark Developer

3 days ago


Chennai, India Rarr Technologies Full time

Well versed with:

  • Very good proficiency in Python and Spark programming.
  • Pandas: Experience with data manipulation and analysis using Pandas.
  • Implementation experience of Spark Core, Spark SQL and Spark Streaming
  • Working with Spark in combination Hadoop Ecosystem
  • Design and implementation of low-latency, high-availability, and performance applications.
  • Should lead and guide a team of junior Python developers.
  • As Sr Python Developer responsibilities include coding, testing, debugging, and troubleshooting throughout the application development process.
  • Performance tuning, improvement, balancing, usability, and automation.
  • Collaborate with other team members and stakeholders.

Educational Qualification

  • Proficiency in Python programming.
  • Experience with Pandas for data manipulation and analysis.
  • Knowledge of Polars for efficient data processing.
  • Strong problem-solving skills and attention to detail.
  • Ability to work collaboratively in a team environment


  • Chennai, India Innovatz Global Full time

    Role: Python+Spark Developer(Relavant exp must be 5+ years) Location: Chennai Duration: Full time Job Description – Through and hands on knowledge on Python and Spark Programming and writing efficient, reusable, and reliable Python code. Well versed with: · Very good proficiency in Python and Spark programming. · Pandas: Experience with data...


  • Chennai, Tamil Nadu, India Glauben Technologies Full time US$ 90,000 - US$ 1,20,000 per year

    Role & responsibilitiesVery good proficiency in Python and Spark programming.Pandas: Experience with data manipulation and analysis using Pandas.Implementation experience of Spark Core, Spark SQL and Spark StreamingWorking with Spark in combination Hadoop EcosystemDesign and implementation of low-latency, high-availability, and performance...

  • Spark Developer

    3 days ago


    Chennai, India Citi Full time

    ETL Developer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) using Apache Spark and Python. This role required deep understanding of data engineering principles, proficiency in Python and hands-on experience with Spark and Hadoop ecosystems....

  • Spark Developer

    12 hours ago


    Chennai, Tamil Nadu, India Citi Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    ETL Developer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) using Apache Spark and Python. This role required deep understanding of data engineering principles, proficiency in Python and hands-on experience with Spark and Hadoop ecosystems....


  • Chennai, India Path Mentors Staffing Solution Full time

    Scala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions Required Candidate profile Scala/Spark Developer with 5+ years' experience in building scalable data...

  • Spark Scala Developer

    13 hours ago


    Chennai, Tamil Nadu, India Infotel UK Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position: Spark Scala DeveloperCompany: Infotel IndiaAt Infotel UK, a premier technology consulting firm, we are seeking a skilled Spark Scala Developer to join our dynamic team. In this role, you will leverage your expertise in Spark and Scala to design and implement advanced data processing solutions that drive insights and provide value to our clients....


  • Chennai, India Path Mentors Staffing Solution Full time

    Translate use cases into functional apps; design, build, and optimize Java/Spark code; identify bottlenecks and fix bugs; process data with Hive, Impala, HBASE. Skills: 8+ yrs Java, Big Data (HDFS, Spark, Kafka), SQL, multithreading, Agile, Git. Required Candidate profile Java/Spark Developer with 5+ years' experience in Big Data, HDFS, Hive, Kafka, SQL,...


  • Chennai, Tamil Nadu, India Citigroup Full time

    ETL Developer will be responsible for designing implementing and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System HDFS using Apache Spark and Python This role required deep understanding of data engineering principles proficiency in Python and hands-on experience with Spark and Hadoop ecosystems ...

  • Spark/Scala Developer

    2 weeks ago


    Chennai, Tamil Nadu, India HARP Technologies and Services Full time

    Notice Period : Immediate to 30 DaysJob Summary :We are looking for experienced Spark Scala Developers to join our growing team. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.Key Responsibilities...


  • Chennai, India Careernet Full time

    Key Skills: Java, Spark, Big Data Processing, Distributed Computing, Performance Tuning, Object-Oriented Programming, RESTful APIs, Agile Methodologies, Git, Maven, Debugging, Unit Testing, Code Reviews. Roles & Responsibilities: Design, develop, and maintain scalable applications using Java and Spark. Collaborate with cross-functional teams to define,...