Python Spark Developer

2 days ago


Chennai, Tamil Nadu, India Rarr Technologies Full time US$ 1,50,000 - US$ 2,00,000 per year

Well versed with:

  • Very good proficiency in Python and Spark programming.
  • Pandas: Experience with data manipulation and analysis using Pandas.
  • Implementation experience of Spark Core, Spark SQL and Spark Streaming
  • Working with Spark in combination Hadoop Ecosystem
  • Design and implementation of low-latency, high-availability, and performance applications.
  • Should lead and guide a team of junior Python developers.
  • As Sr Python Developer responsibilities include coding, testing, debugging, and troubleshooting throughout the application development process.
  • Performance tuning, improvement, balancing, usability, and automation.
  • Collaborate with other team members and stakeholders.

Educational Qualification

  • Proficiency in Python programming.
  • Experience with Pandas for data manipulation and analysis.
  • Knowledge of Polars for efficient data processing.
  • Strong problem-solving skills and attention to detail.
  • Ability to work collaboratively in a team environment


  • Chennai, Tamil Nadu, India Innovatz Global Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role: Python+Spark Developer(Relavant exp must be 5+ years)Location: ChennaiDuration: Full timeJob Description –Through and hands on knowledge on Python and Spark Programming and writing efficient, reusable, and reliable Python code.Well versed with:· Very good proficiency in Python and Sparkprogramming.· Pandas: Experience with data manipulation and...

  • Spark Developer

    1 week ago


    Chennai, Tamil Nadu, India Citi Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    ETL Developer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) using Apache Spark and Python. This role required deep understanding of data engineering principles, proficiency in Python and hands-on experience with Spark and Hadoop ecosystems....

  • Spark Developer

    3 days ago


    Chennai, Tamil Nadu, India Citi Full time US$ 90,000 - US$ 1,20,000 per year

    ETL Developer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) using Apache Spark and Python. This role required deep understanding of data engineering principles, proficiency in Python and hands-on experience with Spark and Hadoop ecosystems....

  • Spark Developer

    3 days ago


    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,12,500 - ₹ 23,40,000

    Senior Data Processing SpecialistElevate your career in data engineering and drive business growth as a Senior Data Processing Specialist. This exciting role offers the opportunity to design, implement, and optimize distributed data processing jobs to handle large-scale data in Hadoop Distributed File System (HDFS) using Apache Spark and Python.This position...


  • Chennai, Tamil Nadu, India Path Mentors Staffing Solution Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Scala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions Required Candidate profileScala/Spark Developer with 5+ years' experience in building scalable data...


  • Chennai, Tamil Nadu, India Infotel UK Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position: Spark Scala DeveloperCompany: Infotel IndiaAt Infotel UK, a premier technology consulting firm, we are seeking a skilled Spark Scala Developer to join our dynamic team. In this role, you will leverage your expertise in Spark and Scala to design and implement advanced data processing solutions that drive insights and provide value to our clients....


  • Chennai, Tamil Nadu, India Path Mentors Staffing Solution Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Translate use cases into functional apps; design, build, and optimize Java/Spark code; identify bottlenecks and fix bugs; process data with Hive, Impala, HBASE. Skills: 8+ yrs Java, Big Data (HDFS, Spark, Kafka), SQL, multithreading, Agile, Git. Required Candidate profileJava/Spark Developer with 5+ years' experience in Big Data, HDFS, Hive, Kafka, SQL, and...


  • Chennai, Tamil Nadu, India Citigroup Full time

    ETL Developer will be responsible for designing implementing and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System HDFS using Apache Spark and Python This role required deep understanding of data engineering principles proficiency in Python and hands-on experience with Spark and Hadoop ecosystems ...


  • Chennai, Tamil Nadu, India HARP Technologies and Services Full time

    Notice Period : Immediate to 30 DaysJob Summary :We are looking for experienced Spark Scala Developers to join our growing team. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.Key Responsibilities...


  • Chennai, Tamil Nadu, India Careernet Full time US$ 90,000 - US$ 1,20,000 per year

    Key Skills: Java, Spark, Big Data Processing, Distributed Computing, Performance Tuning, Object-Oriented Programming, RESTful APIs, Agile Methodologies, Git, Maven, Debugging, Unit Testing, Code Reviews.Roles & Responsibilities:Design, develop, and maintain scalable applications using Java and Spark.Collaborate with cross-functional teams to define, design,...