Python Pyspark Developer

3 weeks ago


Chennai, India RiskInsight Consulting Pvt Ltd Full time
Responsibilities
  • Design, develop, and deploy scalable data processing applications using Python and PySpark.
  • Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions.
  • Write efficient and optimized code to process and analyze large volumes of data.
  • Implement data ingestion processes from various data sources to the data processing platform.
  • Create and maintain data pipelines and workflows for data processing and analytics.
  • Perform data quality checks and ensure data integrity throughout the system.
  • Troubleshoot and debug production issues to identify and resolve technical problems.
  • Stay updated with the latest technologies and tools in data processing to drive innovation and improve performance.
  • Collaborate with cross-functional teams to ensure seamless integration of data processing applications with other systems.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 4-6 years of experience in Python development with specific experience in PySpark.
  • Strong proficiency in Python programming language.
  • Experience with distributed computing frameworks like PySpark and Apache Spark.
  • Knowledge of data processing and analytics techniques.
  • Experience with data integration and ETL processes.
  • Familiarity with data storage and querying systems like SQL and NoSQL databases.
  • Understanding of data structures, algorithms, and distributed systems.
  • Excellent problem-solving and analytical skills.
  • Strong communication and interpersonal skills.
  • Ability to work independently and in a team environment.
  • Proactive attitude towards learning and professional development.

Skills: Python, PySpark, Apache Spark, SQL, NoSQL



  • chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...


  • chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...


  • chennai, India Virtusa Full time

    Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...


  • chennai, India Virtusa Full time

    Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...


  • Chennai, Tamil Nadu, India Virtusa Full time

    Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...

  • Python Pyspark

    2 days ago


    Chennai, India Virtusa Full time

    Overall Eight plus years of experience with min of five plus years experience in required technical skills Required technical skills: Python, PySpark, SQL AWS Cloud experience and Healthcare domain knowledge is desired **About Virtusa** Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join...

  • Python Pyspark

    6 days ago


    Chennai, India Virtusa Full time

    Overall Eight plus years of experience with min of five plus years experience in required technical skills Required technical skills: Python, PySpark, SQL AWS Cloud experience and Healthcare domain knowledge is desired Notice Period - Immediate to 30 days **About Virtusa** Teamwork, quality of life, professional and personal development: values that...

  • Data Engineer

    2 months ago


    Chennai, India HNM Solutions Full time

    Role : Data Engineer with PythonLocation : ChennaiExperience : 5+ yearsRequirements :Data Engineer with Python experts :Minimum 5 years in Data engineering role with Python along with relevant experience.1. Strong working experience in Python programming.2. Expertise with one of the Python frameworks - pyspark,3. strong experience with using pandas, numpy,...

  • Python Pyspark

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Overall Eight plus years of experience with min of five plus years experience in required technical skillsRequired technical skills: Python, PySpark, SQLAWS Cloud experience and Healthcare domain knowledge is desiredAbout VirtusaTeamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you...

  • Python Pyspark

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Overall Eight plus years of experience with min of five plus years experience in required technical skillsRequired technical skills: Python, PySpark, SQLAWS Cloud experience and Healthcare domain knowledge is desiredNotice Period Immediate to 30 daysAbout VirtusaTeamwork, quality of life, professional and personal development: values that Virtusa is proud to...


  • chennai, India Krishpar Technologies Pvt. Ltd Full time

    Dear candidates, We are hiring for one of our client (MNC) Position : Pyspark Developer Experience: 4- 6 Yaers Location: Chennai, Bangalore Job Description: Big Data Testing on Hadoop, Hive, etc., using HiveQL, MapReduce or other big data technologies for automated validation Implementing DevOps / CI-CD using Bitbucket, Jenkins, etc., ...

  • Python Pyspark

    2 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Data engineer 1) Overall 8+ years in IT Experience with relevant 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare Insurance 4) Extensive data analysis skills and Good communication skills 5) Experience working in Agile **About Virtusa** Teamwork, quality of life,...

  • Python Pyspark

    2 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Data engineer 1) Overall 7+ in IT Experience with relevant 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare Insurance 4) Extensive data analysis skills and Good communication skills 5) Experience working in Agile **About Virtusa** Teamwork, quality of life, professional and...

  • Pyspark Dev

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Pyspark Dev & QA - CREQ188700 DescriptionPyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of...

  • Big Data Engineer

    1 month ago


    chennai, India Sysvine Technologies Full time

    Experience: 5 - 8 years Key Skills: Pyspark, Python, SQL, Hive, HBase, AWS, Big Data Location: Chennai Notice Period: We prefer candidates who can join immediately or candidates who are on break or candidates who are at end of their notice period What are we looking for? We are looking for an experienced Python with Pyspark Developer to join our fast-growing...

  • Python Developer

    3 weeks ago


    Bangalore/Chennai, India DXC Luxoft Full time

    We are looking for 10+ years 10+ years of experience in data-intensive python development. Should be ready to work in Bangalore / Chennai (No hybrid/ : - Develop software applications based on business requirements- Maintain software applications and make enhancements according to project specifications- Participate in requirement analysis, design,...

  • Python Developer

    1 month ago


    Bangalore/Chennai, India DXC Luxoft Full time

    We are looking for 10+ years 10+ years of experience in data-intensive python development. Should be ready to work in Bangalore / Chennai (No hybrid/ : - Develop software applications based on business requirements- Maintain software applications and make enhancements according to project specifications- Participate in requirement analysis, design,...

  • Big Data Engineer

    3 weeks ago


    Chennai, India Sysvine Technologies Full time

    Experience: 5 - 8 yearsKey Skills: Hadoop, Pyspark, Python, SQL, HiveLocation: ChennaiNotice Period: We prefer candidates who can join immediately or candidates who are on break or candidates who are at end of their notice periodWhat are we looking for?We are looking for experienced Big Data Hadoop Developer expertise with Hadoop, Big Data Ecosystems, Hive,...


  • Chennai, India Citi Full time

    Data Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...