Python Pyspark Developer

3 days ago


Chennai, India RiskInsight Consulting Pvt Ltd Full time
Responsibilities

Design, develop, and deploy scalable data processing applications using Python and PySpark.Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions.Write efficient and optimized code to process and analyze large volumes of data.Implement data ingestion processes from various data sources to the data processing platform.Create and maintain data pipelines and workflows for data processing and analytics.Perform data quality checks and ensure data integrity throughout the system.Troubleshoot and debug production issues to identify and resolve technical problems.Stay updated with the latest technologies and tools in data processing to drive innovation and improve performance.Collaborate with cross-functional teams to ensure seamless integration of data processing applications with other systems.RequirementsBachelor's degree in Computer Science, Engineering, or a related field.4-6 years of experience in Python development with specific experience in PySpark.Strong proficiency in Python programming language.Experience with distributed computing frameworks like PySpark and Apache Spark.Knowledge of data processing and analytics techniques.Experience with data integration and ETL processes.Familiarity with data storage and querying systems like SQL and NoSQL databases.Understanding of data structures, algorithms, and distributed systems.Excellent problem-solving and analytical skills.Strong communication and interpersonal skills.Ability to work independently and in a team environment.Proactive attitude towards learning and professional development.

Skills: Python, PySpark, Apache Spark, SQL, NoSQL

  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...


  • Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...


  • chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...


  • Chennai, Tamil Nadu, India timesjobs Full time

    Hiring For Pyspark Python SQLPyspark Python SQLDesired ProfileSkills : Pyspark Python SQLNotice Period0- 30 daysEducationFull-time graduateLocationPAN India (Bangalore, Hyderabad, Pune, Chennai, Noida, Kolkata, Gurgaon)Email


  • Chennai, India timesjobs Full time

    Hiring For Pyspark Python SQLPyspark Python SQLDesired ProfileSkills : Pyspark Python SQLNotice Period0- 30 daysEducationFull-time graduateLocationPAN India (Bangalore, Hyderabad, Pune, Chennai, Noida, Kolkata, Gurgaon)Emailcareer@krazymantra.com


  • chennai, India Virtusa Full time

    Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...


  • Chennai, Tamil Nadu, India Virtusa Full time

    Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...

  • Python Pyspark

    1 week ago


    Chennai, India Virtusa Full time

    Overall Eight plus years of experience with min of five plus years experience in required technical skills Required technical skills: Python, PySpark, SQL AWS Cloud experience and Healthcare domain knowledge is desired **About Virtusa** Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join...

  • Python Pyspark

    2 weeks ago


    Chennai, India Virtusa Full time

    Overall Eight plus years of experience with min of five plus years experience in required technical skills Required technical skills: Python, PySpark, SQL AWS Cloud experience and Healthcare domain knowledge is desired Notice Period - Immediate to 30 days **About Virtusa** Teamwork, quality of life, professional and personal development: values that...

  • Python Pyspark

    2 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Overall Eight plus years of experience with min of five plus years experience in required technical skillsRequired technical skills: Python, PySpark, SQLAWS Cloud experience and Healthcare domain knowledge is desiredAbout VirtusaTeamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you...

  • Python Pyspark

    2 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Overall Eight plus years of experience with min of five plus years experience in required technical skillsRequired technical skills: Python, PySpark, SQLAWS Cloud experience and Healthcare domain knowledge is desiredNotice Period Immediate to 30 daysAbout VirtusaTeamwork, quality of life, professional and personal development: values that Virtusa is proud to...


  • Chennai, India Krishpar Technologies Pvt. Ltd Full time

    Dear candidates,We are hiring for one of our client (MNC)Position : Pyspark DeveloperExperience: 4- 6 YaersLocation: Chennai, BangaloreJob Description:Big Data Testing on Hadoop, Hive, etc., using HiveQL, MapReduce or other big data technologies for automated validationImplementing DevOps / CI-CD using Bitbucket, Jenkins, etc.,Implementing Test Automation...


  • chennai, India Krishpar Technologies Pvt. Ltd Full time

    Dear candidates, We are hiring for one of our client (MNC) Position : Pyspark Developer Experience: 4- 6 Yaers Location: Chennai, Bangalore Job Description: Big Data Testing on Hadoop, Hive, etc., using HiveQL, MapReduce or other big data technologies for automated validation Implementing DevOps / CI-CD using Bitbucket, Jenkins, etc., ...

  • Python Pyspark

    3 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Data engineer 1) Overall 8+ years in IT Experience with relevant 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare Insurance 4) Extensive data analysis skills and Good communication skills 5) Experience working in Agile **About Virtusa** Teamwork, quality of life,...

  • Python Pyspark

    3 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Data engineer 1) Overall 7+ in IT Experience with relevant 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare Insurance 4) Extensive data analysis skills and Good communication skills 5) Experience working in Agile **About Virtusa** Teamwork, quality of life, professional and...

  • Pyspark Dev

    2 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Pyspark Dev & QA - CREQ188700 DescriptionPyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of...

  • Pyspark MDM

    2 days ago


    chennai, India Virtusa Full time

    Pyspark MDM - CREQ192926 Description PySpark DeveloperStrong experience in technical leadership, mentoring MDM team of size approx. 10.Work experience 6+ years with skillset in Python (Pandas/ NumPy), PySpark Developer.Minimum 3 years of experience in build & deployment of Bigdata applications using SparkSQL.Hands-on experience in generating/parsing XML,...

  • Python Developer

    4 weeks ago


    Bangalore/Chennai, India DXC Luxoft Full time

    We are looking for 10+ years 10+ years of experience in data-intensive python development. Should be ready to work in Bangalore / Chennai (No hybrid/ : - Develop software applications based on business requirements- Maintain software applications and make enhancements according to project specifications- Participate in requirement analysis, design,...

  • Big Data Engineer

    4 weeks ago


    Chennai, India Sysvine Technologies Full time

    Experience: 5 - 8 yearsKey Skills: Hadoop, Pyspark, Python, SQL, HiveLocation: ChennaiNotice Period: We prefer candidates who can join immediately or candidates who are on break or candidates who are at end of their notice periodWhat are we looking for?We are looking for experienced Big Data Hadoop Developer expertise with Hadoop, Big Data Ecosystems, Hive,...

  • Pyspark Dev

    2 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Pyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of installing, configuring, debugging and...