Pyspark Developer, Pyspark

3 days ago


chennai, India Krishpar Technologies Pvt. Ltd Full time

Dear candidates,

We are hiring for one of our client (MNC)

Position : Pyspark Developer

Experience: 4- 6 Yaers

Location: Chennai, Bangalore

Job Description:

Big Data Testing on Hadoop, Hive, etc., using HiveQL, MapReduce or other big data technologies for automated validation

Implementing DevOps / CI-CD using Bitbucket, Jenkins, etc.,

Implementing Test Automation Frameworks for back-end validation including RDBMS, file, Kafka sources and Big Data targets

Working in an Agile environment on Jira, ALM, Confluence, etc.,

Big Data technologies (Hadoop, Hive, etc.,) using HiveQL, Java-MapReduce / Pig-Latin / Spark-Python or other big data technologies on Linux

Experience with SQL and Shell Scripting experience

Notice : 0-30 Days


  • PySpark Developers

    1 month ago


    chennai, India Techno Wise Full time

    We are looking for a PySpark developer ( with ETL background ) to be able to design and build solution on one of our customer programs. This to build a data standardized and curation layer that will integrate data across internal and external sources, provide analytical insights and integrate with customer’s critical systems. Roles and...

  • PySpark Developers

    3 weeks ago


    chennai, India Techno Wise Full time

    We are looking for a PySpark developer ( with ETL background ) to be able to design and build solution on one of our customer programs. This to build a data standardized and curation layer that will integrate data across internal and external sources, provide analytical insights and integrate with customer’s critical systems. Roles and...

  • Pyspark Dev

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Pyspark Dev & QA - CREQ188700 DescriptionPyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of...


  • Chennai, India Krishpar Technologies Pvt. Ltd Full time

    Dear candidates,We are hiring for one of our client (MNC)Position : Pyspark DeveloperExperience: 4- 6 YaersLocation: Chennai, BangaloreJob Description:Big Data Testing on Hadoop, Hive, etc., using HiveQL, MapReduce or other big data technologies for automated validationImplementing DevOps / CI-CD using Bitbucket, Jenkins, etc.,Implementing Test Automation...


  • Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...


  • chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...


  • chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...


  • Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...

  • Apache Pyspark

    4 hours ago


    chennai, India Maneva Consulting Pvt. Ltd Full time

    GreetingsFromManeva! JobDescription JobTitle ApachePyspark LocationChennai Experience4 10Years Notice15 30Days JobRequirements: Mandatory:Primary skill:Pyspark Education: B.Tech/M.Tech/MCA 46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions...

  • Apache Pyspark

    8 minutes ago


    Chennai, India Maneva Consulting Pvt. Ltd Full time

    GreetingsFromManeva!JobDescriptionJobTitle ApachePyspark LocationChennaiExperience4 10YearsNotice15 30Days JobRequirements: Mandatory:Primary skill:Pyspark Education: B.Tech/M.Tech/MCA 46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions for any Data...

  • Apache Pyspark

    1 week ago


    Chennai, Tamil Nadu, India Maneva Consulting Pvt. Ltd Full time

    GreetingsFromManevaJobDescriptionJobTitleApachePysparkLocationChennaiExperience4 10YearsNotice15 30DaysJobRequirements:Mandatory:Primary skill:PysparkEducation: B.Tech/M.Tech/MCA46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions for any Data...

  • Pyspark Dev

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Pyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of installing, configuring, debugging and...

  • Pyspark

    3 weeks ago


    Chennai, India Cognizant Full time

    Must have Eperience in Pyspark, ETL, and BI projects Must have a stronghold in Python Must have experience in Snowflake Data Base. Must have experience implementing complex stored Procedures and standard DWH and ETL concepts Proficient in Oracle database, complex PL/SQL, Unix Shell Scripting, performance tuning, and troubleshooting Must have experience in...

  • Data Engineer

    3 weeks ago


    Chennai, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    2 months ago


    Chennai, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    3 weeks ago


    Chennai, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    2 months ago


    Chennai, Tamil Nadu, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    2 months ago


    Chennai, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...