PySpark Developer

2 months ago


HyderabadChennaiKolkata, India Risk Resources LLP Full time

Job Description :

Must-Have :

- Mandatory skill : Pyspark.

- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.

- Must have excellent knowledge in Apache Spark and Python programming experience.

- Experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, aggregating data, performing data enrichment, and loading into target data destinations.

- Hands-on project experience on Jupyter Notebook/ PyCharm etc. IDE

- Should have experience in fine-tuning process and troubleshooting performance issue.

- Experience in source code control systems like git, GitHub, SVN etc.

- Experience in deployment and operationalizing the code, knowledge of scheduling tools like Control-M etc. is preferred.

- Experience in CI/CD tools like Jenkins, Nexus, Ansible etc.

- Excellent communication and interpersonal skills.

Good-to-Have :

- Understanding of Unix/Linux Shell Scripting

- Should understand and have operating experience with Agile

(ref:hirist.tech)
  • PySpark Developer

    4 months ago


    Kolkata, India Risk Resources LLP Full time

    Job Description :Must-Have :- Mandatory skill : Pyspark.- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.- Must have excellent knowledge in Apache Spark and Python programming experience.- Experience in developing data...

  • Pyspark developer

    2 weeks ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for Data Engineer (Pyspark Developer) Required Skill Set: Pyspark, Python (Pandas and Numpy), Azure Synapse/ADF/Databricks , SQL and relational databases, Spark SQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, Dev Ops (CI/CD) Desired Experience Range: 6 to 10 Years Job Location: Chennai / Pune...

  • Pyspark Developer

    1 month ago


    chennai, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Data Engineer (Pyspark Developer)Required Skill Set: Pyspark, Python (Pandas and Numpy), Azure Synapse/ADF/Databricks , SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, DevOps (CI/CD)Desired Experience Range: 6 to 10 YearsJob Location: Chennai / PuneMust Have:Data...

  • Pyspark Developer

    2 months ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Data Engineer (Pyspark Developer)Required Skill Set: Pyspark, Python (Pandas and Numpy), Azure Synapse/ADF/Databricks , SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, DevOps (CI/CD)Desired Experience Range: 6 to 10 YearsJob Location: Chennai / PuneMust Have:Data...

  • Pyspark Developer

    2 months ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring forData Engineer (Pyspark Developer)Required Skill Set:Pyspark, Python (Pandas and Numpy), Azure Synapse/ADF/Databricks , SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, DevOps (CI/CD)Desired Experience Range:6 to 10 YearsJob Location:Chennai / PuneMust Have:Data...

  • Pyspark developer

    1 month ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Data Engineer (Pyspark Developer)Required Skill Set: Pyspark, Python (Pandas and Numpy), Azure Synapse/ADF/Databricks , SQL and relational databases, Spark SQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, Dev Ops (CI/CD)Desired Experience Range: 6 to 10 YearsJob Location: Chennai / PuneMust...

  • Pyspark Developer

    2 months ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Data Engineer (Pyspark Developer)Required Skill Set: Pyspark, Python (Pandas and Numpy), Azure Synapse/ADF/Databricks , SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, DevOps (CI/CD)Desired Experience Range: 6 to 10 YearsJob Location: Chennai / PuneMust Have:Data...

  • Pyspark Developer

    2 months ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for Data Engineer (Pyspark Developer) Required Skill Set: Pyspark, Python (Pandas and Numpy), Azure Synapse/ADF/Databricks , SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, DevOps (CI/CD) Desired Experience Range: 6 to 10 Years Job Location: Chennai / Pune Must Have:...

  • Pyspark Developer

    2 months ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Data Engineer (Pyspark Developer)Required Skill Set: Pyspark, Python (Pandas and Numpy), Azure Synapse/ADF/Databricks , SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, DevOps (CI/CD)Desired Experience Range: 6 to 10 YearsJob Location: Chennai / PuneMust Have:Data...

  • PySpark Developer

    1 month ago


    Hyderabad, India Tata Consultancy Services Full time

    Role- PySpark DeveloperExperience- 5 TO 10 YRSLocation- Bangalore / HyderabadMust Have- PysparkDesired Competencies (Technical/Behavioral Competency)Must-Have · Hands-on experience in Pyspark including Dataframe core functions sparkSQL and SparkStreaming. · Minimum 3 years of experience HIVE, Hadoop, Kafka, YARN, HBase & MongoDB · Hands on experience in...

  • PySpark Developer

    3 weeks ago


    Chennai, India Tata Consultancy Services Full time

    Role : PySpark DeveloperTechnical Skill Set : PySpark, Python, HDFS, Hadoop, SQLLocation : Mumbai, Pune ,Chennai, Banglore , NCR, HyderabadMust-Have :Sound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured & unstructured dataAbility to design data pipelines in end to end manner Knowledge on Avro, Parquet...

  • PySpark Developer

    3 weeks ago


    Chennai, India Tata Consultancy Services Full time

    Role : PySpark DeveloperTechnical Skill Set : PySpark, Python, HDFS, Hadoop, SQLLocation : Mumbai, Pune ,Chennai, Banglore , NCR, HyderabadMust-Have :Sound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured & unstructured dataAbility to design data pipelines in end to end manner Knowledge on Avro, Parquet...

  • PySpark Developer

    1 month ago


    Hyderabad, India Tata Consultancy Services Full time

    Role- PySpark DeveloperExperience - 5 TO 10 YRSLocation - Bangalore / HyderabadMust Have - PysparkDesired Competencies (Technical/Behavioral Competency)Must-Have · Hands-on experience in Pyspark including Dataframe core functions sparkSQL and SparkStreaming. · Minimum 3 years of experience HIVE, Hadoop, Kafka, YARN, HBase & MongoDB · Hands on experience...

  • PySpark Developer

    3 weeks ago


    Hyderabad, India Kairos Konnect Full time

    Pyspark Developer Key things : Python, PysparkOffshore Years exp 6+ yrsNo of positions : 5 rolesHyderabad- 5 days onsiteShift timings are 1pm-10pmResponsibilities :- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to...

  • Pyspark developer

    4 weeks ago


    Hyderabad, India Tata Consultancy Services Full time

    Role - Py Spark Developer Experience - 5 TO 10 YRS Location - Bangalore / Hyderabad Must Have - Pyspark Desired Competencies (Technical/Behavioral Competency) Must-Have · Hands-on experience in Pyspark including Dataframe core functions spark SQL and Spark Streaming. · Minimum 3 years of experience HIVE, Hadoop, Kafka, YARN, HBase & Mongo...

  • Pyspark Developer-1

    3 weeks ago


    Kolkata, West Bengal, India Realign LLC Full time

    **Job Type: Full Time**: **Job Category: IT**: Job Title: PySpark Developer Job Summary: Responsibilities and Duties: - Develop and optimize PySpark data processing pipelines - Collaborate with data engineers and data scientists to implement data solutions - Write efficient and scalable PySpark code - Troubleshoot and resolve performance issues - Design...

  • Pyspark

    2 months ago


    Kolkata, West Bengal, India Tata Consultancy Services Full time

    pyspark 5 to 8 kolkata location and developer role Qualifications :ELECT& ELETROENG


  • Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS !!!Job Title : Pyspark developerLocation- Chennai/Bangalore/Gurgaon/Pune/BhuvneshwarExperience required : 5+ yearsRequired InformationDetailsRequired Technical Skill-Knowledge of Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQSMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala,...


  • Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS !!!Job Title : Pyspark developerLocation- Chennai/Bangalore/Gurgaon/Pune/BhuvneshwarExperience required : 5+ yearsRequired InformationDetailsRequired Technical Skill-Knowledge of Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQSMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala,...


  • chennai, India Tata Consultancy Services Full time

    Role : PySpark DeveloperTechnical Skill Set : PySpark, Python, HDFS, Hadoop, SQLLocation : Mumbai, Pune ,Chennai, Banglore , NCR, HyderabadMust-Have :Sound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured & unstructured dataAbility to design data pipelines in end to end mannerKnowledge on Avro, Parquet...