PySpark Developer

4 weeks ago


Hyderabad, Telangana, India Kairos Konnect Full time

Pyspark Developer

Key things : Python, Pyspark

Offshore Years exp 6+ yrs

No of positions : 5 roles

Hyderabad- 5 days onsite

Shift timings are 1pm-10pm

Responsibilities :

- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.

- Collaborate with product and technology teams to design and validate the capabilities of the data platform

- Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability

- Provide technical support and usage guidance to the users of our platform's services.

- Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.

Qualifications :

- Experience building and optimizing data pipelines in a distributed environment

- Experience supporting and working with cross-functional teams

- Proficiency working in Linux environment

- 4+ years of advanced working knowledge of SQL, Python, and PySpark

- Knowledge on Palantir

- Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline

- Experience with platform monitoring and alerts tools

(ref:hirist.tech)
  • Pyspark Developer

    3 weeks ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Greetings from TATA CONSULTANCY SERVICES LIMITED Role–Pyspark DeveloperExperience Range-5 to 10 yearsWork Location –Hyderabad, PuneSKILLS REQUIRED:Analyze existing Teradata tables and Data Warehouse structures.Design and implement a strategy to migrate data from Teradata to Spark 3.x and Delta Lake.Develop PySpark scripts to extract, transform, and load...


  • Hyderabad, Telangana, India Folks Palette LLP Full time

    About the RoleFolks Palette LLP is committed to innovation and excellence in data engineering. We are seeking a skilled PySpark Developer Lead to lead our data engineering team and drive the development of scalable data solutions. The ideal candidate will have a strong background in big data technologies, particularly PySpark, and experience with cloud...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm) Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners. Key Skills: (Must Have) Programming Languages: Python Big Data Technologies: PySpark Database Technologies: SQL Communication & Collaboration: Excellent...


  • Hyderabad, Telangana, India Coforge Full time

    - Job Title: Python Pyspark Developer- Experience- 5.0 - 12.0 years- Location- Hyderabad- Shift- Shift (02:00 pm -10:30 pm)- Mode- Strictly Work from Office- Notice Period- Preferred immediate/early joiners.Key Skills: (Must Have)- Programming Languages: Python- Big Data Technologies: PySpark- Database Technologies: SQL- Communication & Collaboration:...

  • PySpark

    3 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Description Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor...

  • PySpark

    4 weeks ago


    Hyderabad, Telangana, India Alignity Full time

    Job DescriptionDo you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market If so, we are excited to have bumped onto you.Learn how we are redefining themeaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.- Jobseeker Video Testimonials- Employee Glassdoor...

  • PySpark QA

    3 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    PySpark QA - CREQ191292 Description JOB DESCRIPTION Skill: PySpark QA Role / Tier: Lead Software Engineer/Tier 2 Experience: 6 – 9 years Job Description: Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to cleanse, explore,...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark DeveloperExperience- 5.0 - 12.0 yearsLocation- HyderabadShift- Shift (02:00 pm -10:30 pm)Mode- Strictly Work from OfficeNotice Period- Preferred immediate/early joiners.We at Coforge are looking for below skill set:Communication & Collaboration: Excellent written and verbal communication skillsStrong proficiency in Python and...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark DeveloperExperience- 5.0 - 12.0 yearsLocation- HyderabadShift- Shift (02:00 pm -10:30 pm)Mode- Strictly Work from OfficeNotice Period- Preferred immediate/early joiners.We at Coforge are looking for below skill set:Communication & Collaboration: Excellent written and verbal communication skillsStrong proficiency in Python and...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm) Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners. We at Coforge are looking for below skill set: Communication & Collaboration: Excellent written and verbal communication skills Strong proficiency in...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title:Python Pyspark DeveloperExperience-5.0 - 12.0 yearsLocation-HyderabadShift-Shift (02:00 pm -10:30 pm)Mode-Strictly Work from OfficeNotice Period-Preferred immediate/early joiners.We at Coforge are looking for below skill set:Communication & Collaboration: Excellent written and verbal communication skillsStrong proficiency in Python and relevant...

  • PySpark

    3 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor Reviews If you are...

  • Pyspark Developer

    3 weeks ago


    Hyderabad, Telangana, India Folks Palette LLP Full time

    Job Description :Responsibilities :- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to design and validate the capabilities of the data platform- Identify, design, and implement process improvements: automating...

  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India Kairos Konnect Full time

    Responsibilities : - Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to design and validate the capabilities of the data platform- Identify, design, and implement process improvements: automating manual processes,...

  • Pyspark Developer

    4 weeks ago


    Hyderabad, Telangana, India Corporate Resources Full time

    Job Description 1. Knowledge of the key phases of software delivery lifecycle and established software development methodologies 2. Must have strong understanding of data architecture, data integration and data management processes, ability to develop transformation logic in Spark-SQL based on...


  • Hyderabad, Telangana, India S P A Enterprise Services Ltd. Full time

    Key Responsibilities- Implement data transformation logic, data cleansing, and data enrichment processes to ensure data quality and consistency.- Optimize data pipelines and queries using Spark SQL and PySpark to improve performance and scalability.- Refactor and modernize legacy codebases, focusing on clean code, improved readability, and maintainability.-...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Data Scientist with PySpark ExpertiseWe are seeking a skilled Data Scientist to join our team at Coforge. The ideal candidate will have extensive experience working with large-scale data processing using PySpark and excellent proficiency in Python and relevant data science libraries.Key Responsibilities:Design and implement data pipelines using...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm)Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners.Key Skills: (Must Have)Programming Languages: Python Big Data Technologies: Py Spark Database Technologies: SQLCommunication & Collaboration: Excellent written...


  • Hyderabad, Telangana, India Coforge Full time

    **Job Overview**We are seeking an exceptional Senior Data Scientist to join our team as a PySpark expert. As a key member of our data science group, you will be responsible for designing and developing advanced data processing systems using PySpark.


  • Hyderabad, Telangana, India SOULPAGE IT SOLUTIONS PRIVATE LIMITED Full time

    About UsSoulpage IT Solutions is an innovative AI/ML technology company based in Hyderabad. Our company specializes in cutting-edge solutions for data engineering, AI, and cloud-based analytics.The OpportunityWe are seeking an experienced Data Engineer with expertise in Big Data technologies, Python, and PySpark to join our team. As a Data Engineer at...