PySpark Developer

4 weeks ago


Hyderabad, Telangana, India Kairos Konnect Full time

Responsibilities :

- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.

- Collaborate with product and technology teams to design and validate the capabilities of the data platform

- Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability

- Provide technical support and usage guidance to the users of our platform's services.

- Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.

Qualifications :

- Experience building and optimizing data pipelines in a distributed environment

- Experience supporting and working with cross-functional teams

- Proficiency working in Linux environment

- 4+ years of advanced working knowledge of SQL, Python, and PySpark

- Knowledge on Palantir

- Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline

- Experience with platform monitoring and alerts tools

(ref:hirist.tech)
  • Pyspark Developer

    4 weeks ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Greetings from Tata Consulting ServicesTCS is Hiring for Pyspark DeveloperExperience : 5 - 12 yearsLocation: Bangalore/Hyderabad/PunePlease find the JD belowMust-HaveMandatory: Primary skill: Pyspark.3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for...

  • PySpark Developer

    4 weeks ago


    Hyderabad, Telangana, India Kairos Konnect Full time

    Pyspark Developer Key things : Python, PysparkOffshore Years exp 6+ yrsNo of positions : 5 rolesHyderabad- 5 days onsiteShift timings are 1pm-10pmResponsibilities :- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to...

  • Pyspark Developer

    3 weeks ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Greetings from TATA CONSULTANCY SERVICES LIMITED Role–Pyspark DeveloperExperience Range-5 to 10 yearsWork Location –Hyderabad, PuneSKILLS REQUIRED:Analyze existing Teradata tables and Data Warehouse structures.Design and implement a strategy to migrate data from Teradata to Spark 3.x and Delta Lake.Develop PySpark scripts to extract, transform, and load...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm) Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners. Key Skills: (Must Have) Programming Languages: Python Big Data Technologies: PySpark Database Technologies: SQL Communication & Collaboration: Excellent...


  • Hyderabad, Telangana, India Coforge Full time

    - Job Title: Python Pyspark Developer- Experience- 5.0 - 12.0 years- Location- Hyderabad- Shift- Shift (02:00 pm -10:30 pm)- Mode- Strictly Work from Office- Notice Period- Preferred immediate/early joiners.Key Skills: (Must Have)- Programming Languages: Python- Big Data Technologies: PySpark- Database Technologies: SQL- Communication & Collaboration:...

  • PySpark

    3 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Description Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor...

  • PySpark

    3 weeks ago


    Hyderabad, Telangana, India Alignity Full time

    Job DescriptionDo you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market If so, we are excited to have bumped onto you.Learn how we are redefining themeaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.- Jobseeker Video Testimonials- Employee Glassdoor...

  • PySpark QA

    3 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    PySpark QA - CREQ191292 Description JOB DESCRIPTION Skill: PySpark QA Role / Tier: Lead Software Engineer/Tier 2 Experience: 6 – 9 years Job Description: Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to cleanse, explore,...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark DeveloperExperience- 5.0 - 12.0 yearsLocation- HyderabadShift- Shift (02:00 pm -10:30 pm)Mode- Strictly Work from OfficeNotice Period- Preferred immediate/early joiners.We at Coforge are looking for below skill set:Communication & Collaboration: Excellent written and verbal communication skillsStrong proficiency in Python and...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm) Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners. We at Coforge are looking for below skill set: Communication & Collaboration: Excellent written and verbal communication skills Strong proficiency in...

  • PySpark

    3 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor Reviews If you are...

  • Pyspark Developer

    3 weeks ago


    Hyderabad, Telangana, India Folks Palette LLP Full time

    Job Description :Responsibilities :- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to design and validate the capabilities of the data platform- Identify, design, and implement process improvements: automating...

  • Pyspark Developer

    3 weeks ago


    Hyderabad, Telangana, India Corporate Resources Full time

    Job Description 1. Knowledge of the key phases of software delivery lifecycle and established software development methodologies 2. Must have strong understanding of data architecture, data integration and data management processes, ability to develop transformation logic in Spark-SQL based on...


  • Hyderabad, Telangana, India S P A Enterprise Services Ltd. Full time

    Key Responsibilities- Implement data transformation logic, data cleansing, and data enrichment processes to ensure data quality and consistency.- Optimize data pipelines and queries using Spark SQL and PySpark to improve performance and scalability.- Refactor and modernize legacy codebases, focusing on clean code, improved readability, and maintainability.-...


  • Hyderabad, Telangana, India Chase Bank Full time

    Job DescriptionYou're ready to gain the skills and experience needed to grow within your role and advance your career - and we have the perfect software engineering opportunity for you.As a PySpark Developer Software Engineer II at JPMorgan Chase within the Commercial & Investment Bank Payments Technology team, you are part of an agile team that works to...


  • Hyderabad, Telangana, India Coforge Full time

    Job Title: Python Pyspark Developer Experience- 5.0 - 12.0 years Location- Hyderabad Shift- Shift (02:00 pm -10:30 pm)Mode- Strictly Work from Office Notice Period- Preferred immediate/early joiners.Key Skills: (Must Have)Programming Languages: Python Big Data Technologies: Py Spark Database Technologies: SQLCommunication & Collaboration: Excellent written...

  • - PySpark Developer

    4 weeks ago


    Hyderabad, Telangana, India DATA ECONOMY PRIVATE LIMITED Full time

    Key Responsibilities : - Model Development : Lead the development of advanced models using AWS services such as EMR, Glue, and Glue Notebooks.- Cloud Infrastructure : Design, build, and optimize scalable cloud infrastructure solutions with a minimum of 5 years of experience.- ETL Pipeline Development : Create, manage, and optimize ETL pipelines using PySpark...


  • Hyderabad, Telangana, India SOULPAGE IT SOLUTIONS PRIVATE LIMITED Full time

    About UsSoulpage IT Solutions is an innovative AI/ML technology company based in Hyderabad. Our company specializes in cutting-edge solutions for data engineering, AI, and cloud-based analytics.The OpportunityWe are seeking an experienced Data Engineer with expertise in Big Data technologies, Python, and PySpark to join our team. As a Data Engineer at...


  • Hyderabad, Telangana, India HireIT Consultants Full time

    Job TitleSQL Developer with PySpark Coding Job DescriptionAbout the PositionWe are seeking a skilled SQL Developer to work on designing, implementing, and maintaining data pipelines and ensuring data accuracy, integrity, and performance in a cloud or on-premise environment.Key AccountabilitiesDesign and implement data processing pipelines using PySpark to...


  • Hyderabad, Telangana, India IT & Services Full time

    Job Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...