Senior PySpark/Python Developer

1 day ago


Hyderabad, Telangana, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 24,00,000 per year

About The Role :

We are seeking a highly skilled and experienced Senior PySpark/Python Developer to play a critical role in building a robust and reliable system for managing and disseminating customer notifications regarding PG&E's Planned Power Outages (PPOs). This is an exciting opportunity to tackle complex data challenges within a dynamic environment and contribute directly to improving customer communication and experience.

As a key member of the team, you will be responsible for developing and implementing data processing pipelines that can ingest, transform, and synthesize information from various backend systems related to PPOs. Your primary goal will be to "eat ambiguity and excrete certainty" by taking complex, ever-changing data and producing clear, consistent, and timely notifications for PG&E customers.

This role requires a strong individual contributor who can execute tasks within a defined scope while also demonstrating leadership qualities such as adaptability, continuous learning, and ownership. You should be comfortable navigating ambiguous situations, proactively identifying solutions, and providing direction even when clear, pre-defined solutions are not immediately apparent.

Responsibilities :

  • Design, develop, and maintain scalable and efficient data processing pipelines using PySpark and Python.

  • Leverage your expertise in data engineering principles to build robust and reliable solutions.

  • Work with complex and dynamic datasets related to work requests and planned power outages.

  • Apply your knowledge of Palantir Foundry to integrate with existing data infrastructure and potentially build new modules or workflows.

  • Develop solutions to consolidate and finalize information about planned power outages from disparate systems.

  • Implement logic to ensure accurate and timely notifications are generated for customers, minimizing confusion and inconsistencies.

  • Identify and address edge cases and special circumstances within the PPO process.

  • Collaborate effectively with cross-functional teams, including business analysts, product owners, and other engineers.

  • Take ownership of technical challenges and drive them to resolution.

  • Proactively learn and adapt to new technologies and evolving requirements.

  • Contribute to the development of technical documentation and best practices.

Required Skills And Experience :

  • Minimum of 8+ years of overall experience in software development with a strong focus on data engineering.

  • Extensive and demonstrable experience with PySpark for large-scale data processing.

  • Strong proficiency in Python and its relevant data engineering libraries.

  • Hands-on experience with Palantir Foundry and its core functionalities (e.g., Ontology, Pipelines, Actions, Contour).

  • Solid understanding of data modeling, data warehousing concepts, and ETL/ELT processes.

  • Experience working with complex and high-volume datasets.

  • Ability to write clean, efficient, and well-documented code.

  • Excellent problem-solving and analytical skills.

  • Strong communication and collaboration skills.

  • Ability to work independently and manage priorities effectively in a remote setting.

  • Demonstrated ability to take ownership and drive tasks to completion.

  • Comfort navigating ambiguous situations and proposing solutions.

  • A proactive and continuous learning mindset.

Nice To Have :

  • Experience with cloud platforms (e.g., AWS, Azure, GCP).

  • Familiarity with data visualization tools.

  • Understanding of notification systems and best practices.

  • Prior experience in the utilities or energy sector.



  • Hyderabad, Telangana, India MatchPoint Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Type: PermanentLocation: Hyderabad (5 Days Onsite)Experience RequiredJob Description:We are seeking a skilledData Engineerwith strong expertise inPySpark Quries, Python programming, and Data Structures & Algorithms (DSA). The ideal candidate will design and optimize large-scale data pipelines, write efficient and scalable code, and solve complex data...

  • PySpark Developer

    6 days ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: PySpark DeveloperExperience: 6 to 8 YearsLocation: Hyderabad ( Onsite )Job DescriptionMust-HaveStrong knowledge of Pyspark and SQL2 + years of experience in PySpark.4+Years of experience in DataStage, Terada.6+ Years of experience in Python.Experience in GCP cloud ServicesDelta LakeGood-to-HavePysparkGCPGoogle Cloud / Google...

  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India algoleap Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • PySpark Developer

    6 days ago


    Hyderabad, Telangana, India Algoleap Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    SUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • Pyspark Developer

    7 days ago


    Hyderabad, Telangana, India KloudPortal Technology Solutions PVT. LTD Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job DescriptionJob Summary We are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams.Key ResponsibilitiesDevelop and optimise...


  • Hyderabad, Telangana, India Matrix Global Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Summary:We are seeking a highly skilled ETL Developer with strong expertise in SQL and Python or PySpark to join our data engineering team within a leading financial institution. The ideal candidate will have at least 5 years of experience in the banking sector, with a solid understanding of Anti-Money Laundering (AML) processes and compliance...


  • Hyderabad, Telangana, India Disa Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    2 rounds of coding sessions is must for every candidate.Position: Pyspark, Python, SQL, Palantir Data EngineerLocation: Hyderabad, India. Onsite from Day1. Need local Hyderabad, India or close by locations candidatesResponsibilitiesDevelop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and...

  • Pyspark Developer

    7 days ago


    Hyderabad, Telangana, India Infosys Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Educational RequirementsBachelor of EngineeringService LineData & Analytics UnitResponsibilitiesA day in the life of an Infoscion- As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction.- You will understand requirements, create and review...


  • Hyderabad, Telangana, India Caspex Corp Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position: Senior Python Developer with MLOps platformLocation: Hyderabad, India (Need to work from Experian- Hyderabad office at least 2 to 3 days in a week from day one)No of Open Positions: 1Experience:6+ YearsSummaryDesign & build backend components of MLOps platform on AWS.Collaborate with geographically distributed cross-functional teams.Participate in...

  • Digital Specialist

    5 days ago


    Hyderabad, Telangana, India Python Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Company DescriptionWe suggest you enter details here.Role DescriptionThis is a full-time remote role for an AI Futures - Mentor's Intern at Python. The intern will be responsible for assisting mentors in developing AI-related projects. Day-to-day tasks include research, coding, data analysis, coordination of project activities, and participation in meetings....