Palantir

Job Summary

As an Lead Data Engineer with a focus on Palantir PySpark and Python you will play a pivotal role in designing and implementing scalable data solutions. With a hybrid work model you will collaborate with cross-functional teams to drive innovation and efficiency. Your expertise will contribute to the companys mission of delivering cutting-edge technology solutions that have a significant impact on society.

Responsibilities

• Design and implement scalable data architectures using Palantir Spark and SparkSQL to meet business requirements.
• Collaborate with cross-functional teams to understand data needs and provide innovative solutions.
• Develop and optimize Python scripts to enhance data processing and analysis capabilities.
• Ensure data quality and integrity through rigorous testing and validation processes.
• Lead the development of data models and pipelines to support analytics and reporting.
• Provide technical guidance and mentorship to junior team members to foster growth and development.
• Oversee the integration of data from various sources to create a unified data platform.
• Monitor system performance and implement improvements to enhance efficiency and reliability.
• Stay updated with the latest industry trends and technologies to drive continuous improvement.
• Communicate effectively with stakeholders to align data solutions with business objectives.
• Document technical specifications and processes to ensure knowledge sharing and continuity.
• Contribute to the companys purpose by delivering data solutions that drive informed decision-making.
• Impact society by enabling data-driven insights that lead to innovative solutions. Qualifications
• Possess extensive experience in designing data architectures with Spark and SparkSQL.
• Demonstrate proficiency in Python programming for data processing and analysis.
• Exhibit strong problem-solving skills and the ability to work collaboratively in a hybrid environment.
• Have a solid understanding of data modeling and pipeline development.
• Show experience in ensuring data quality and integrity through testing and validation.
• Display excellent communication skills to interact with stakeholders and team members.
• Stay abreast of industry trends and advancements in data technologies.

Certifications Required

Certified Spark Developer Python Programming Certification