Senior Data Engineer

2 days ago

Hyderabad, India PRONEXUS CONSULTING PRIVATE LIMITED Full time

Role Overview :


We are hiring a Senior Palantir Data Engineer with deep expertise in building large-scale, cloud-native data pipelines, orchestration frameworks, and operational data services.

This role demands strong experience with Palantir Foundry, AWS, Python, and PySpark, along with a proven track record in architecting data solutions in complex enterprise environments.

As a senior engineer, you will lead design decisions, mentor junior team members, and drive the implementation of secure, scalable, and high-performance data infrastructure.


Key Responsibilities :


- Architect and develop advanced data pipelines, ingestion frameworks, and orchestration flows using PySpark, Palantir Foundry, and AWS services.

- Lead the development of domain-specific Foundry ontologies, code workbooks, and operational pipelines.

- Design reusable, scalable components and workflows for data cleansing, enrichment, and transformation.

- Drive infrastructure-as-code adoption and CI/CD pipeline integration using GitLab and AWS developer tools.

- Champion observability and operational excellence by implementing robust monitoring and alerting systems.

- Collaborate closely with stakeholders across business, analytics, and engineering to align platform capabilities with strategic goals.

- Provide technical leadership in architectural reviews, design sessions, and mentoring of junior engineers.

- Contribute to platform governance and policy enforcement, including data security and compliance (e.g., IAM best practices).


Technical Skills Required :


- Programming : Expert-level skills in Python and PySpark

- Cloud Platform : Advanced hands-on experience with AWS (S3, Glue, EMR, Lambda, IAM, CloudWatch, ECS)

- Platform Expertise : In-depth experience with Palantir Foundry, including Ontology, Object Builders, Code Workbooks, and pipeline orchestration

- DevOps & CI/CD : Git, GitLab, Bitbucket, Jenkins, AWS CodePipeline/CodeBuild

- Data Modeling & SQL : Strong SQL optimization and schema design skills

- Linux : Proficiency in system-level scripting and data management in Unix environments

- Monitoring & Logging : Tools such as Prometheus, Datadog, ELK stack, or AWS-native tools


Qualifications :


- Bachelors or Masters degree in Computer Science, Data Engineering, or related field

- 10+ years of experience in designing, building, and operating large-scale data systems

- Proven experience leading high-impact engineering teams or large-scale data transformation programs

- Ability to assess business data needs and translate them into scalable technical architectures

- Strong stakeholder management and communication skills across engineering and product teams


(ref:hirist.tech)

  • Lead/Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per year

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks. Gather and analyse data requirements from business stakeholders and identify opportunities for data-driven insights. Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks. Ensure data...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Property Data Engineer

    1 week ago

    Hyderabad, Telangana, India ICE Data Services Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Job PurposeThe Property Data Engineeris responsible for developing and maintaining data conversion programs that transform raw property assessment data into standardized formats based on specifications by Property Data Analyst and Senior Analysts. This role requires not only advanced programming and ETL skills but also a deep understanding of the structure,...

  • Data Engineer Senior Consultant

    2 weeks ago

    Hyderabad, Telangana, India NTT Data Full time

    Job DescriptionReq ID:330296NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer Senior Consultant to join our team in Hyderabad, Telangana (IN-TG), India (IN).- Understand...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)- Translate business rules into technical specifications and implement scalable data solutions.- Manage...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions. Manage a...

  • Senior Data Engineer/Architect

    7 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark,Copilot Studio , Databricks Lakehouse Platform, its architecture, and its capabilities.Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within 15th September...

  • Aws Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per year

    We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions.Key...