Senior Data Engineer

3 weeks ago

PunePimpriChinchwad Area, India Lear Corporation Full time

Overview:

As a Senior Data Engineer at Lear, you will take a leadership role in designing, building, and maintaining robust data pipelines within the Foundry platform. Your expertise will drive the seamless integration of data and analytics, ensuring high-quality datasets and supporting critical decision-making processes. If you’re passionate about data engineering and have a track record of excellence, this role is for you

Responsibilities:

Manage Execution of Data-Focused Projects:

  • As a senior member of the LEAR foundry team, support in designing, building and maintaining data-focused projects using Lear’s data analytics and application platforms.
  • Participate in projects from conception to root cause analytics and solution deployment.
  • Understand program and product delivery phases, contributing expert analysis across the lifecycle.Ensure Project deliverables are met as per agreed timeline.

Tools and Technologies:

  • Utilize key tools within Palantir Foundry, including:
  • Pipeline Builder: Author data pipelines using a visual interface.
  • Code Repositories: Manage code for data pipeline development.
  • Data Lineage: Visualize end-to-end data flows.
  • Leverage programmatic health checks to ensure pipeline durability.
  • Work with both new and legacy technologies to integrate separate data feeds and transform them into new scalable datasets.
  • Mentor junior data engineers on best practices.

Data Pipeline Architecture and Development:

  • Lead the design and implementation of complex data pipelines.

Collaborate with cross-functional teams to ensure scalability, reliability, and efficiency andutilize Git concepts for version control and collaborative development.

  • Optimize data ingestion, transformation, and enrichment processes.

Big Data, Dataset Creation and Maintenance:

Utilize pipeline or code repository to transform big data into manageable datasets and produce high-quality datasets that meet the organization’s needs.

  • Implement optimum build time to ensure effective utilization of resource.

High-Quality Dataset Production:

  • Produce and maintain datasets that meet organizational needs.
  • Optimize the size and build scheduled of datasets to reflect the latest information.
  • Implement data quality health checks and validation.

Collaboration and Leadership:

  • Work closely with data scientists, analysts, and operational teams.
  • Provide technical guidance and foster a collaborative environment.
  • Champion transparency and effective decision-making.

Continuous Improvement:

  • Stay abreast of industry trends and emerging technologies.
  • Enhance pipeline performance, reliability, and maintainability.
  • Contribute to the evolution of Foundry’s data engineering capabilities.

Compliance and data security:

  • Ensure documentation and procedures align with internal practices (ITPM) and Sarbanes Oxley requirements, continuously improving them.

Team Development and Collaboration:

  • Mentor junior team members and contribute to their growth.
  • Foster collaboration within cross-functional teams.
  • Share best practices and encourage knowledge sharing.

Quality Assurance & Optimization:

  • Optimize data pipelines and their impact on resource utilization of downstream processes.
  • Continuously test and improve data pipeline performance and reliability.
  • Optimize system performance for all deployed resources.


Qualifications:

  • Bachelor’s or master’s degree in Computer Science, Engineering, or a related field.
  • Minimum 5 years of experience in data engineering, ETL, and data integration.
  • Proficiency in Python and libraries like Pyspark, Pandas, Numpy.
  • Strong understanding of Palantir Foundry and its capabilities.
  • Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka).
  • Excellent problem-solving skills and attention to detail.
  • Effective communication and leadership abilities.

  • Senior Data Engineer

    3 weeks ago

    Pimpri-Chinchwad, India Lear Corporation Full time

    Overview:As aSenior Data Engineerat Lear, you will take a leadership role in designing, building, and maintaining robust data pipelines within the Foundry platform. Your expertise will drive the seamless integration of data and analytics, ensuring high-quality datasets and supporting critical decision-making processes. If you’re passionate about data...

  • Senior Data Engineer

    3 weeks ago

    Pimpri-Chinchwad, India Lear Corporation Full time

    Overview:As a Senior Data Engineer at Lear, you will take a leadership role in designing, building, and maintaining robust data pipelines within the Foundry platform. Your expertise will drive the seamless integration of data and analytics, ensuring high-quality datasets and supporting critical decision-making processes. If you’re passionate about data...

  • Senior Data Engineer

    7 days ago

    Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Data Engineering Senior Specialist

    1 month ago

    pimpri-chinchwad, India Telstra Full time

    Employment Type Permanent Closing Date 30 Dec 2023 11:59pm Job Title Data Engineering Senior Specialist - Python & Pyspark Job Summary As a Data Platform Engineer Senior Specialist, you bridge the hardware-software boundary. You create, optimise and maintain data storages and platforms so that our users can access high quality and reliable data assets...

  • Data Engineering Senior Specialist

    1 month ago

    Pimpri-Chinchwad, India Telstra Full time

    Employment TypePermanentClosing Date30 Dec 2023 11:59pmJob TitleData Engineering Senior Specialist - Python & PysparkJob SummaryAs a Data Platform Engineer Senior Specialist, you bridge the hardware-software boundary. You create, optimise and maintain data storages and platforms so that our users can access high quality and reliable data assets and...

  • Senior Data Engineer

    1 month ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    2 weeks ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Software Engineer

    1 month ago

    Pune/Pimpri-Chinchwad Area, India RS Consulting Full time

    We are hiring for Senior Software engineers (full stack developers) for a German software company located in Baner, Pune.Experience: 5 to 8 yearsJob Location: Hinjewadi, PuneKey Skills: C#,.Net, React, SQL Server, JavaScript, TypeScript, HTML, CSS, Azure

  • Senior Software Engineer

    1 month ago

    Pune/Pimpri-Chinchwad Area, India RS Consulting Full time

    We are hiring for Senior Software engineers (full stack developers) for a German software company located in Baner, Pune. Experience: 5 to 8 years Job Location: Hinjewadi, Pune Key Skills: C#,.Net, React, SQL Server, JavaScript, TypeScript, HTML, CSS, Azure

  • GCP Data Engineer

    6 hours ago

    Pimpri-Chinchwad, India N Consulting Ltd Full time

    Title: GCP Data EngineerCompany Overview:Natobotics is a rapidly growing technology company that specializes in developing innovative solutions for the biotechnology and pharmaceutical industries. Our cutting-edge products and services are designed to help accelerate scientific research and revolutionize the way medical treatments are developed. We are...

  • GCP Data Engineer

    2 days ago

    pimpri-chinchwad, India N Consulting Ltd Full time

    Title: GCP Data Engineer   Company Overview: Natobotics is a rapidly growing technology company that specializes in developing innovative solutions for the biotechnology and pharmaceutical industries. Our cutting-edge products and services are designed to help accelerate scientific research and revolutionize the way medical treatments are developed. We are...

  • GCP Data Engineer

    2 days ago

    Pimpri-Chinchwad, India N Consulting Ltd Full time

    Title: GCP Data Engineer Company Overview:Natobotics is a rapidly growing technology company that specializes in developing innovative solutions for the biotechnology and pharmaceutical industries. Our cutting-edge products and services are designed to help accelerate scientific research and revolutionize the way medical treatments are developed. We are...

  • Senior Software Engineer

    1 month ago

    Pimpri-Chinchwad, India RS Consulting Full time

    We are hiring for Senior Software engineers (full stack developers) for a German software company located in Baner, Pune.Experience: 5 to 8 yearsJob Location: Hinjewadi, PuneKey Skills: C#,.Net, React, SQL Server, JavaScript, TypeScript, HTML, CSS, Azure

  • Senior Software Engineer

    1 month ago

    Pimpri-Chinchwad, India RS Consulting Full time

    We are hiring for Senior Software engineers (full stack developers) for a German software company located in Baner, Pune.Experience: 5 to 8 yearsJob Location: Hinjewadi, PuneKey Skills: C#,.Net, React, SQL Server, JavaScript, TypeScript, HTML, CSS, Azure

  • Senior Data Scientist

    1 month ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Scientist

    2 weeks ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based...

  • Senior Design Engineer

    1 week ago

    Pune/Pimpri-Chinchwad Area, India Crane India Full time

    Crane India has an opportunity for a Senior Design Engineer ( VAVE ) at our at our Design Centre, Baner, Pune.Responsibilities :Design package development for Industrial valves specifically for Check valves following New Product Development stage gate processLeading VAVE design activities and collaborating with operations team to drive cost reduction...

  • Senior Design Engineer

    1 week ago

    Pune/Pimpri-Chinchwad Area, India Crane India Full time

    Crane India has an opportunity for a Senior Design Engineer ( VAVE ) at our at our Design Centre, Baner, Pune. Responsibilities : Design package development for Industrial valves specifically for Check valves following New Product Development stage gate process Leading VAVE design activities and collaborating with operations team to drive cost reduction...

  • Senior Software Engineer

    4 weeks ago

    Pune/Pimpri-Chinchwad Area, India ConnectWise Full time

    Senior Software Engineer (Dot Net) Mumbai/PuneExperience – 5 to 10 years.Job type – Permanent, HybridJob location – Pune & MumbaiJOB DESCRIPTION Required Skills: • Programming languages: o ASP.net, .NET core, C#, JavaScript, SQL, MVC, Web API, o Experience with Intellij / Eclipse, Visual Studio and Git Source Control o Experience with HTML, CSS,...

  • Senior Software Engineer

    4 weeks ago

    Pune/Pimpri-Chinchwad Area, India ConnectWise Full time

    Senior Software Engineer (Dot Net) Mumbai/Pune Experience – 5 to 10 years. Job type – Permanent, Hybrid Job location – Pune & Mumbai JOB DESCRIPTION Required Skills: • Programming languages: o ASP.net, .NET core, C#, JavaScript, SQL, MVC, Web API, o Experience with Intellij / Eclipse, Visual Studio and Git Source Control o Experience with...