Senior Data Platform Engineer

4 weeks ago


Pune, India Edgematics Full time
Job Title: Lead Data Engineer

We are seeking a highly skilled Lead Data Engineer to lead the development of a cutting-edge data platform at Edgematics. The ideal candidate will have a strong background in distributed computing, data engineering, and cloud data platforms.

Key Responsibilities:
  • Design and build a highly scalable, fault-tolerant data platform optimized for distributed computing and large-scale data processing.
  • Implement data pipelines and ETL/ELT processes using distributed computing frameworks to efficiently ingest, transform, and load massive datasets from various sources.
  • Leverage cloud data platforms to enable seamless data sharing, near-zero maintenance, and fast analytics on structured and semi-structured data.
  • Collaborate with data scientists, machine learning engineers, and software developers to understand data requirements and build solutions to power GenAI applications.
  • Optimize distributed computing jobs and queries for maximum performance and cost efficiency.
  • Implement data governance, security, and compliance best practices.
  • Provide guidance on distributed computing architecture and mentor junior data engineers.
Qualifications:
  • 5+ years of experience as a Data Engineer working with big data technologies.
  • Strong proficiency in SQL, Python programming, and data modeling techniques.
  • Deep expertise in distributed computing principles and frameworks (e.g., Apache Spark), including SQL, streaming, and optimizing jobs for scale and efficiency.
  • Hands-on experience with developing and deploying distributed computing applications using cloud-based platforms (e.g., AWS EMR, Azure HDInsight, or equivalent).
  • Strong understanding of cloud data platform architectures and best practices for ELT/ETL, data sharing, and query optimization (e.g., AWS Athena, AWS Glue, Azure Synapse Analytics, or equivalent).
  • Experience enabling application engineers to build applications leveraging the data platform through APIs and abstractions.
  • Experience with orchestration frameworks like Apache Airflow and data streaming technologies like Kafka.
  • Experience building and optimizing data pipelines for machine learning applications.
  • Knowledge of data modelling, data warehousing, and schema design.
  • Familiarity with public cloud platforms such as AWS, Azure, or GCP.
  • Excellent problem-solving and communication skills.
  • Bachelor's or Master's degree in Computer Science (Preferred), Engineering, or a related field.

  • Platform Engineer

    4 weeks ago


    Pune, Maharashtra, India NTT DATA Full time

    Job Title: Platform EngineerJob Summary:NTT DATA Services is seeking a skilled Platform Engineer to join our team in Pune, India. As a Platform Engineer, you will be responsible for designing, implementing, and maintaining cloud-based infrastructure and platforms to support the delivery of applications and services.Key Responsibilities:Design and implement...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India NTT DATA Services Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team in Pune, India. As a key member of our data engineering team, you will be responsible for designing and developing big data platforms using Spark, HBase, Hive, and other Hadoop ecosystem technologies.Key Responsibilities:Design and develop big data platforms using...


  • Pune, Maharashtra, India PubMatic Full time

    Job Title: Senior Data Platform EngineerAt PubMatic, we're looking for a skilled Senior Data Platform Engineer to join our team. As a key member of our engineering team, you will design, develop, and deploy scalable and efficient data processing systems that meet the needs of our customers.Responsibilities:Design and implement data pipelines using modern...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India NTT DATA Services Full time

    Job Requirements:We are seeking a highly skilled Senior Data Engineer to join our team at NTT DATA Services. The ideal candidate will have a strong background in data engineering, with expertise in designing and developing big data platforms.Key Responsibilities:Design and develop big data platforms using Spark, HBase, Hive, and other Hadoop ecosystem...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India NTT DATA Services Full time

    Req ID: 298868 NTT DATA is a global leader in business and technology services, committed to helping clients innovate, optimize and transform for long term success. We are seeking a talented Senior Data Engineer to join our team in India.About the Role:We are looking for a skilled Data Engineer with expertise in designing and developing big data platforms....

  • Senior Data Engineer

    3 weeks ago


    Pune, Maharashtra, India NTT DATA Services Full time

    Job Requirements:We are seeking a highly skilled Senior Data Engineer to join our team in Pune, India. The ideal candidate will have a bachelor degree with 5+ years of programming experience on data platforms.Key Responsibilities:Design and develop big data platforms using expertise in Data Engineering.Deep understanding of data processing technology stacks:...

  • Senior Data Engineer

    3 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. is a leading provider of data, marketing solutions, sales, and research. With a 50-year history in the US, the company has established a strategic global centre of excellence in Pune, delivering mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Senior Data Engineer

    5 months ago


    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for over five decades in the US. Our global centre of excellence in Pune delivers mission-critical data services to our customers worldwide, leveraging our proprietary cloud-based technology platform and business & consumer databases.Job SummaryWe are...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for 50 years in the US. With a strategic global centre of excellence in Pune, Data Axle delivers mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Faurecia Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our Data Platform Solutions team at FORVIA. As a Senior Data Engineer, you will be responsible for developing end-to-end data engineering products using Palantir, mining data from structured, semi-structured, and unstructured data sources, and developing...

  • Senior Data Engineer

    1 month ago


    Pune, India NTT DATA Services Full time

    Req ID: 298868 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Bachelor degree with 5+ years of...


  • Pune, Maharashtra, India PubMatic Full time

    PubMatic is an innovative technology company that empowers digital content creators to control their inventory and increase monetization.Our sell-side platform enables marketers to drive return on investment and reach addressable audiences across ad formats and devices.We champion a vibrant and transparent digital advertising supply chain.As a Senior Data...

  • Senior Data Engineer

    3 weeks ago


    Pune, Maharashtra, India Faurecia Full time

    Job Title: Senior Data EngineerJob Description:We are seeking a highly skilled Senior Data Engineer to join our Data Platform Solutions team at FORVIA. As a key member of our global team, you will be responsible for developing end-to-end data engineering products using Palantir.Key Responsibilities:Develop data engineering products using PalantirExtract...


  • Pune, India Enlighten HR Consulting Full time

    Job Title: Senior Data Platform ArchitectJob Summary:We are seeking a highly skilled Senior Data Platform Architect to lead the development of a cutting-edge data platform. The ideal candidate will have expertise in distributed computing frameworks, data modeling, and cloud data platform architectures.Key Responsibilities:Design and build a highly scalable,...


  • Pune, Maharashtra, India NTT DATA Full time

    Job SummaryWe are seeking a skilled Systems Integration Senior Specialist to join our team in India. The ideal candidate will have a Master's or Bachelor's degree in computer science or a related field and at least 8 years of experience in implementing data applications and big data platforms.Expertise in designing, engineering, and deploying data ingestion,...


  • Pune, Maharashtra, India NTT DATA Full time

    Job Title: Lead Platform EngineerJob Summary:We are seeking a highly skilled Lead Platform Engineer to join our team in Pune, India. The successful candidate will be responsible for designing, implementing, and maintaining our cloud infrastructure, ensuring high availability, scalability, and security.Key Responsibilities:Design and implement cloud...


  • Pune, Maharashtra, India TechHost Services Full time

    Job Title: Senior Full Stack Engineer Data PlatformAbout the Role:We are seeking a highly skilled Senior Full Stack Engineer to join our Data Platform team at TechHost Services. As a Senior Full Stack Engineer, you will be responsible for designing, implementing, and maintaining data-driven web applications using modern techniques and technologies.Key...

  • Platform Engineer

    4 months ago


    Pune, India NTT DATA Full time

    Job Description Req ID: 285103 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Platform Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN)."Job Duties:...


  • Pune, Maharashtra, India NTT DATA Full time

    Job DescriptionReq ID: 285212 NTT DATA Services is committed to delivering exceptional IT and business solutions. We are seeking a skilled Lead Platform Engineer to join our team in India and contribute to the development of our cloud infrastructure.We are looking for a highly motivated individual with a strong background in cloud technologies, including...