Data Platform Engineer

23 hours ago


Delhi, India OSD Data Services Full time
Data Platform Engineer

Location: Remote

Type: Internship

About Us

At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a comprehensive Data Lakehouse Platform that integrates the best tools to handle everything from ingestion and governance to analytics and machine learning.

We pride ourselves on being at the forefront of data engineering, combining a passion for innovation with a commitment to solving real-world data challenges. By joining us, you’ll have the chance to work with cutting-edge technologies and some of the brightest minds in the industry.

Role Overview

We are looking for a Data Platform Engineer with a passion for OSD to design, build, and optimize scalable, high-performance data platforms. You’ll play a key role in enabling our clients to extract maximum value from their data by leveraging the power of tools like Spark, Kafka, Kubernetes, and Trino.

This role offers the unique opportunity to work on complex, petabyte-scale projects, shaping the future of data infrastructure for businesses across industries. You’ll collaborate with talented teams to build data platforms that deliver real-time insights, support advanced analytics, and integrate seamlessly with AI technologies.

Key Responsibilities

- Design and Development: Architect and implement scalable Data Lakehouse Platforms using open-source technologies.- Pipeline Optimization: Develop and optimize data pipelines for both real-time and batch processing with tools like Spark and Airflow.- Storage and Format Management: Implement modern storage formats such as Apache Iceberg, Hudi, or Delta Lake, ensuring efficient data storage and retrieval.- Orchestration and Deployment: Manage deployment and orchestration using Kubernetes and Docker across cloud (AWS, GCP, Azure) or on-prem environments.- Data Governance: Establish and maintain robust governance practices, including database CDC replication and lineage tracking.- Analytics Integration: Support interactive dashboards and analytics tools, such as Superset or similar, enabling data-driven decisions.- Performance Tuning: Monitor system performance and implement optimizations to ensure scalability and cost-efficiency.- Innovation: Stay ahead of industry trends, experimenting with emerging technologies to continuously improve the platform.

What You’ll Bring

- 3+ years of experience in data platform engineering, with expertise in open-source tools and cloud technologies.- Strong understanding of distributed computing frameworks like Spark and query engines like Trino or Presto.- Proficiency in containerization and orchestration technologies (Docker, Kubernetes).- Hands-on experience with cloud platforms (AWS, GCP, Azure) and hybrid/on-prem infrastructure.- Familiarity with ETL/ELT workflows, CDC replication tools, and modern data storage solutions.- Proficiency in programming languages like Python, Java, or Scala.- Experience managing large-scale data systems (terabyte/petabyte-scale) and optimizing for performance.- Excellent problem-solving skills and a passion for leveraging open-source technologies to build transformative solutions.

Preferred Qualifications

- Familiarity with AI/ML frameworks and integration.- Experience with CI/CD workflows and infrastructure as code (e.g., Terraform, Ansible).- Knowledge of data governance frameworks and compliance standards.

Why Join Us?

- Innovative Work: Be part of a company at the cutting edge of data engineering, working on impactful and transformative projects.- Growth Opportunities: We invest in your professional development, offering learning opportunities and career progression pathways.- Collaborative Environment: Join a supportive team of experts who thrive on solving complex challenges together.- Flexible Work Options: Enjoy a healthy work-life balance with remote work flexibility and competitive compensation.- Impactful Solutions: Help shape data solutions that drive real-world results for businesses across industries.

What Makes This Role Unique

- Work with open-source technologies at scale.- Tackle complex challenges in data engineering and analytics.- Be part of a fast-growing team, where your ideas and contributions will directly influence our success.

About Our Tech Stack

You’ll work with a comprehensive suite of tools and frameworks, including:

- Distributed computing: Apache Spark, Hive- Streaming and messaging: Kafka- Query engines: Trino, Presto- Orchestration: Airflow- Storage formats: Apache Hudi, Iceberg, Delta Lake- Visualization: Superset- Containerization: Docker, Kubernetes- Cloud platforms: AWS, GCP, Azure

How to Apply

Are you ready to take your data engineering career to the next level? Apply today to join a team that’s transforming how the world works with data.

Apply Now on Linkedin

  • Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...


  • Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...


  • delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.


  • Delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.


  • Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...


  • delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...


  • Delhi, Delhi, India Atlas - the Recruitment Platform Full time

    About Atlas TechnologiesAt Atlas Technologies, we're revolutionizing the recruitment industry with our innovative anti-CRM platform. Our mission is to empower recruitment professionals by automating data entry and providing a user-friendly experience.Job SummaryWe're seeking an experienced Full Stack Data Migration Engineer to join our team. As a key member...


  • delhi, India Atlas - the Recruitment Platform Full time

    Before you start reading, please read this carefully! I've spent a good amount of time thinking about what to write :D Who we are Atlas Technologies is an anti-CRM built solely for recruitment professionals. A customer relationship management tool is a required software to run any business. The problem is that data entry is extremely onerous and these...


  • delhi, India GeoTech Full time

    Location:(Remote, with occasional travel to Riyadh, Saudi Arabia)Department:Data and AIEmployment Type:Full-timeAbout GeoTechGeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer vision, and...


  • delhi, India GeoTech Full time

    Location: [Remote, with occasional travel to Riyadh, Saudi Arabia] Department: Data and AI Employment Type: Full-time About GeoTech GeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer...


  • Delhi, India GeoTech Full time

    Location:(Remote, with occasional travel to Riyadh, Saudi Arabia)Department:Data and AIEmployment Type:Full-timeAbout GeoTechGeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer vision, and...


  • Delhi, India GeoTech Full time

    Location: (Remote, with occasional travel to Riyadh, Saudi Arabia)Department: Data and AIEmployment Type: Full-timeAbout Geo TechGeo Tech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer...


  • Delhi, India GeoTech Full time

    Location: (Remote, with occasional travel to Riyadh, Saudi Arabia)Department: Data and AIEmployment Type: Full-timeAbout GeoTechGeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer vision,...


  • delhi, India GeoTech Full time

    Location: (Remote, with occasional travel to Riyadh, Saudi Arabia)Department: Data and AIEmployment Type: Full-timeAbout GeoTechGeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer vision,...


  • Delhi, India Velotio Technologies Full time

    Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS,...


  • Delhi, India Velotio Technologies Full time

    Velotio Technologiesis a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS,...


  • Delhi, India Velotio Technologies Full time

    Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B...