OSD Data Services | Data Platform Engineer

2 days ago


rajahmundry, India OSD Data Services Full time
Data Platform Engineer

Location: Remote

Type: Internship

About Us

At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a comprehensive Data Lakehouse Platform that integrates the best tools to handle everything from ingestion and governance to analytics and machine learning.

We pride ourselves on being at the forefront of data engineering, combining a passion for innovation with a commitment to solving real-world data challenges. By joining us, you’ll have the chance to work with cutting-edge technologies and some of the brightest minds in the industry.


Role Overview

We are looking for a Data Platform Engineer with a passion for OSD to design, build, and optimize scalable, high-performance data platforms. You’ll play a key role in enabling our clients to extract maximum value from their data by leveraging the power of tools like Spark, Kafka, Kubernetes, and Trino.

This role offers the unique opportunity to work on complex, petabyte-scale projects, shaping the future of data infrastructure for businesses across industries. You’ll collaborate with talented teams to build data platforms that deliver real-time insights, support advanced analytics, and integrate seamlessly with AI technologies.

Key Responsibilities
  • Design and Development: Architect and implement scalable Data Lakehouse Platforms using open-source technologies.
  • Pipeline Optimization: Develop and optimize data pipelines for both real-time and batch processing with tools like Spark and Airflow.
  • Storage and Format Management: Implement modern storage formats such as Apache Iceberg, Hudi, or Delta Lake, ensuring efficient data storage and retrieval.
  • Orchestration and Deployment: Manage deployment and orchestration using Kubernetes and Docker across cloud (AWS, GCP, Azure) or on-prem environments.
  • Data Governance: Establish and maintain robust governance practices, including database CDC replication and lineage tracking.
  • Analytics Integration: Support interactive dashboards and analytics tools, such as Superset or similar, enabling data-driven decisions.
  • Performance Tuning: Monitor system performance and implement optimizations to ensure scalability and cost-efficiency.
  • Innovation: Stay ahead of industry trends, experimenting with emerging technologies to continuously improve the platform.
What You’ll Bring
  • 3+ years of experience in data platform engineering, with expertise in open-source tools and cloud technologies.
  • Strong understanding of distributed computing frameworks like Spark and query engines like Trino or Presto.
  • Proficiency in containerization and orchestration technologies (Docker, Kubernetes).
  • Hands-on experience with cloud platforms (AWS, GCP, Azure) and hybrid/on-prem infrastructure.
  • Familiarity with ETL/ELT workflows, CDC replication tools, and modern data storage solutions.
  • Proficiency in programming languages like Python, Java, or Scala.
  • Experience managing large-scale data systems (terabyte/petabyte-scale) and optimizing for performance.
  • Excellent problem-solving skills and a passion for leveraging open-source technologies to build transformative solutions.


Preferred Qualifications
  • Familiarity with AI/ML frameworks and integration.
  • Experience with CI/CD workflows and infrastructure as code (e.g., Terraform, Ansible).
  • Knowledge of data governance frameworks and compliance standards.


Why Join Us?
  • Innovative Work: Be part of a company at the cutting edge of data engineering, working on impactful and transformative projects.
  • Growth Opportunities: We invest in your professional development, offering learning opportunities and career progression pathways.
  • Collaborative Environment: Join a supportive team of experts who thrive on solving complex challenges together.
  • Flexible Work Options: Enjoy a healthy work-life balance with remote work flexibility and competitive compensation.
  • Impactful Solutions: Help shape data solutions that drive real-world results for businesses across industries.


What Makes This Role Unique
  • Work with open-source technologies at scale.
  • Tackle complex challenges in data engineering and analytics.
  • Be part of a fast-growing team, where your ideas and contributions will directly influence our success.


About Our Tech Stack

You’ll work with a comprehensive suite of tools and frameworks, including:

  • Distributed computing: Apache Spark, Hive
  • Streaming and messaging: Kafka
  • Query engines: Trino, Presto
  • Orchestration: Airflow
  • Storage formats: Apache Hudi, Iceberg, Delta Lake
  • Visualization: Superset
  • Containerization: Docker, Kubernetes
  • Cloud platforms: AWS, GCP, Azure


How to Apply

Are you ready to take your data engineering career to the next level? Apply today to join a team that’s transforming how the world works with data.


Apply Now on




  • rajahmundry, India Trek Health Full time

    Company DescriptionTrek Health is revolutionizing healthcare with its Payer Price Transparency Analytics Platform. Our solutions offer payer-provider price transparency insights and analytics. We take pride in ingesting and processsing multi-terabytes of data every month and provide actionable insights to our customers. The company is backed by $3M seed...


  • rajahmundry, India Essvee Consultant Full time

    Profile : Scala Data Engineer / Sr. Data Engineer | Location: Mumbai | Experience: 5 or 5+ years | Budget : 10 to 15lac | Hybrid Job |Note: If you want your CV shortlisted, Copy, Paste and fill out the below form for a better response.Scala Data Engineer / Sr. Data Engineer Skills: Spark, Data Bricks, Azure, Azure Data, SQL, Services, Databricks, Data...


  • Rajahmundry, India Holcim Global Digital Hub Full time

    Job Title : Data ScienceExperience: 6 -8yrsJob Location : RemoteEducation:Education / QualificationBE / B. Tech in Computer Science, Engineering or relevant fieldGraduate degree in Data Science or other quantitative field is preferredStrong mathematics skills (e.g. statistics, algebra)Certification in Cloud Analytics Platforms – AWS mustThe Data Scientist...


  • Rajahmundry, India Maverick Technology Partners Full time

    Aternity Platform Engineer, New DelhiHybrid, 3 days a week onsite (Local Candidates Only)3 month+ contract roleYOU BRING (EXPERIENCE & QUALIFICATIONS): · 5+ years of experience with Aternity or other application performance system. Expert skills with the Microsoft Windows OS, including understanding the registry and WMI. Working knowledge of performance...


  • Rajahmundry, Andhra Pradesh, India Teja Technical Services Full time

    Teja Technical Services, a pioneering provider of cutting-edge technical solutions, seeks a meticulous District MIS expert to drive data-driven decision-making across its districts. With a strong focus on operational efficiency and growth, the company prides itself on delivering exceptional services through innovative technology and skilled...


  • Rajahmundry, India Tata Consultancy Services Full time

    Greetings from TCS !!!Job Title : Big Data DeveloperLocation- Gurgaon/CHN/BLR/HYD/Kochi/TrivandrumExperience required : 4 to 8KEYSKILLS- Big Data DeveloperMSUT HAVE-. Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools. · Should be able to develop, tweak queries and work on performance enhancement. · Solid understanding of...


  • Rajahmundry, India Activate Talent Full time

    Title: Product Data Management Associate Schedule: US Time zoneIndustry: Apparel Job Description:We are seeking a highly organized and detail-oriented Product Data Management Associate to join our team. In this role, you will be responsible for managing and maintaining accurate product data across multiple platforms, including NetSuite and Shopify. You will...


  • Rajahmundry, Andhra Pradesh, India CoinSwitch Full time

    We are seeking a skilled Crypto Data Insights Specialist to join our team at CoinSwitch, India's largest crypto app.OverviewCoinSwitch breaks down the complexities in Crypto, empowering everyday Indians to make informed investment decisions on a simple and trusted platform. With over 20 million users trusting us, we are committed to making Crypto...


  • Rajahmundry, Andhra Pradesh, India HTC Global Services Full time

    HTC Global Services: A Leader in IT SolutionsHTC Inc. is a renowned global Information Technology solution and BPO provider, with a presence in multiple industry verticals. Our company offers turnkey project lifecycle solutions in e-business, data warehousing, embedded systems, ECM, SCM, CRM, and ERP.Duck Creek Policy Developer Job SummaryWe are seeking an...


  • Rajahmundry, Andhra Pradesh, India Eternz Full time

    About Eternz">Eternz is a leading jewelry brand in Bengaluru, dedicated to delivering exceptional jewelry experiences and showcasing unparalleled brilliance. With an extensive collection of exquisite pieces and bespoke customization options, we cater to modern women seeking unique and personalized jewelry that elevates their style.">Job Overview">This is a...

  • SAP Public Cloud

    3 weeks ago


    Rajahmundry, India KashSam Data Solutions Pvt Ltd Full time

    Company DescriptionKashSam Data Solutions Pvt Ltd, based in Gurugram, enables businesses to embrace a data-driven decision-making culture and undergo digital transformation. The company specializes in interpreting complex data technologies into practical terms for businesses to leverage effectively. With expertise in various verticals, KashSam provides...

  • Data Analysis Lead

    1 week ago


    Rajahmundry, Andhra Pradesh, India CoinSwitch Full time

    Company OverviewCoinSwitch is a pioneering crypto platform that empowers Indian users to make informed investment decisions. With over 20 million users, we are India's largest crypto app.Role SummaryWe're seeking a seasoned Data Analysis Lead to join our team. As a key member, you will be responsible for conducting in-depth analysis of product data, user...


  • Rajahmundry, Andhra Pradesh, India Hoichoi Full time

    About HoichoiWe are a leading on-demand video streaming entertainment platform for Bengalis worldwide, with an array of exciting content choices including Bengali classics, blockbusters, documentaries, short films, and exclusive original web series. Our aim is to be home to the best in Bengali entertainment.Hoichoi is the digital vertical of SVF...


  • Rajahmundry, India Groupe SII Full time

    What about the role?Development of a modern card issuing platform assembling banking core systems with modern digital componentsConnect our customers to the client's solutions, configure and enable the services following the requirements and best practices.Provide technical guidance and participate in troubleshooting sessionsLead all the technical tasks of...


  • Rajahmundry, India Oracle Full time

    Short description We are seeking an experienced and talented Principle Software Engineer - IC4 Engineer with a strong background in Java Backend development to join our dynamic team. The ideal candidate will have a deep understanding of distributed systems and expertise in DevOps tools and strong programming skills in languages such as Java, Python. As a...


  • Rajahmundry, Andhra Pradesh, India HiPaaS Inc. Full time

    Job OverviewWe are seeking a skilled Chief Data Infrastructure Architect to lead the design and implementation of cutting-edge data infrastructure that drives real business insights at HiPaaS Inc.

  • DevOps Engineer

    1 week ago


    Rajahmundry, India Insight Global Full time

    Insight Global is looking for a DevOps to join one of North American’s largest retail and wellness companies. The ideal candidate will be joining the Enterprise Platform Engineering team that is focused on the improvement and betterment of the GitLab platform. This role will require you to enable and empower people to solve problems as they are faced with...


  • rajahmundry, India Vidorra LLC Full time

    Job Title: Data Entry TypistJob Summary:We are seeking a highly accurate and efficient Data Entry Typist to join our team. The ideal candidate will have excellent typing skills, attention to detail, and the ability to work in a fast-paced environment. The successful candidate will be responsible for accurately and efficiently entering data into our computer...


  • Rajahmundry, India BlockTXM Inc Full time

    Skills Set Needed:Integration Testing, API Testing, Bulk Materials Construction, Dispatch Systems, SaaS Platforms, Manual & Automated Testing (Selenium, JIRA, Postman), Command Alkon Integration, SAP ERP Integration, Sage Integration, Twilio API, Microsoft Dynamics 365, Data Flow Validation, CRM Tools, Real-time Analytics, Troubleshooting Complex...

  • Sr. Software Engineer

    4 weeks ago


    Rajahmundry, India 360 Cloud Solution Private Limited Full time

    Company Description360 Cloud Solution Private Limited, founded in 2022, is an IT Services and IT Consulting company based in India. The company offers dedicated resources in various skills including Salesforce, Vlocity, CRM, PeopleSoft, Oracle, Business Analyst, QA, DevOps, AWS, Azure, ServiceNow, UI/UX Developer, Front-end Developer, and Data Engineer. They...