OSD Data Services | Data Platform Engineer
2 days ago
Location: Remote
Type: Internship
About UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a comprehensive Data Lakehouse Platform that integrates the best tools to handle everything from ingestion and governance to analytics and machine learning.
We pride ourselves on being at the forefront of data engineering, combining a passion for innovation with a commitment to solving real-world data challenges. By joining us, you’ll have the chance to work with cutting-edge technologies and some of the brightest minds in the industry.
We are looking for a Data Platform Engineer with a passion for OSD to design, build, and optimize scalable, high-performance data platforms. You’ll play a key role in enabling our clients to extract maximum value from their data by leveraging the power of tools like Spark, Kafka, Kubernetes, and Trino.
This role offers the unique opportunity to work on complex, petabyte-scale projects, shaping the future of data infrastructure for businesses across industries. You’ll collaborate with talented teams to build data platforms that deliver real-time insights, support advanced analytics, and integrate seamlessly with AI technologies.
- Design and Development: Architect and implement scalable Data Lakehouse Platforms using open-source technologies.
- Pipeline Optimization: Develop and optimize data pipelines for both real-time and batch processing with tools like Spark and Airflow.
- Storage and Format Management: Implement modern storage formats such as Apache Iceberg, Hudi, or Delta Lake, ensuring efficient data storage and retrieval.
- Orchestration and Deployment: Manage deployment and orchestration using Kubernetes and Docker across cloud (AWS, GCP, Azure) or on-prem environments.
- Data Governance: Establish and maintain robust governance practices, including database CDC replication and lineage tracking.
- Analytics Integration: Support interactive dashboards and analytics tools, such as Superset or similar, enabling data-driven decisions.
- Performance Tuning: Monitor system performance and implement optimizations to ensure scalability and cost-efficiency.
- Innovation: Stay ahead of industry trends, experimenting with emerging technologies to continuously improve the platform.
- 3+ years of experience in data platform engineering, with expertise in open-source tools and cloud technologies.
- Strong understanding of distributed computing frameworks like Spark and query engines like Trino or Presto.
- Proficiency in containerization and orchestration technologies (Docker, Kubernetes).
- Hands-on experience with cloud platforms (AWS, GCP, Azure) and hybrid/on-prem infrastructure.
- Familiarity with ETL/ELT workflows, CDC replication tools, and modern data storage solutions.
- Proficiency in programming languages like Python, Java, or Scala.
- Experience managing large-scale data systems (terabyte/petabyte-scale) and optimizing for performance.
- Excellent problem-solving skills and a passion for leveraging open-source technologies to build transformative solutions.
- Familiarity with AI/ML frameworks and integration.
- Experience with CI/CD workflows and infrastructure as code (e.g., Terraform, Ansible).
- Knowledge of data governance frameworks and compliance standards.
- Innovative Work: Be part of a company at the cutting edge of data engineering, working on impactful and transformative projects.
- Growth Opportunities: We invest in your professional development, offering learning opportunities and career progression pathways.
- Collaborative Environment: Join a supportive team of experts who thrive on solving complex challenges together.
- Flexible Work Options: Enjoy a healthy work-life balance with remote work flexibility and competitive compensation.
- Impactful Solutions: Help shape data solutions that drive real-world results for businesses across industries.
- Work with open-source technologies at scale.
- Tackle complex challenges in data engineering and analytics.
- Be part of a fast-growing team, where your ideas and contributions will directly influence our success.
You’ll work with a comprehensive suite of tools and frameworks, including:
- Distributed computing: Apache Spark, Hive
- Streaming and messaging: Kafka
- Query engines: Trino, Presto
- Orchestration: Airflow
- Storage formats: Apache Hudi, Iceberg, Delta Lake
- Visualization: Superset
- Containerization: Docker, Kubernetes
- Cloud platforms: AWS, GCP, Azure
Are you ready to take your data engineering career to the next level? Apply today to join a team that’s transforming how the world works with data.
Apply Now on
-
Trek Health | Senior Data Engineer
2 days ago
rajahmundry, India Trek Health Full timeCompany DescriptionTrek Health is revolutionizing healthcare with its Payer Price Transparency Analytics Platform. Our solutions offer payer-provider price transparency insights and analytics. We take pride in ingesting and processsing multi-terabytes of data every month and provide actionable insights to our customers. The company is backed by $3M seed...
-
rajahmundry, India Essvee Consultant Full timeProfile : Scala Data Engineer / Sr. Data Engineer | Location: Mumbai | Experience: 5 or 5+ years | Budget : 10 to 15lac | Hybrid Job |Note: If you want your CV shortlisted, Copy, Paste and fill out the below form for a better response.Scala Data Engineer / Sr. Data Engineer Skills: Spark, Data Bricks, Azure, Azure Data, SQL, Services, Databricks, Data...
-
Senior Data Scientist
6 days ago
Rajahmundry, India Holcim Global Digital Hub Full timeJob Title : Data ScienceExperience: 6 -8yrsJob Location : RemoteEducation:Education / QualificationBE / B. Tech in Computer Science, Engineering or relevant fieldGraduate degree in Data Science or other quantitative field is preferredStrong mathematics skills (e.g. statistics, algebra)Certification in Cloud Analytics Platforms – AWS mustThe Data Scientist...
-
Aternity Platform Engineer
1 week ago
Rajahmundry, India Maverick Technology Partners Full timeAternity Platform Engineer, New DelhiHybrid, 3 days a week onsite (Local Candidates Only)3 month+ contract roleYOU BRING (EXPERIENCE & QUALIFICATIONS): · 5+ years of experience with Aternity or other application performance system. Expert skills with the Microsoft Windows OS, including understanding the registry and WMI. Working knowledge of performance...
-
District MIS Professional
4 weeks ago
Rajahmundry, Andhra Pradesh, India Teja Technical Services Full timeTeja Technical Services, a pioneering provider of cutting-edge technical solutions, seeks a meticulous District MIS expert to drive data-driven decision-making across its districts. With a strong focus on operational efficiency and growth, the company prides itself on delivering exceptional services through innovative technology and skilled...
-
TCS Opportunity for Big Data Developers
1 week ago
Rajahmundry, India Tata Consultancy Services Full timeGreetings from TCS !!!Job Title : Big Data DeveloperLocation- Gurgaon/CHN/BLR/HYD/Kochi/TrivandrumExperience required : 4 to 8KEYSKILLS- Big Data DeveloperMSUT HAVE-. Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools. · Should be able to develop, tweak queries and work on performance enhancement. · Solid understanding of...
-
Product Data Management Associate
3 weeks ago
Rajahmundry, India Activate Talent Full timeTitle: Product Data Management Associate Schedule: US Time zoneIndustry: Apparel Job Description:We are seeking a highly organized and detail-oriented Product Data Management Associate to join our team. In this role, you will be responsible for managing and maintaining accurate product data across multiple platforms, including NetSuite and Shopify. You will...
-
Crypto Data Insights Specialist
1 week ago
Rajahmundry, Andhra Pradesh, India CoinSwitch Full timeWe are seeking a skilled Crypto Data Insights Specialist to join our team at CoinSwitch, India's largest crypto app.OverviewCoinSwitch breaks down the complexities in Crypto, empowering everyday Indians to make informed investment decisions on a simple and trusted platform. With over 20 million users trusting us, we are committed to making Crypto...
-
Rajahmundry, Andhra Pradesh, India HTC Global Services Full timeHTC Global Services: A Leader in IT SolutionsHTC Inc. is a renowned global Information Technology solution and BPO provider, with a presence in multiple industry verticals. Our company offers turnkey project lifecycle solutions in e-business, data warehousing, embedded systems, ECM, SCM, CRM, and ERP.Duck Creek Policy Developer Job SummaryWe are seeking an...
-
Product Data Management Specialist
3 weeks ago
Rajahmundry, Andhra Pradesh, India Eternz Full timeAbout Eternz">Eternz is a leading jewelry brand in Bengaluru, dedicated to delivering exceptional jewelry experiences and showcasing unparalleled brilliance. With an extensive collection of exquisite pieces and bespoke customization options, we cater to modern women seeking unique and personalized jewelry that elevates their style.">Job Overview">This is a...
-
SAP Public Cloud
3 weeks ago
Rajahmundry, India KashSam Data Solutions Pvt Ltd Full timeCompany DescriptionKashSam Data Solutions Pvt Ltd, based in Gurugram, enables businesses to embrace a data-driven decision-making culture and undergo digital transformation. The company specializes in interpreting complex data technologies into practical terms for businesses to leverage effectively. With expertise in various verticals, KashSam provides...
-
Data Analysis Lead
1 week ago
Rajahmundry, Andhra Pradesh, India CoinSwitch Full timeCompany OverviewCoinSwitch is a pioneering crypto platform that empowers Indian users to make informed investment decisions. With over 20 million users, we are India's largest crypto app.Role SummaryWe're seeking a seasoned Data Analysis Lead to join our team. As a key member, you will be responsible for conducting in-depth analysis of product data, user...
-
Rajahmundry, Andhra Pradesh, India Hoichoi Full timeAbout HoichoiWe are a leading on-demand video streaming entertainment platform for Bengalis worldwide, with an array of exciting content choices including Bengali classics, blockbusters, documentaries, short films, and exclusive original web series. Our aim is to be home to the best in Bengali entertainment.Hoichoi is the digital vertical of SVF...
-
Integration Engineer – Backend Services
2 months ago
Rajahmundry, India Groupe SII Full timeWhat about the role?Development of a modern card issuing platform assembling banking core systems with modern digital componentsConnect our customers to the client's solutions, configure and enable the services following the requirements and best practices.Provide technical guidance and participate in troubleshooting sessionsLead all the technical tasks of...
-
Principal Software Engineer
1 month ago
Rajahmundry, India Oracle Full timeShort description We are seeking an experienced and talented Principle Software Engineer - IC4 Engineer with a strong background in Java Backend development to join our dynamic team. The ideal candidate will have a deep understanding of distributed systems and expertise in DevOps tools and strong programming skills in languages such as Java, Python. As a...
-
Chief Data Infrastructure Architect
4 weeks ago
Rajahmundry, Andhra Pradesh, India HiPaaS Inc. Full timeJob OverviewWe are seeking a skilled Chief Data Infrastructure Architect to lead the design and implementation of cutting-edge data infrastructure that drives real business insights at HiPaaS Inc.
-
DevOps Engineer
1 week ago
Rajahmundry, India Insight Global Full timeInsight Global is looking for a DevOps to join one of North American’s largest retail and wellness companies. The ideal candidate will be joining the Enterprise Platform Engineering team that is focused on the improvement and betterment of the GitLab platform. This role will require you to enable and empower people to solve problems as they are faced with...
-
Vidorra LLC | Data Entry | rajahmundry
4 weeks ago
rajahmundry, India Vidorra LLC Full timeJob Title: Data Entry TypistJob Summary:We are seeking a highly accurate and efficient Data Entry Typist to join our team. The ideal candidate will have excellent typing skills, attention to detail, and the ability to work in a fast-paced environment. The successful candidate will be responsible for accurately and efficiently entering data into our computer...
-
BlockTXM Inc | Senior Quality Assurance Engineer
2 weeks ago
Rajahmundry, India BlockTXM Inc Full timeSkills Set Needed:Integration Testing, API Testing, Bulk Materials Construction, Dispatch Systems, SaaS Platforms, Manual & Automated Testing (Selenium, JIRA, Postman), Command Alkon Integration, SAP ERP Integration, Sage Integration, Twilio API, Microsoft Dynamics 365, Data Flow Validation, CRM Tools, Real-time Analytics, Troubleshooting Complex...
-
Sr. Software Engineer
4 weeks ago
Rajahmundry, India 360 Cloud Solution Private Limited Full timeCompany Description360 Cloud Solution Private Limited, founded in 2022, is an IT Services and IT Consulting company based in India. The company offers dedicated resources in various skills including Salesforce, Vlocity, CRM, PeopleSoft, Oracle, Business Analyst, QA, DevOps, AWS, Azure, ServiceNow, UI/UX Developer, Front-end Developer, and Data Engineer. They...