OSD Data Services | Data Platform Engineer | india
16 hours ago
Location : Remote
Type : Internship
About UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a comprehensive Data Lakehouse Platform that integrates the best tools to handle everything from ingestion and governance to analytics and machine learning.
We pride ourselves on being at the forefront of data engineering, combining a passion for innovation with a commitment to solving real-world data challenges. By joining us, you’ll have the chance to work with cutting-edge technologies and some of the brightest minds in the industry.
We are looking for a Data Platform Engineer with a passion for OSD to design, build, and optimize scalable, high-performance data platforms. You’ll play a key role in enabling our clients to extract maximum value from their data by leveraging the power of tools like Spark, Kafka, Kubernetes, and Trino .
This role offers the unique opportunity to work on complex, petabyte-scale projects, shaping the future of data infrastructure for businesses across industries. You’ll collaborate with talented teams to build data platforms that deliver real-time insights, support advanced analytics, and integrate seamlessly with AI technologies.
- Design and Development : Architect and implement scalable Data Lakehouse Platforms using open-source technologies.
- Pipeline Optimization : Develop and optimize data pipelines for both real-time and batch processing with tools like Spark and Airflow .
- Storage and Format Management : Implement modern storage formats such as Apache Iceberg, Hudi, or Delta Lake , ensuring efficient data storage and retrieval.
- Orchestration and Deployment : Manage deployment and orchestration using Kubernetes and Docker across cloud (AWS, GCP, Azure) or on-prem environments.
- Data Governance : Establish and maintain robust governance practices, including database CDC replication and lineage tracking.
- Analytics Integration : Support interactive dashboards and analytics tools, such as Superset or similar, enabling data-driven decisions.
- Performance Tuning : Monitor system performance and implement optimizations to ensure scalability and cost-efficiency.
- Innovation : Stay ahead of industry trends, experimenting with emerging technologies to continuously improve the platform.
- 3+ years of experience in data platform engineering, with expertise in open-source tools and cloud technologies.
- Strong understanding of distributed computing frameworks like Spark and query engines like Trino or Presto .
- Proficiency in containerization and orchestration technologies (Docker, Kubernetes ).
- Hands-on experience with cloud platforms (AWS, GCP, Azure) and hybrid/on-prem infrastructure.
- Familiarity with ETL/ELT workflows, CDC replication tools, and modern data storage solutions.
- Proficiency in programming languages like Python, Java, or Scala .
- Experience managing large-scale data systems (terabyte/petabyte-scale) and optimizing for performance.
- Excellent problem-solving skills and a passion for leveraging open-source technologies to build transformative solutions.
- Familiarity with AI/ML frameworks and integration.
- Experience with CI/CD workflows and infrastructure as code (e.g., Terraform, Ansible).
- Knowledge of data governance frameworks and compliance standards.
- Innovative Work : Be part of a company at the cutting edge of data engineering, working on impactful and transformative projects.
- Growth Opportunities : We invest in your professional development, offering learning opportunities and career progression pathways.
- Collaborative Environment : Join a supportive team of experts who thrive on solving complex challenges together.
- Flexible Work Options : Enjoy a healthy work-life balance with remote work flexibility and competitive compensation.
- Impactful Solutions : Help shape data solutions that drive real-world results for businesses across industries.
- Work with open-source technologies at scale.
- Tackle complex challenges in data engineering and analytics.
- Be part of a fast-growing team, where your ideas and contributions will directly influence our success.
You’ll work with a comprehensive suite of tools and frameworks, including:
- Distributed computing: Apache Spark, Hive
- Streaming and messaging: Kafka
- Query engines: Trino, Presto
- Orchestration: Airflow
- Storage formats: Apache Hudi, Iceberg, Delta Lake
- Visualization: Superset
- Containerization: Docker, Kubernetes
- Cloud platforms: AWS, GCP, Azure
Are you ready to take your data engineering career to the next level? Apply today to join a team that’s transforming how the world works with data.
-
india OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
OSD Data Services | Data Platform Engineer | india
17 hours ago
india OSD Data Services Full timeData Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Data Platform Engineer
2 days ago
India OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Data Platform Engineer
15 hours ago
India OSD Data Services Full timeData Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...
-
Senior Data Infrastructure Architect
2 days ago
India OSD Data Services Full timeAbout the RoleWe are seeking a highly skilled Senior Data Infrastructure Architect to join our team at OSD Data Services. This is an exciting opportunity to work with cutting-edge technologies and be part of a fast-growing company that's transforming how businesses leverage their data.
-
india Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...
-
Data Warehouse Engineer
1 week ago
India Data Warehouse Engineer Full timeExperience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.
-
Senior Data Integration Engineer
2 weeks ago
India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...
-
Data Warehouse Expert for Analytics Projects
1 week ago
India Data Warehouse Engineer Full timeAbout the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
india Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
Aws data engineer
2 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Cloud Data Engineering Lead
6 days ago
India ITI Data Full timeITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...
-
AWS Data Engineer
4 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
4 months ago
India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
1 month ago
india ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
4 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
