Senior Data Architect

2 days ago


Meerut, Uttar Pradesh, India OSD Data Services Full time
About OSD Data Services

OSD Data Services is a trailblazer in the data engineering landscape, pushing the boundaries of what's possible with data. Our vision is to empower organizations with unparalleled data insights, driving informed decision-making and business growth. With a focus on innovative data lakehouse solutions, we've developed a robust platform that streamlines data ingestion, governance, and analytics.

Job Overview

We're seeking a highly skilled Data Platform Engineer to lead the design, implementation, and optimization of high-performance data platforms. You'll be responsible for leveraging open-source technologies like Spark, Kafka, and Trino to unlock the full potential of our clients' data.

Key Responsibilities:
  1. Design and Development: Design and implement scalable data platforms using open-source technologies, ensuring seamless integration with existing systems.
  2. Pipeline Optimization: Develop and optimize data pipelines for real-time and batch processing using Spark and Airflow, minimizing latency and maximizing efficiency.
  3. Storage and Format Management: Implement modern storage formats like Apache Iceberg, Hudi, or Delta Lake to optimize data storage and retrieval, ensuring scalability and performance.
  4. Orchestration and Deployment: Manage deployment and orchestration using Kubernetes and Docker across cloud (AWS, GCP, Azure) or on-prem environments, ensuring seamless integration with existing infrastructure.
  5. Data Governance: Establish robust governance practices, including database CDC replication and lineage tracking, to ensure data accuracy and integrity.
  6. Analytics Integration: Support interactive dashboards and analytics tools, enabling data-driven decision-making and business growth.
  7. Performance Tuning: Monitor system performance and implement optimizations for scalability and cost-efficiency, ensuring optimal resource utilization.
  8. Innovation: Stay ahead of industry trends, experimenting with emerging technologies to continuously improve the platform and drive innovation.
Requirements
  • 3+ years of experience in data platform engineering, with expertise in open-source tools and cloud technologies.
  • Strong understanding of distributed computing frameworks like Spark and query engines like Trino or Presto.
  • Proficiency in containerization and orchestration technologies (Docker, Kubernetes).
  • Hands-on experience with cloud platforms (AWS, GCP, Azure) and hybrid/on-prem infrastructure.
  • Familiarity with ETL/ELT workflows, CDC replication tools, and modern data storage solutions.
  • Proficiency in programming languages like Python, Java, or Scala.
  • Experience managing large-scale data systems (terabyte/petabyte-scale) and optimizing for performance.
  • Excellent problem-solving skills and a passion for leveraging open-source technologies to build transformative solutions.
Salary: $120,000 - $180,000 per yearBenefits
  • Competitive salary and benefits package.
  • Ongoing training and professional development opportunities.
  • Collaborative and dynamic work environment.
  • Flexible work arrangements, including remote work options.


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    A New Era in Data EngineeringOSD Data Services is revolutionizing the way businesses approach data engineering. We're looking for a talented Data Platform Engineer to join our team and contribute to the development of our comprehensive Data Lakehouse Platform.Job DescriptionThis role involves designing, building, and optimizing high-performance data...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    Data Platform Engineer Job DescriptionWe are seeking an experienced Data Platform Engineer to join our team in designing, building, and optimizing scalable, high-performance data platforms.The ideal candidate will have expertise in open-source tools and cloud technologies, with strong understanding of distributed computing frameworks and containerization...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    About UsAt OSD Data Services, we're revolutionizing data engineering by empowering organizations with unified, scalable, and seamless data infrastructure.We pride ourselves on being at the forefront of cutting-edge technologies, combining a passion for innovation with a commitment to solving real-world data challenges. As a Data Platform Engineer, you'll...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    Job Description">We are seeking a talented Data Platform Engineer to join our team at OSD Data Services.This is an exciting opportunity for a passionate individual to design, build, and optimize scalable data platforms using cutting-edge technologies. Our ideal candidate will have experience in data lakehouse engineering, distributed computing, and cloud...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    Data Platform Engineer Role OverviewWe are seeking a highly skilled Senior Data Solutions Architect with expertise in designing, building, and optimizing scalable, high-performance data platforms. As a key member of our team, you will play a crucial role in enabling our clients to extract maximum value from their data by leveraging the power of tools like...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    About OSD Data ServicesWe're a cutting-edge data engineering company redefining how businesses leverage their data. Our mission is to empower organizations with seamless, unified, and scalable data infrastructure for smarter decision-making and faster innovation.We combine passion for innovation with a commitment to solving real-world data challenges. By...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    About OSD Data ServicesWe are a cutting-edge data engineering company, redefining how businesses leverage their data. Our mission is to empower organizations with seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation.


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    Innovative WorkAs a Data Platform Engineer at OSD Data Services, you'll be part of a team that's shaping the future of data infrastructure. You'll work with open-source technologies at scale, tackling complex challenges in data engineering and analytics.You'll collaborate with talented teams to build data platforms that deliver real-time insights, support...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    Unlock the Full Potential of Your Business with OSD Data ServicesAt OSD Data Services, we're dedicated to empowering organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation.We're seeking an experienced Data Platform Engineer with a passion for open-source technologies to join our...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    About OSD Data ServicesAt OSD Data Services, we're redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on cloud-based technologies, we've built a comprehensive Data Lakehouse Platform that...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    We're seeking a skilled Data Platform Engineer to join our innovative team at OSD Data Services.About the RoleThis is an exciting opportunity to work on cutting-edge data engineering projects and contribute to the development of a comprehensive Data Lakehouse Platform that integrates the best tools for handling everything from ingestion and governance to...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    About OSD Data ServicesWe are a cutting-edge data engineering company that empowers businesses to unlock the full potential of their data. Our mission is to deliver seamless, unified, and scalable data infrastructure that drives smarter decision-making and faster innovation.Role OverviewWe are seeking a highly skilled Data Platform Engineer to design, build,...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    Unlock the Power of Your DataAre you ready to take your data engineering career to the next level? Join OSD Data Services as a Data Platform Engineer and be part of a team that's transforming how businesses approach data engineering.About the RoleThis is a unique opportunity to work on complex, petabyte-scale projects and shape the future of data...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    Role Description">As a Data Platform Engineer at OSD Data Services, you'll be responsible for designing, building, and optimizing high-performance data platforms that enable businesses to extract maximum value from their data. With a strong focus on innovation and collaboration, our team thrives on solving complex data challenges.You'll leverage your...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    Are you ready to take your data engineering career to the next level? We're looking for a talented Data Platform Engineer to join our team at OSD Data Services.About the RoleThis is an exciting opportunity to work on complex, petabyte-scale projects and shape the future of data infrastructure for businesses across industries.You'll design, build, and...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    Key ResponsibilitiesDesign and Development: Architect and implement scalable Data Lakehouse Platforms using open-source technologies.Pipeline Optimization: Develop and optimize data pipelines for both real-time and batch processing with tools like Spark and Airflow.Storage and Format Management: Implement modern storage formats such as Apache Iceberg, Hudi,...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    About This RoleWe're seeking an experienced Data Platform Engineer to join our team and help us build scalable, high-performance data platforms. As a key member of our team, you'll design and implement data lakehouse platforms, optimize data pipelines, and manage storage and format management.Job DescriptionThis role offers the unique opportunity to work on...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    About OSD Data ServicesAt OSD Data Services, we're redefining the way businesses harness their data potential. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that fosters smarter decision-making and accelerated innovation. With a focus on cutting-edge data lakehouse technologies, we've developed a...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    About Our Tech StackYou'll work with a comprehensive suite of tools and frameworks, including:Distributed computing: Apache Spark, HiveStreaming and messaging: KafkaQuery engines: Trino, PrestoOrchestration: AirflowStorage formats: Apache Hudi, Iceberg, Delta LakeVisualization: SupersetContainerization: Docker, KubernetesCloud platforms: AWS, GCP, AzureAbout...


  • Meerut, Uttar Pradesh, India OSD Data Services Full time

    Overview">OSD Data Services is at the forefront of data engineering, pushing the boundaries of what's possible with data. As a Data Platform Engineer, you'll be instrumental in designing, building, and optimizing high-performance data platforms that transform businesses across industries.With a strong focus on innovation and collaboration, our team thrives...