Lead Data Platform Architect

1 month ago

Bangalore, India Digitopcs consulting Full time
Job Title: Lead Data Platform Engineer

Job Summary:

We are seeking a highly skilled Lead Data Platform Engineer to lead the design and engineering of a scalable, secure, and cost-optimized Streaming Data Platform. The successful candidate will have a strong background in leading the design and implementation of complex data platforms, with a focus on cloud-native technologies and streaming data processing.

Key Responsibilities:

  • Lead the design and engineering of a scalable, secure, and cost-optimized Streaming Data Platform.
  • Lead role in evolving from on-prem to hybrid cloud infrastructure with Kafka as the core technology.
  • Lead platform upgrades and installs.
  • Perform procedures in Development.
  • Collaborate with Operations team in production.
  • Develop automation of platform components (infrastructure as code).
  • Integrate platform metrics into the Syniverse monitoring stack.
  • Execute DB performance analysis.
  • Collaborate with Development teams to provide results and recommendations.
  • Perform Capacity analysis to be applied directly in planning infrastructure design/purchases.
  • Communicate results/recommendations to leadership team.

Qualifications:

  • Bachelor's Degree in Computer Science or equivalent.
  • 10+ years relevant experience managing Database, Analytics, and Streaming Platforms.
  • 7+ years of programming with Java, python, or Go.
  • 5+ years of Linux experience in both scripting and administrative role.
  • 4+ years Kafka with a preference for Confluent platform: Deploying and managing Brokers, Zookeeper, Schema Registry, ksqlDB, and Connectors.
  • Cloud skills: Production experience with Public Cloud. AWS strongly preferred. Production experience deploying Kafka in cloud and on-prem. Production experience deploying cloud native DB services in the cloud. Experience performing assessment of Cloud and on-prem data system.
  • DBA experience with preference for PostgreSQL or similar relational database. Production experience tuning queries and optimizing performance on large scale Analytic DBs. Experience developing automation scripts for infrastructure and platform with Ansible strongly preferred.
  • Demonstrates understanding of Data Model design and tradeoffs. Demonstrates ability to work across teams including Operations, Development, DBA, and Infrastructure admins. Demonstrates clear communication to peers and leadership.

Desired:

  • Production experience with Impala (Cloudera) or Snowflake DB including data ingestion, schema design, and tuning.
  • Experience setting up Grafana and Prometheus for metrics capture.
  • Development of Stream processing applications using Confluent (ksqlDB and Kafka Streams).
  • Experience in DBA role on TimescaleDB.
  • Data pipeline experience using python, Spark Streaming, Streamsets, Kafka Connect, and ksqlDB.
  • Experience deploying on Kubernetes using Containers.
  • OLTP DB data model and workload tuning experience.
  • Previous experience managing Cloudera CDH clusters.
  • Logging using Logstash, Fluentd or equivalent

About Us:

Digitopcs consulting is a leading provider of data platform solutions. We are committed to delivering high-quality solutions that meet the needs of our clients.

  • Data Solutions Architect

    1 month ago

    Bangalore, India HEVO DATA Full time

    Job Title: Data Solutions ArchitectJob Summary:We are seeking a skilled Data Solutions Architect to join our team at Hevo Data. As a Data Solutions Architect, you will be responsible for working closely with our sales team to understand customer needs and demonstrate how Hevo's platform can solve their real-time data replication needs.Key...

  • Lead Data Platform Architect

    4 weeks ago

    Bangalore, India CONQUER HIRE LLP Full time

    Job Title: Technical ArchitectWe are seeking an experienced Technical Architect to lead the development of our next-generation products leveraging artificial intelligence for life science companies, improving patient experience and outcomes. This role will drive our current business intelligence solution to the next level. The ideal candidate will serve as...

  • Healthcare Data Platform Architect

    4 weeks ago

    Bangalore, India yitrobc Full time

    Healthcare Data Platform Architect OpportunityAt yitrobc, we're looking for a skilled Healthcare Data Platform Architect to join our team. As a key member of our tech team, you'll play a crucial role in designing and implementing a robust, scalable, secure, and cutting-edge technology-based healthcare data platform. This platform will involve working closely...

  • Senior Data Platform Architect

    4 weeks ago

    Bangalore, India CodeX Tech-IT LLC Full time

    About the RoleWe are seeking a highly skilled Senior Data Platform Architect to lead the design and development of our cloud-native data platform. As a key member of our team, you will play a critical role in building and scaling our data infrastructure to support complex data processing and analytics needs.Key Responsibilities:Design and implement a...

  • Principal Architect

    2 months ago

    Bangalore, Karnataka, India yitrobc Full time

    Description :As a Platform Architect, you will be responsible for designing and implementing a robust, scalable, secure and cutting edge technology based healthcare data platform. Your role will involve working closely with cross-functional teams to ensure the platform meets industry standards and supports the efficient integration and management of...

  • Platform Architect

    1 week ago

    bangalore, India developrec Full time

    Salesforce Platform Architect (SAP and Web Integration experience needed) Bengaluru/Remote – Contract role We are seeking an experienced Salesforce and Web Integration Platform Architect to lead the end-to-end architecture for the digital eB2B portal. This role requires deep expertise in Salesforce (including B2B Commerce, Experience Cloud, Service...

  • Platform Architect

    1 week ago

    bangalore, India developrec Full time

    Salesforce Platform Architect (SAP and Web Integration experience needed)Bengaluru/Remote – Contract roleWe are seeking an experienced Salesforce and Web Integration Platform Architect to lead the end-to-end architecture for the digital eB2B portal.This role requires deep expertise in Salesforce (including B2B Commerce, Experience Cloud, Service Cloud,...

  • Data engineer

    1 month ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Data Engineer

    2 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. - Lead the architecture, design, and delivery of enterprise grade microservices. - Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    1 month ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    2 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Platform Architect

    4 weeks ago

    Bangalore, India Talpro Full time

    Job SummaryWe are seeking a talented Data Platform Architect to join our team at Talpro. As a key member of our data engineering team, you will be responsible for designing and developing scalable and high-performance data platforms.Key Responsibilities• Design and develop data ingestion, transformation, and processing pipelines using technologies such...

  • Data Architect Lead

    1 month ago

    Bangalore/Hyderabad, India Coders Brain Technology & Private Limited Full time

    Job Title: Data Solution Architect/Data Architect/Big Data ArchitectSalary Range: ₹20LPA - ₹75LPAExperience: 11 to 22 YearsLocation: Hyderabad onlyNotice Period: ImmediateRole: Data Solution ArchitectShift Timings: RegularWork Mode: Hybrid (3 days a week is mandatory)Job Role: FTEEducation Qualification: BE/BTech/MCA onlyJob Description:Key...

  • Data Architect Lead

    1 month ago

    Bangalore, India Ds Full time

    As a key member of our Data Platforms & Products team, you will lead the development of next-generation data capabilities that drive business growth. Your expertise in data architecture and modeling will be instrumental in shaping our data products and driving innovation.Working closely with our Business Analytics leaders, you will understand the needs of...

  • Senior Data Platform Architect

    1 month ago

    Bangalore, India Vsquare Systems Pvt. Ltd. Full time

    Senior Data Platform ArchitectVsquare Systems Pvt. Ltd. is seeking a highly skilled Senior Data Platform Architect to design and implement scalable and secure data platforms.Key Responsibilities:Design and document data platform architecture, ensuring alignment with business goals and technical requirements.Develop architectural blueprints, including data...

  • Data Engineer

    3 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Senior Cloud Data Platform Architect

    4 weeks ago

    Bangalore, India Digitopcs consulting Full time

    Job Description:As a Senior Cloud Data Platform Architect at Digitopcs consulting, you will lead the design and engineering of a scalable, secure, and cost-optimized Streaming Data Platform. This role involves evolving from on-prem to hybrid cloud infrastructure with Kafka as the core technology. Key Responsibilities:- Lead the design and implementation of a...

  • Data Engineer

    1 month ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Platform Lead

    2 weeks ago

    bangalore, India Minus Zero Full time

    About this Role: - Technical leader of the Data Platform, connect with stakeholder, build partnerships and grow the Data Platform team in Bangalore - Own the APIs that services at Toast use to query and retrieve data - Operate and maintain our batch and streaming data processing workflows in production - Own the APIs teams at Toast use to access, process...

  • Data Platform Lead

    2 weeks ago

    bangalore, India Minus Zero Full time

    About this Role: Technical leader of the Data Platform, connect with stakeholder, build partnerships and grow the Data Platform team in Bangalore Own the APIs that services at Toast use to query and retrieve data Operate and maintain our batch and streaming data processing workflows in production Own the APIs teams at Toast use to access, process and...