Data Platform Engineer

1 month ago


Bangalore Metropolitan Area, India ApTask Full time

Primary responsibilities:

Lead the design and engineering of a scalable, secure, and cost-optimized Streaming Data Platform

Lead role in evolving from (current) on-prem to hybrid cloud infrastructure with Kafka as the core technology

Lead platform upgrades and installs. Perform the procedures in Development. Collaborate with Operations team in production.

Develop automation of platform components (infrastructure as code)

Integrate platform metrics into the Syniverse monitoring stack

Execute DB performance analysis. Collaborate with Development teams to provide results and recommendations. This includes queries, DB schema design, and aggregation layers.

Perform Capacity analysis to be applied directly in planning infrastructure design/purchases

Communicate results/recommendations to leadership team


Qualifications :

Bachelor’s Degree in Computer Science or equivalent

10+ years relevant experience managing Database, Analytics, and Streaming Platforms.

7+ years of programming with Java, python, or Go

5+ years of Linux experience in both scripting and administrative role

4+ years Kafka with a preference for Confluent platform:

Deploying and managing Brokers, Zookeeper, Schema Registry, ksqlDB, and Connectors

Setup mirroring of Kafka topics data across clusters, DCs, and Cloud


Cloud skills:

Production experience with Public Cloud. AWS strongly preferred.

Production experience deploying Kafka in cloud and on-prem

Production experience deploying cloud native DB services in the cloud

Experience performing assessment of Cloud and on-prem data system

DBA experience with preference for PostgreSQL or similar relational database

Production experience tuning queries and optimizing performance on large scale Analytic DBs

Experience developing automation scripts for infrastructure and platform with Ansible strongly preferred

Demonstrates understanding of Data Model design and tradeoffs

Demonstrates ability to work across teams including Operations, Development, DBA, and Infrastructure admins

Demonstrates clear communication to peers and leadership



  • Bangalore Metropolitan Area, India NXP Semiconductors Full time

    As a Graph Engineer, you will:Develop pipelines and code to support the ingress and egress of this data to and from the knowledge graphs. Perform basic and advanced graph querying and data modeling on the knowledge graphs that lie at the heart of the organization's Product Creation ecosystem. Maintain the (ETL) pipelines, code and Knowledge Graph to stay...


  • Bangalore Metropolitan Area, India MResult Full time

    About MResult MResult is a leading Data & Analytics intelligence technology solutions provider to companies that value insights from information as a competitive advantage. We are the partner of choice for enterprises on their digital transformation journey. Our teams offer solutions and services at the intersection of Advanced Data, Analytics, and AI. These...


  • Bangalore Metropolitan Area, India Multiplier Full time

    Multiplier enables companies to employ anyone, anywhere, in a few clicks. Our SaaS platform combines the multi-local complexities of hiring & paying employees anywhere in the world and automates everything. We are passionate about creating a world where people can get a job they love without leaving the people they love.We are an early-stage start-up with a...

  • Lead Data Engineer

    6 days ago


    Bangalore Metropolitan Area, India SMC Squared India Full time

    Job Title: Lead Data Engineer Location: Bangalore Experience: 7+ YearsWork Mode: Hybrid(3 days WFO) Job Type:Full-time/Permanent Notice Period: Immediate to 15 days.----------------------------------------------------------------------------------------------------------------------------------------------------------------------Job Description:We are...

  • Senior Data Engineer

    2 weeks ago


    Bangalore Metropolitan Area, India Applicantz Full time

    THIS IS A CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER.Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and Flexible work environment. They use cutting edge technologies to keep themselves ahead of the curve. Diversity in all aspects is...


  • Greater Bengaluru Area, India ApTask Full time

    Primary responsibilities: Lead the design and engineering of a scalable, secure, and cost-optimized Streaming Data Platform Lead role in evolving from (current) on-prem to hybrid cloud infrastructure with Kafka as the core technology Lead platform upgrades and installs. Perform the procedures in Development. Collaborate with Operations team in production....


  • Greater Bengaluru Area, India ApTask Full time

    Primary responsibilities:Lead the design and engineering of a scalable, secure, and cost-optimized Streaming Data PlatformLead role in evolving from (current) on-prem to hybrid cloud infrastructure with Kafka as the core technologyLead platform upgrades and installs. Perform the procedures in Development. Collaborate with Operations team in...


  • Bangalore Metropolitan Area, India Diversified Full time

    Job Description: Exp - 5+ yearsShift: Rotational ShiftThe Deployment Engineer will be responsible for supporting proactive monitoring system deployments for audio visual, video conferencing and digital signage devices. The deployment engineer will also perform ongoing platform support and development. The Engineer will be involved with the onboarding of new...


  • Bangalore Metropolitan Area, India Diversified Full time

    Job Description: Exp - 5+ yearsShift: Rotational ShiftThe Deployment Engineer will be responsible for supporting PULSE implementations as well as ongoing platform support and development. The Engineer will be involved with the onboarding of new and existing clients and any future changes for PULSE Managed Service products and services such as feature...

  • Data Engineer

    4 weeks ago


    Bangalore Metropolitan Area, India Kratos Gamer Network Full time

    About KGeN:KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer cohorts,...


  • Bangalore, India NXP Semiconductors Full time

    As a Graph Engineer, you will: Develop pipelines and code to support the ingress and egress of this data to and from the knowledge graphs. Perform basic and advanced graph querying and data modeling on the knowledge graphs that lie at the heart of the organization's Product Creation ecosystem. Maintain the (ETL) pipelines, code and Knowledge Graph...


  • Greater Bengaluru Area, India NXP Semiconductors Full time

    As a Graph Engineer, you will:Develop pipelines and code to support the ingress and egress of this data to and from the knowledge graphs. Perform basic and advanced graph querying and data modeling on the knowledge graphs that lie at the heart of the organization's Product Creation ecosystem. Maintain the (ETL) pipelines, code and Knowledge Graph to stay...


  • Greater Bengaluru Area, India NXP Semiconductors Full time

    As a Graph Engineer, you will: Develop pipelines and code to support the ingress and egress of this data to and from the knowledge graphs. Perform basic and advanced graph querying and data modeling on the knowledge graphs that lie at the heart of the organization's Product Creation ecosystem. Maintain the (ETL) pipelines, code and Knowledge Graph to stay...


  • Bangalore, India CodeX Tech-IT LLC Full time

    About the RoleWe are seeking a highly skilled Senior Data Platform Engineer to join our team at CodeX Tech-IT LLC. As a key member of our data engineering team, you will play a critical role in building and scaling our data platform to support complex data processing and analytics needs.Key Responsibilities- Design and develop a scalable and reliable data...


  • bangalore, India ApTask Full time

    Primary responsibilities:Lead the design and engineering of a scalable, secure, and cost-optimized Streaming Data PlatformLead role in evolving from (current) on-prem to hybrid cloud infrastructure with Kafka as the core technologyLead platform upgrades and installs. Perform the procedures in Development. Collaborate with Operations team in...


  • bangalore, India Clappia ⢸ No-Code Platform Full time

    Duration: 6 months Start date: Immediately Selected intern's day-to-day responsibilities include: 1. Engaging with existing customers and potential clients to understand their technical requirements and provide tailored solutions on the Clappia platform. 2. Collaborating with the engineering and sales teams to translate customer needs into technical...


  • Bangalore Metropolitan Area, India Sagri Full time

    Sagri, a pioneering AgriTech startup, is at the forefront of combining satellite data, artificial intelligence, and grid technology to tackle critical challenges in agriculture and the environment. Our mission is to drive positive change by visualizing agricultural land, enabling sustainable farming practices, reducing carbon emissions, and creating value...

  • Software Engineer

    2 weeks ago


    bangalore, India REConnect Energy Full time

    Software Engineer - Data Platforms Work at the intersection of Energy, Weather & Climate Sciences and Artificial Intelligence Responsibilities : Design, develop, and maintain data engineering pipelines using Python. Implement and optimize database solutions with SQL and NOSQL Databases. (MySQL and MongoDB) Perform data analysis, profiling, and quality...

  • Software engineer

    2 weeks ago


    Bangalore, India REConnect Energy Full time

    Software Engineer - Data Platforms Work at the intersection of Energy, Weather & Climate Sciences and Artificial Intelligence Responsibilities : Design, develop, and maintain data engineering pipelines using Python.  Implement and optimize database solutions with SQL and NOSQL Databases. (My SQL and Mongo DB)  Perform data analysis, profiling,...

  • Data Engineer

    3 weeks ago


    Bangalore Metropolitan Area, India Kunato Full time

    We are seeking a dynamic and driven Data Engineer with a strong blend of technical expertise and business acumen. In this role, you will collaborate with cross-functional teams, including Software Engineers, Data Scientists, Business Analysts, Product Managers, and other key stakeholders, to develop innovative data solutions that fuel business insights and...