Software Development Engineer III Data

1 week ago

Bengaluru, Karnataka, India Meesho Full time ₹ 7,00,000 - ₹ 12,00,000 per year

We have developed API gateway aggregators using frameworks like Hystrix and spring-cloud-gateway for circuit breaking and parallel processing.

Our serving microservices handle more than 15K RPS on normal days and during saledays this can go to 30K RPS. Being a consumer app, these systems have SLAs of ~10ms

Our distributed scheduler tracks more than 50 million shipments periodically fromdifferent partners and does async processing involving RDBMS.

We use an in-house video streaming platform to support a wide variety of devices and networks.

What Youll Do

  • Design and implement scalable and fault-tolerant data pipelines (batch and streaming) using frameworks like Apache Spark, Flink, and Kafka.
  • Lead the design and development of data platforms and reusable frameworks that serve multiple teams and use cases.
  • Build and optimize data models and schemas to support large-scale operational and analytical workloads.
  • Deeply understand Apache Spark internals and be capable of modifying or extending the open-source Spark codebase as needed.
  • Develop streaming solutions using tools like Apache Flink, Spark Structured Streaming.
  • Drive initiatives that abstract infrastructure complexity, enabling ML, analytics, and product teams to build faster on the platform.
  • Champion a platform-building mindset focused on reusability, extensibility, and developer self-service.
  • Ensure data quality, consistency, and governance through validation frameworks, observability tooling, and access controls.
  • Optimize infrastructure for cost, latency, performance, and scalability in modern cloud-native environments.
  • Mentor and guide junior engineers, contribute to architecture reviews, and uphold high engineering standards.
  • Collaborate cross-functionally with product, ML, and data teams to align technical solutions with business needs.

What Were Looking For

  • 5-8 years of professional experience in software/data engineering with a focus on distributed data systems.
  • Strong programming skills in Java, Scala, or Python, and expertise in SQL.
  • At least 2 years of hands-on experience with big data systems including Apache Kafka, Apache Spark/EMR/Dataproc, Hive, Delta Lake, Presto/Trino, Airflow, and data lineage tools (e.g., Datahb,Marquez, OpenLineage).
  • Experience implementing and tuning Spark/Delta Lake/Presto at terabyte-scale or beyond.
  • Strong understanding of Apache Spark internals (Catalyst, Tungsten, shuffle, etc.) with experience customizing or contributing to open-source code.
  • Familiarity and worked with modern open-source and cloud-native data stack components such as:
  • Apache Iceberg, Hudi, or Delta Lake
  • Trino/Presto, DuckDB, or ClickHouse,Pinot ,Druid
  • Airflow, Dagster, or Prefect
  • DBT, Great Expectations, DataHub, or OpenMetadata
  • Kubernetes, Terraform, Docker
  • Strong analytical and problem-solving skills, with the ability to debug complex issues in large-scale systems.
  • Exposure to data security, privacy, observability, and compliance frameworks is a plus.

Good to Have

  • Contributions to open-source projects in the big data ecosystem (e.g., Spark, Kafka, Hive, Airflow)
  • Hands-on data modeling experience and exposure to end-to-end data pipeline development
  • Familiarity with OLAP data cubes and BI/reporting tools such as Tableau, Power BI, Superset, or Looker
  • Working knowledge of tools and technologies like ELK Stack (Elasticsearch, Logstash, Kibana), Redis, and MySQL
  • Exposure to backend technologies including RxJava, Spring Boot, and Microservices architecture

  • Software Development Engineer III

    1 week ago

    Bengaluru, Karnataka, India CData Software Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    In the age of digital transformation, data has become increasingly vital to core business operations. But with so many cloud applications and platforms available today, data has become more decentralized than ever.CData is the real-time data connectivity company. Our easy-to-use integration products allow users to work with their data where, when, and how...

  • Software Development Engineer III

    6 days ago

    Bengaluru, Karnataka, India CDATA SOFTWARE Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    In the age of digital transformation, data has become increasingly vital to core business operations. But with so many cloud applications and platforms available today, data has become more decentralized than ever.CData is the real-time data connectivity company. Our easy-to-use integration products allow users to work with their data where, when, and how...

  • Software Development Engineer III

    7 days ago

    Bengaluru, Karnataka, India CData Software Full time ₹ 17,50,000 - ₹ 25,00,000 per year

    In the age of digital transformation, data has become increasingly vital to core business operations. But with so many cloud applications and platforms available today, data has become more decentralized than ever.CData is the real-time data connectivity company. Our easy-to-use integration products allow users to work with their data where, when, and how...

  • Software Development Engineer III

    1 week ago

    Bengaluru, Karnataka, India F5 Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Software Engineer IIIWere looking for a Software Engineer III with deep experience building and scaling SaaS platforms in the cloud. This role requires a hands-on developer and deliver complex, distributed systems while working with team members and driving cross-functional alignment.Youll lead design and development of scalable microservices,...

  • Software Development Engineer III

    2 weeks ago

    Bengaluru, Karnataka, India Meesho Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleAs an SDE - III (Backend), you will solve real-life complex problems and create compelling experiences for our users. In this role, you will ensure that the solutions and processes that we create are of the highest quality. And in doing so, you will champion a seamless app experience for all our users. You will also collaborate with your fellow...

  • Software Engineer III

    2 weeks ago

    Bengaluru, Karnataka, India NIKE Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    WHO YOU'LL WORK WITHAt Nike, we leverage the power of data and technology to serve athletes around the world. The Data Foundation team is at the forefront of this mission—building scalable, secure, and intelligent platforms that power decision-making across Nike's global supply chain and planning ecosystem.WHO WE ARE LOOKING FORWe are looking for an...

  • Software Engineer Iii

    4 weeks ago

    Bengaluru, Karnataka, India JPMorgan Chase Full time

    Job Category Software Engineering We have an exciting and rewarding opportunity for you to take your software engineering career to the next level As a Software Engineer III at JPMorgan Chase within the Chief Administrative Office - Global Real Estate Technology you will be an experienced member of an agile team tasked with designing and delivering...

  • Software Engineer Iii

    4 weeks ago

    Bengaluru, Karnataka, India JPMorgan Chase Full time

    Job Category Software Engineering We have an exciting and rewarding opportunity for you to take your software engineering career to the next level As a Software Engineer III at JPMorgan Chase within the Consumer Community Banking Team you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in...

  • Software Engineer III

    4 weeks ago

    Bengaluru, Karnataka, India JPMorganChase Full time

    Job DescriptionJob DescriptionWe have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As a Software Engineer III at JPMorgan Chase within the Chief Technology Office team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure,...

  • Software Engineer III

    2 weeks ago

    Bengaluru, Karnataka, India JPMorganChase Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As a Software Engineer III at JPMorgan Chase within the Consumer & Community Banking Team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You...