Lead II

2 days ago

Pune, Maharashtra, India UST Full time ₹ 12,00,000 - ₹ 36,00,000 per year

7 - 9 Years

1 Opening

Pune

Role description

We are seeking a skilled Pipeline Engineer to design, develop, and optimize scalable data and processing pipelines supporting large-scale distributed systems. The ideal candidate will have hands-on experience with microservices, big data technologies, and modern CI/CD workflows. You will be instrumental in building and maintaining robust data and service pipelines that power our core systems.

Key Responsibilities:

  • Design, build, and maintain scalable data pipelines using Java or Scala.
  • Develop microservices and backend components with Spring Boot.
  • Implement and support big data workflows leveraging Kafka, Spark, Zeppelin, and Hadoop.
  • Create efficient data integration workflows to ensure high performance and reliability.
  • Work with distributed data stores including S3, Cassandra, MongoDB, Couchbase, Redis, and Elasticsearch.
  • Utilize modern serialization formats like Protocol Buffers, Avro, or Thrift for efficient data exchange.
  • Build and maintain CI/CD pipelines to automate testing and continuous delivery.
  • Containerize applications with Docker and orchestrate using Kubernetes and Helm.
  • Deploy and manage infrastructure on AWS cloud services.
  • Collaborate cross-functionally to ensure data quality, reliability, and optimal performance.

Mandatory Skills:

  • Proficient in Java with 2+ years of experience building scalable microservices.
  • Strong expertise in Spring Boot and backend development.
  • Solid understanding of functional programming principles.
  • Experience with CI/CD pipelines and version control tools such as Git, Jenkins, or GitLab CI.
  • Proficient with big data technologies including Kafka, Spark, Zeppelin, Hadoop, and AWS EMR.
  • Experience with distributed storage and databases like S3, Cassandra, MongoDB, Elasticsearch, Couchbase, or Redis.
  • Familiarity with serialization formats (Protocol Buffers, Avro, Thrift).
  • Hands-on experience with Docker, Kubernetes, and Helm.
  • Knowledge of AWS cloud services and infrastructure management.

Good to Have:

  • Experience with real-time data streaming and processing.
  • Familiarity with observability tools (Prometheus, Grafana, ELK stack).
  • Understanding of security best practices for data pipelines and APIs.
  • Exposure to infrastructure as code (IaC) tools such as Terraform or CloudFormation.
  • Experience with ETL processes.

Soft Skills:

  • Excellent written and verbal communication skills.
  • Strong ownership and ability to independently drive tasks to completion.
  • Proactive in identifying blockers and proposing solutions.
  • Collaborative mindset to work effectively with backend, frontend, and DevOps teams.
  • Comfortable working in fast-paced, asynchronous environments.
Skills

Java,Kafka,Kong,Kubernetes

About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world's best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients' organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.

  • Lead II

    2 days ago

    Pune, Maharashtra, India Amrapali Ind Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Senior Salesforce Experience Cloud DeveloperRole Overview:We are seeking a Senior Salesforce Experience Cloud Developer to lead the design and implementation of scalable, secure, and content-rich digital experiences leveraging Experience Cloud and Sales Cloud. This role is perfect for professionals passionate about community portals, digital...

  • Data Scientist-II

    2 days ago

    Pune, Maharashtra, India Urbint Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Data Scientist IIUrbint uses AI and the latest industry science to identify threats to workers and infrastructure to stop safety incidents before they happen. We are a tight-knit team working together to build powerful technology that prevents serious injuries and infrastructure damages. Many of the largest energy and infrastructure companies in North...

  • Software Engineer II

    2 weeks ago

    Pune, Maharashtra, India Rapid7 Full time

    Job DescriptionRapid7 is a publicly traded Cybersecurity company headquartered in Boston, MA with 17 offices around the world. We are excited to be expanding our Global footprint into India and as we build out our Product & Engineering teams, we are looking for Software Engineers. As a Software Engineer II you will take ownership of the development of new...

  • Associate, Middle Office II

    2 weeks ago

    Pune, Maharashtra, India BNY External Career Site Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Associate, Middle Office IIAt BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the world's investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to...

  • Software Engineer II

    2 weeks ago

    Pune, Maharashtra, India Rapid7 Full time

    Description :Rapid7 is a publicly traded Cybersecurity company headquartered in Boston, MA with 17 offices around the world. We are excited to be expanding our Global footprint into India and as we build out our Product & Engineering teams, we are looking for Software Engineers. As a Software Engineer II you will take ownership of the development of new...

  • SDE II

    2 days ago

    Pune, Maharashtra, India EDB Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    A Little About UsEDB provides a data and AI platform that enables organizations to harness the full power of Postgres for transactional, analytical, and AI workloads across any cloud, anywhere. EDB empowers enterprises to control risk, manage costs and scale efficiently for a data and AI led world. Serving more than 1,500 customers globally and as the...

  • SDE II

    9 hours ago

    Pune, Maharashtra, India EDB Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    A Little About UsEDB provides a data and AI platform that enables organizations to harness the full power of Postgres for transactional, analytical, and AI workloads across any cloud, anywhere. EDB empowers enterprises to control risk, manage costs and scale efficiently for a data and AI led world. Serving more than 1,500 customers globally and as the...

  • Software Quality Analyst II

    4 days ago

    Pune, Maharashtra, India Bentley Systems Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Software Quality Analyst IILocation: Hybrid - PunePosition Summary:Are you ready to start a new journey with a team of energized professionals advancing and connecting the world's infrastructure? Bentley is looking for youWe are looking for dynamic, proactive and innovative 'Software Quality Analyst II' reporting to the Software Quality manager to automate...

  • Lead Salesforce Developer

    6 days ago

    Pune, Maharashtra, India GeekSoft Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Help design, build and continuously improve the clients online platform. Research, suggest and implement new technology solutions following best practices/standards. Take responsibility for the resiliency and availability of different products. Be a productive member of the team. Requirements9 years of hands-on Salesforce development...

  • Associate, Client Reporting/Performance II

    2 weeks ago

    Pune, Maharashtra, India BNY External Career Site Full time ₹ 6,00,000 - ₹ 8,00,000 per year

    Associate, Client Reporting / Performance IIAt BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the world's investible assets. Every day, our teams harness cutting-edge AI and breakthrough...