CriticalRiver Inc. | Kafka Engineers | hyderabad

11 hours ago

hyderabad, India CriticalRiver Inc. Full time

Job Title: Kafka Lead

Experience 10+ yrs.

Location: Hyderabad


Scope

The scope of work involves the finalization and optimization of the Kafka Streams solution for the IEE job, focusing on achieving production-level performance, scalability, observability, and cost efficiency. The key objectives are outlined as follows:

Cost Optimization

  • Estimate and benchmark the current cost.
  • Prioritize iterative performance improvements with a focus on cost efficiency.

Functional Enhancements

  • Ensure functional parity with the main branch.
  • Upgrade library versions, including Java, Spring Boot, Spring, Kafka Streams, etc.
  • Eliminate Hibernate dependencies.
  • Remove unnecessary libraries and redundant functionalities.

Integration and Optimization

  • Optimize boot-up time, including multi-threaded loading of data sources (e.g., whitelists, lookups).
  • Continuously identify and resolve performance bottlenecks.
  • Logging and Metrics
  • Implement detailed logging and metrics collection for monitoring and analysis.

Production Readiness

Prepare for production deployment by addressing the following areas:

  • Containerization of the solution
  • Development of runbooks
  • Creation of monitoring dashboards and alert mechanisms
  • Deployment scripts for streamlined rollouts
  • Auto-scalable container orchestration
  • Cluster sizing recommendation tool
  • Auto-healing mechanisms for handling: slow or erroneous policies and invalid events

Quality Assurance

  • Develop comprehensive automated tests, including: Unit tests, integration tests with data mocking and policy types with violation handling
  • Execute extensive unit tests, Sonar scans, and security scans.
  • Implement CI/CD pipelines for continuous deployment to Dev and Performance environments based on quality gate criteria.

Documentation

  • Create comprehensive documentation, including: Design documents, Code walkthroughs, Runbooks for operational guidance

Deliverables & Milestones

Optimized the (Kafka Streams) codebase with production-level performance enhancements, implemented monitoring and alerting and AWS resources, and provided comprehensive documentation for production deployment, including architecture details and operational procedures like runbooks. Additionally, conducted end-to-end testing with recommendations for any further improvements. The project will be executed in phases with the following key milestones:

  • Weekly Progress Reports: Regular updates on the project status and achievements.
  • Bi-Weekly Demos: Demonstrations every two weeks to showcase progress and gather feedback.
  • Ongoing Cost Optimization Monitoring: Continuous visibility into the current state of the Cost Optimization estimates
  • Functional Testing: Conduct parallel testing for functional parity with the existing Spark-based IEE job on a selected tenant within the first two months.
  • Multi-Tenant Testing: Perform multiple parallel tests across different tenants prior to final sign-off



Why Join Us?

At CriticalRiver, you’ll have the opportunity to lead and shape a key practice within our organization, work with high-caliber clients, and make a meaningful impact on their digital transformation journey. We are committed to fostering a culture of innovation, growth, and collaboration where your ideas and leadership will thrive.

CriticalRiver Inc. is an employee-owned technology consulting and IT services firm that empowers its workforce to have a direct stake in the company's growth and success. This ownership model fosters a collaborative and committed culture where employees are motivated to deliver high-quality solutions and services for clients. By giving its team members a shared interest in the company's achievements, CriticalRiver enhances innovation, accountability, and a strong sense of community across all levels of the organization.

  • CriticalRiver Inc. | Kafka Engineers | hyderabad

    11 hours ago

    hyderabad, India CriticalRiver Inc. Full time

    Job Title: Kafka LeadExperience 10+ yrs.Location: HyderabadScopeThe scope of work involves the finalization and optimization of the Kafka Streams solution for the IEE job, focusing on achieving production-level performance, scalability, observability, and cost efficiency. The key objectives are outlined as follows:Cost OptimizationEstimate and benchmark...

  • CriticalRiver Inc. | Kafka Engineers | hyderabad

    18 hours ago

    hyderabad, India CriticalRiver Inc. Full time

    Job Title: Kafka LeadExperience 10+ yrs.Location: HyderabadScope The scope of work involves the finalization and optimization of the Kafka Streams solution for the IEE job, focusing on achieving production-level performance, scalability, observability, and cost efficiency. The key objectives are outlined as follows: Cost Optimization Estimate and...

  • CriticalRiver Inc. | DevSecOps | hyderabad

    11 hours ago

    hyderabad, India CriticalRiver Inc. Full time

    Job Title: DevSecOps Lead/EngineersExperience 10+ yrs.Location: Anywhere In IndiaJob OverviewWe are seeking a DevSecOps Lead Engineer to provide technical leadership and manage the deployment of secure, scalable cloud infrastructure across development, staging, and production environments. You will collaborate with cross-functional teams to enhance CI/CD...

  • CriticalRiver Inc. | DevSecOps | hyderabad

    3 days ago

    hyderabad, India CriticalRiver Inc. Full time

    Job Title: DevSecOps Lead/EngineersExperience 10+ yrs.Location: Anywhere In IndiaJob OverviewWe are seeking a DevSecOps Lead Engineer to provide technical leadership and manage the deployment of secure, scalable cloud infrastructure across development, staging, and production environments. You will collaborate with cross-functional teams to enhance CI/CD...

  • CriticalRiver Inc. | DevSecOps | hyderabad

    11 hours ago

    hyderabad, India CriticalRiver Inc. Full time

    Job Title: DevSecOps Lead/Engineers Experience 10+ yrs. Location: Anywhere In India Job Overview We are seeking a DevSecOps Lead Engineer to provide technical leadership and manage the deployment of secure, scalable cloud infrastructure across development, staging, and production environments. You will collaborate with cross-functional teams to enhance...

  • Kafka Engineers

    2 hours ago

    Hyderabad, India CriticalRiver Inc. Full time

    Job Title:Kafka LeadExperience10+ yrs.Location:HyderabadScopeThe scope of work involves the finalization and optimization of the Kafka Streams solution for the IEE job, focusing on achieving production-level performance, scalability, observability, and cost efficiency. The key objectives are outlined as follows:Cost OptimizationEstimate and benchmark the...

  • Kafka Engineers

    10 hours ago

    Hyderabad, India CriticalRiver Inc. Full time

    Job Title: Kafka LeadExperience 10+ yrs.Location: HyderabadScope The scope of work involves the finalization and optimization of the Kafka Streams solution for the IEE job, focusing on achieving production-level performance, scalability, observability, and cost efficiency. The key objectives are outlined as follows: Cost Optimization Estimate and...

  • Kafka Engineers

    14 hours ago

    Hyderabad, India CriticalRiver Inc. Full time

    Job Title: Kafka LeadExperience 10+ yrs.Location: HyderabadScope The scope of work involves the finalization and optimization of the Kafka Streams solution for the IEE job, focusing on achieving production-level performance, scalability, observability, and cost efficiency. The key objectives are outlined as follows: Cost Optimization Estimate and...

  • Kafka Engineers

    3 hours ago

    Hyderabad, India CriticalRiver Inc. Full time

    Job Title: Kafka Lead Experience 10+ yrs. Location: Hyderabad Scope The scope of work involves the finalization and optimization of the Kafka Streams solution for the IEE job, focusing on achieving production-level performance, scalability, observability, and cost efficiency. The key objectives are outlined as follows: Cost Optimization Estimate...

  • CriticalRiver Inc. | Director

    2 weeks ago

    hyderabad, India CriticalRiver Inc. Full time

    About Company : CRITICALRIVER is a trusted digital technology consulting company with a demonstrated track record of successful technology implementations in areas such as Digital Transformation, Digital Experience Management, Digital Engagement, and Digital Engineering with 100+ Digital Transformation engagements. Founded in 2014 in the heart of Silicon...

  • CriticalRiver Inc. | Senior Salesforce Developer | hyderabad

    3 weeks ago

    hyderabad, India CriticalRiver Inc. Full time

    About Company : CRITICALRIVER is a trusted digital technology consulting company with a demonstrated track record of successful technology implementations in areas such as Digital Transformation, Digital Experience Management, Digital Engagement, and Digital Engineering with 100+ Digital Transformation engagements. Founded in 2014 in the heart of Silicon...

  • CriticalRiver Inc. | Director

    2 weeks ago

    hyderabad, India CriticalRiver Inc. Full time

    About Company : CRITICALRIVER is a trusted digital technology consulting company with a demonstrated track record of successful technology implementations in areas such as Digital Transformation, Digital Experience Management, Digital Engagement, and Digital Engineering with 100+ Digital Transformation engagements. Founded in 2014 in the heart of Silicon...

  • Director - Salesforce

    3 weeks ago

    hyderabad, India CriticalRiver Inc. Full time

    Job Title: Salesforce Practice Engineering Leader / Practice DirectorExperience 15+ yrs.Location: Hyderabad (Preferred) / Bangalore/ JaipurCompany Overview:CriticalRiver Inc. is a global technology consulting and IT services company specializing in digital transformation solutions for businesses across various industries. We provide expertise in areas...

  • Director - Salesforce

    3 weeks ago

    hyderabad, India CriticalRiver Inc. Full time

    Job Title: Salesforce Practice Engineering Leader / Practice DirectorExperience 15+ yrs.Location: Hyderabad (Preferred) / Bangalore/ JaipurCompany Overview:CriticalRiver Inc. is a global technology consulting and IT services company specializing in digital transformation solutions for businesses across various industries. We provide expertise in areas like...

  • Director - Salesforce

    3 weeks ago

    hyderabad, India CriticalRiver Inc. Full time

    Job Title: Salesforce Practice Engineering Leader / Practice Director Experience 15+ yrs. Location: Hyderabad (Preferred) / Bangalore/ Jaipur Company Overview: CriticalRiver Inc. is a global technology consulting and IT services company specializing in digital transformation solutions for businesses across various industries. We provide expertise in...

  • Director - Salesforce

    2 weeks ago

    hyderabad, India CriticalRiver Inc. Full time

    Job Title: Salesforce Practice Engineering Leader / Practice Director Experience 15+ yrs.Location: Hyderabad (Preferred) / Bangalore/ JaipurCompany Overview:CriticalRiver Inc. is a global technology consulting and IT services company specializing in digital transformation solutions for businesses across various industries. We provide expertise in...

  • Director - Salesforce

    3 weeks ago

    Hyderabad, India CriticalRiver Inc. Full time

    Job Title: Salesforce Practice Engineering Leader / Practice DirectorExperience 15+ yrs.Location: Hyderabad (Preferred) / Bangalore/ JaipurCompany Overview:CriticalRiver Inc. is a global technology consulting and IT services company specializing in digital transformation solutions for businesses across various industries. We provide expertise in areas like...

  • Director - Salesforce

    2 weeks ago

    Hyderabad, India CriticalRiver Inc. Full time

    Job Title: Salesforce Practice Engineering Leader / Practice Director Experience 15+ yrs.Location: Hyderabad (Preferred) / Bangalore/ JaipurCompany Overview:CriticalRiver Inc. is a global technology consulting and IT services company specializing in digital transformation solutions for businesses across various industries. We provide expertise in...

  • Director - Salesforce

    4 weeks ago

    hyderabad, India CriticalRiver Inc. Full time

    Job Title: Salesforce Practice Engineering Leader / Practice Director Experience 15+ yrs. Location: Hyderabad (Preferred) / Bangalore/ Jaipur Company Overview: CriticalRiver Inc. is a global technology consulting and IT services company specializing in digital transformation solutions for businesses across various industries. We provide expertise in areas...

  • Director - Salesforce

    4 weeks ago

    Hyderabad, India CriticalRiver Inc. Full time

    Job Title: Salesforce Practice Engineering Leader / Practice Director Experience 15+ yrs. Location: Hyderabad (Preferred) / Bangalore/ Jaipur Company Overview: CriticalRiver Inc. is a global technology consulting and IT services company specializing in digital transformation solutions for businesses across various industries. We provide expertise in areas...