Senior NoSQL Database Engineer

About the Role

We are seeking a Senior NoSQL Database Engineer with deep expertise in Apache Cassandra and working knowledge of MongoDB. This role requires complete ownership of the Cassandra database lifecycle from initial provisioning and configuration to cluster expansion, upgrades, performance tuning, monitoring, backup, and security hardening.The ideal candidate is passionate about designing and maintaining resilient, high-availability, distributed data systems, and ensuring zero-downtime performance in production environments.

________________________________________

Key Responsibilities

1. Installation & Provisioning:

2. Plan, install, and configure new Cassandra clusters from scratch across different environments (dev, staging, prod).

3. Automate provisioning using scripts or Infrastructure-as-Code (Terraform, Ansible).
4. Validate prerequisites such as OS tuning, Java/JVM versions, port configurations, and security policies.

5. Ensure high-availability design through proper replication and data partitioning strategies.

6. Cluster Management & Scaling:

7. Create and manage multi-node Cassandra clusters with defined replication and consistency settings.

8. Add or remove nodes without downtime; handle token assignment and ring balancing.
9. Manage data distribution, repair operations, compactions, and read/write load balancing.

10. Plan and execute cluster upgrades and patching (minor and major versions) while ensuring zero or minimal downtime.

11. Performance Tuning & Optimization:

12. Monitor performance metrics such as latency, throughput, GC behaviour, and disk I/O.

13. Perform schema and query optimization in collaboration with developers.
14. Adjust JVM parameters, cache settings, and compaction strategies to enhance performance.

15. Identify and mitigate bottlenecks using tools like node tool, JMX, and Grafana dashboards.

16. Backup, Restore & Disaster Recovery:

17. Implement automated backup strategies using nodetool snapshot or third-party tools (e.g., Medusa).

18. Verify backup integrity and perform routine recovery drills.

19. Establish and maintain disaster recovery plans with tested RTO and RPO goals.

20. Monitoring & Maintenance:

21. Set up continuous monitoring with Prometheus, Grafana, or OpsCenter.

22. Track and alert on key health indicators node status, compaction, heap usage, disk space, and dropped mutations.
23. Participate in on-call rotations to handle production issues and database incidents.

24. Conduct root-cause analysis (RCA) and preventive maintenance for recurring issues.

25. Security & Compliance:

26. Implement role-based access control (RBAC) and secure authentication mechanisms.

27. Enable TLS/SSL encryption for data-in-transit and data-at-rest where applicable.

28. Regularly audit database permissions, rotate credentials, and comply with organizational security standards.

29. Upgrades & Continuous Improvement:

30. Plan and execute in-place Cassandra upgrades and migrations between major versions.

31. Validate schema and data consistency post-upgrade.
32. Stay updated on new Cassandra releases, features, and performance enhancements.

33. Recommend improvements for architecture, automation, and reliability.

34. Collaboration & Documentation:

35. Work closely with DevOps, application, and infrastructure teams to align database configurations with business needs.

36. Document installation, upgrade, and recovery procedures thoroughly (runbooks, knowledge base).
37. Mentor junior team members and share operational best practices.

________________________________________

Required Skills

• At least 5 years of hands-on experience managing Cassandra in production environments.
• Strong knowledge of Cassandra internals gossip, token distribution, consistency, repair, and compaction.
• Proven experience with database provisioning, scaling, and upgrades.
• Proficient in Linux systems and scripting (Bash or Python).
• Experience with data replication, backup, and recovery automation.
• Familiarity with cloud platforms (AWS/GCP/Azure) for distributed Cassandra deployments.
• Good understanding of database security, encryption, and auditing.
• Effective communication and problem-solving skills.

________________________________________

Preferred (Nice to Have)

• Experience with MongoDB as a complementary NoSQL database.
• Familiarity with Terraform, Ansible, or Kubernetes for automation and containerized deployments.
• Exposure to Elasticsearch, Kafka, or other distributed systems.
• Hands-on with CI/CD pipelines for database release management.
• Knowledge of Prometheus, Grafana, or OpsCenter for performance visualization.