Technical Director

Job Description: Technical Director (Enterprise AI Systems)

We are seeking a Lead Software Designer to drive the architectural design and development of our enterprise-grade AI product. This role requires a deep understanding of AI/ML systems, cloud-native architectures, and scalable software design.

Key Responsibilities:

·       Architect scalable, modular, and secure AI-driven software systems.

·       Design APIs, microservices, and cloud infrastructure for AI workloads.

·       Ensure seamless AI model integration and efficient scaling.

·       Set technical directions, select AI/ML frameworks, and define best practices.

·       Optimize performance, scalability, and resource utilization.

·       Implement caching, load balancing, and distributed computing.

·       Ensure security compliance (GDPR, SOC2) and secure data handling.

·       Enforce best practices in authentication, encryption, and API security.

·       Collaborate with cross-functional teams to deliver AI solutions.

·       Mentor engineers and communicate architectural decisions to stakeholders.

Mandatory Skills & Qualifications:

Experience: 10+ years in software architecture & design, with at least 3+ years focused on AI/ML product design & development.

·       Experience with design and developing applications with LLMs, RAG Applications, Gen AI Agents.

·       Fine-tuning open-source LLMs.

·       Experience with deploying and monitoring LLMs.

·       Experience with LLM evaluation frameworks or tools like DeepEval, Langfuse or similar.

·       Experience with frameworks like langchain, llamaindex, pydantic etc.

·       Proficiency in RDBMS like PostgreSQL and knowledge of vector databases (eg: chromadb,Pinecone, FAISS, Weaviate).

·       Strong background in microservices, RESTful & GraphQL APIs, event-driven architectures, Working experience with Kafka, RabbitMQ etc...

·       Proficient in Python, Java for backend development

·       Experience with TensorFlow, PyTorch, Hugging Face etc...

·       Skilled in data processing (NumPy, Pandas, Dask,NLTK) and front-end (TypeScript, React.js).

·       Experience in scalable AI systems, data pipelines, MLOps, and real-time inference.

·       Strong understanding of security protocols, IAM, OAuth2, JWT, RBAC.

·       Expertise in cloud platforms (AWS, GCP, Azure), Kubernetes, Docker.

·       Hands-on experience with CI/CD (Eg: github,Jenkins etc...)

·       Hands-on with system monitoring (Eg: ELK Stack,OpenTelemetry, Prometheus, Grafana).

·       Leadership in managing cross-functional teams and communicating technical concepts.

Nice-to-Have Skills:

·       Ensuring AI model interpretability, fairness, and bias mitigation strategies.

·       Optimizing model inference using quantization, distillation, and pruning techniques.

·       Experience in deploying AI models in production at scale, including MLOps best practices.

·       Designing AI systems with privacy-preserving techniques (differential privacy, homomorphic encryption etc.).

·       Experience with knowledge graph-based AI applications.

About Cognute

Cognute offers Intelligent Virtual Assistants for Consumer Lenders like banks, credit unions, fintech lenders, loan servicers and debt collection agencies. We are a very early-stage startup and looking to hire our early technology team who will be compensated through salary & equity.