Senior Data Architect

This high-profile position involves driving technical innovations in data platforms and pipelines, including risk evaluation.

You will be responsible for delivering critical features of our Enterprise TruRisk Platform.

This cutting-edge platform enables customers to measure, communicate, and eliminate cyber risks.

• Design, develop, and support a highly scalable, distributed SaaS-based Security Risk Prioritization product.
• Leverage big data and micro-services technology to process billions of transactions daily.

This role requires you to collaborate with a talented team of engineers and architects to harness open-source technologies and tackle complex business-impacting initiatives.

• Lead technical innovations in data platforms and pipelines.
• Provide strategic guidance on data platform design, roll-out, and evolution.
• Collaborate with product teams, professional services, and sales engineers on solution reviews and trade-off discussions.
• Drive technology explorations and roadmaps to stay ahead of industry trends.
• Serve as a technical lead on high-stakes, cross-functional projects.
• Ensure the quality and integrity of system architecture and design.
• Break down complex problems into straightforward solutions through functional decomposition.
• Understand system interdependencies and limitations.
• Apply expert knowledge in performance, scalability, enterprise system architecture, and engineering best practices.
• Stay up-to-date on internal and industry prior art to inform design decisions.
• Effectively research and benchmark cloud technologies against competitors.
• Document requirements clearly for developers.
• Assist developers with accurate requirements and directions.
• Support career growth by mentoring individuals and the community on advanced technical issues.
• Share deep knowledge and experience to increase productivity across multiple teams.
• Train others and share expertise.

• Bachelor's degree in computer science or equivalent.
• 8+ years of total experience.
• 4+ years of relevant experience in designing and architecting big data solutions using Spark.
• 3+ years of experience working with engineering resources for innovation.
• 4+ years of experience understanding big data events flow pipeline.
• 3+ years of experience in performance testing for large infrastructure.
• 3+ In-depth experience in understanding various search solutions (Solr/Elastic).
• 3+ years of experience with Kafka.
• In-depth experience in data lakes and related ecosystems.
• In-depth experience in message queues.
• In-depth experience in providing requirements for scalable architectures in big data and micro-services environments.
• In-depth understanding of caching components or services.
• Knowledge of Presto technology.
• Knowledge of Airflow.
• Hands-on experience in scripting and automation.
• In-depth understanding of RDBMS/NoSQL, Oracle, Cassandra, Kafka, Redis, Hadoop, Lambda architecture, Kappa, Kappa++ architectures with Flink data streaming and rule engines.
• Experience in working with ML models engineering and related deployment.
• Design and implement secure big data clusters meeting compliance and regulatory requirements.
• Experience leading the delivery of large-scale systems focused on managing the infrastructure layer of the technology stack.
• Strong experience in doing performance benchmarking testing for big data technologies.
• Strong troubleshooting skills.
• Experience leading development life cycle processes and best practices.
• Experience in big data services administration would be an added value.
• Experience with Agile Management (Scrum, RUP, XP), OO Modeling, working on internet, UNIX, Middleware, and database-related projects.
• Experience mentoring/training the engineering community on complex technical issues.
• Project management experience.