Senior data architect

Company Description Sprouts. AI is an AI native “Generative Demand Platform” disrupting the $1.1 T B2 B GTM category. It helps  B2 B demand gen and sales teams generate qualified pipeline and increase deal conversion rates with real-time account and contact level intelligence signals, recommending next best action and execution via AI agents. We are solving the problem of inefficient GTM driven by dirty data ecosystems, multiple siloed legacy tools, large GTM teams, static ICPs and poorly defined segments.  Current customers have seen a significant improvement in data coverage and quality, 3 X increase in qualified leads, over 50% increase in SDR/BDR efficiency, and a 30%+ reduction in martech tool cost. Job Overview: Job Title: Senior Data Architect Location: Bangalore/Chandigarh Job Type: Full-time Experience: 10+ years Job Summary: We are looking for an experienced Senior Data Architect to lead the design, development, and optimization of our modern data infrastructure. The ideal candidate will have deep expertise in big data platforms, data lakes, lakehouse architectures, and hands-on experience with modern tools such as Spark clusters, Py Spark, Apache Iceberg, the Nessie catalog, and Apache Airflow. This role will be pivotal in evolving our data platform, including database migrations, scalable data pipelines, and governance-ready architectures for both analytical and operational use case s. Key Responsibilities: ● Design and implement scalable and reliable data architectures for real-time and batch processing systems ● Evaluate and recommend data tools, frameworks, and infrastructure aligned with company goals ● Develop and optimize complex ETL/ELT pipelines using Py Spark and Apache Airflow ● Architect and manage data lakes using Spark on Apache Iceberg and Nessie catalog for versioned and governed data workflows ● Perform data analysis, data profiling, data quality improvements, and data modeling ● Lead database migration efforts, including planning, execution, and optimization ● Define and enforce data engineering best practices, data governance standards, and schema evolution strategies ● Collaborate cross-functionally with data scientists, analysts, platform engineers, and business stakeholders Required Skills & Qualifications: ● 10+ years of experience in data architecture, data engineering, data security, data governance, and big data platforms ● Deep understanding of trade-offs between managed services and open-source data stack tools, including cost, scalability, operational overhead, flexibility, and vendor lock-in ● Strong hands-on experience with Py Spark for writing data pipelines and distributed data processing ● Proven expertise with Apache Iceberg, Apache Hudi, and the Nessie catalog for modern table formats and versioned data catalogs ● Experience in scaling and managing Elasticsearch and Postgre SQL clusters ● Strong experience with Apache Airflow for workflow orchestration (or equivalent tools)● Demonstrated success in database migration projects across multiple cloud providers ● Ability to perform deep data analysis and compare datasets between systems ● Experience handling 100s of terabytes of data or more ● Proficiency in SQL, data modeling, and performance tuning ● Excellent communication and presentation skills, with the ability to lead technical conversations Nice to Have: ● Experience in Sales, Marketing, and CRM domains, especially with Accounts and Contacts data ● Knowledge in AI and vector databases. ● Exposure to streaming data frameworks (Kafka, Flink, etc.)● Ability to support analytics and reporting initiatives Why Join Us: ● Work on cutting-edge data architectures using modern open-source technologies ● Be part of a team transforming data operations and analytics at scale ● Opportunity to architect high-impact systems from the ground up ● Join a collaborative, innovation-driven culture