Data Architect

We are looking for an experienced Senior Data Architect with strong hands-on expertise in Databricks and Master Data Management (MDM) for a 30-day on-site assignment at our client's location.

• Location: Mumbai Thane
• Mode of Work: Onsite (Client Location)
• Start Date: Immediate joiners preferred

We are seeking an experienced and visionary Senior Databricks Architect with 12 + experience to lead the design, development, and implementation of cutting-edge data solutions on both Azure and AWS cloud platforms. This role is pivotal in shaping our data strategy, driving digital transformation, and ensuring the delivery of high-quality, scalable, and secure data systems. The ideal candidate will possess deep expertise in Databricks Lakehouse architecture, robust knowledge of cloud data services, and proven experience in data consulting, Master Data Management (MDM), and data quality frameworks.

Responsibilities:

• Strategic Data Leadership:
• Define and champion the enterprise data strategy, roadmap, and architectural principles aligning with business objectives.
• Lead the adoption of Databricks Lakehouse architecture across Azure and AWS environments.
• Provide expert consulting to business stakeholders and technical teams on data-related challenges, opportunities, and best practices.
• Drive innovation by evaluating and integrating new technologies and approaches within the data ecosystem.
• Architectural Design & Implementation:
• Architect end-to-end scalable, high-performance, and cost-effective data solutions using Databricks on both Azure (Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics) and AWS (S3, Glue, Lambda, Redshift).
• Design and optimize complex ETL/ELT pipelines for batch and real-time data processing, leveraging Apache Spark and Databricks.
• Develop and enforce architectural standards, patterns, and best practices for data modeling, data warehousing, and data lake implementations.
• Oversee the technical design, development, and deployment of data solutions, ensuring adherence to architectural guidelines.
• Data Governance & Quality:
• Design and implement robust Master Data Management (MDM) strategies and solutions to ensure data consistency, accuracy, and completeness across critical business entities.
• Develop and enforce data quality frameworks, including data profiling, cleansing, validation, and monitoring mechanisms.
• Establish and maintain data governance policies, metadata management, and data lineage tracking.
• Ensure data security, privacy (e.g., GDPR, CCPA), and compliance within all data solutions.
• Team Leadership & Mentorship:
• Provide technical leadership, guidance, and mentorship to data engineers, data scientists, and other technical team members.
• Conduct architectural reviews and ensure the quality and integrity of delivered solutions.
• Foster a culture of continuous learning and improvement within the data team.
• Stakeholder Collaboration:
• Collaborate closely with business leaders, product owners, and cross-functional teams to translate complex business requirements into technical data solutions.
• Communicate complex technical concepts clearly and concisely to both technical and non-technical audiences.
• Manage and prioritize competing demands and lead discussions to achieve consensus on architectural decisions.

Required Skills & Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related field.
• 10+ years of progressive experience in data architecture, with at least 5 years in a senior or lead architect role.
• Expert-level proficiency in Databricks Lakehouse Platform, including Databricks Workspace, Delta Lake, Unity Catalog, Databricks SQL, and Databricks Machine Learning.
• Deep hands-on experience with both Azure and AWS cloud platforms and their respective data services:
• Azure: Azure Data Lake Storage (ADLS Gen2), Azure Data Factory (ADF), Azure Synapse Analytics, Azure Event Hubs, Azure Stream Analytics, Azure SQL Database, Azure Cosmos DB.
• AWS: S3, AWS Glue, AWS Lambda, Amazon Redshift, Amazon Kinesis, Amazon EMR, Amazon DynamoDB.
• Proven experience in designing and implementing large-scale data systems (data warehouses, data lakes, data meshes).
• Strong expertise in Master Data Management (MDM) concepts, tools, and implementation methodologies.
• Extensive experience in developing and implementing data quality frameworks and data governance strategies.
• Proficiency in programming languages such as Python (PySpark), Scala, and SQL.
• Strong understanding of data modelling techniques (dimensional modeling, data vault, 3NF).
• Experience with real-time streaming data technologies (e.g., Kafka, Spark Streaming, Azure Event Hubs/Kafka, Kinesis).
• Familiarity with DevOps practices, CI/CD pipelines (e.g., Azure DevOps, GitHub Actions, Jenkins), and infrastructure as code (e.g., Terraform).
• Excellent analytical, problem-solving, and communication skills.
• Ability to work effectively in a fast-paced, agile environment and manage multiple priorities.

Preferred Qualifications:

• Databricks Certified Architect or Data Engineer certifications.
• Azure or AWS Solution Architect certifications.
• Experience with data visualization tools (e.g., Power BI, Tableau).
• Knowledge of advanced analytics, machine learning, and AI concepts.
• Experience in a consulting environment. This is a critical role for our organization, offering the opportunity to make a significant impact on our data landscape and drive innovation. If you are a passionate and experienced Databricks architect with a strong background in Azure and AWS, we encourage you to apply.