Solution Architect

The Databricks Architect role will be part of our client’s Data Engineering practice team and will be focused on building Data pipelines and Data processing solutions based on AWS platform for Digital Marketing domain.

The Databricks Architect will be working closely with Enterprise Architect, Data Scientist and Product Manager’s for creating technical and architectural roadmap, propose cost-effective solutions on AWS for current and future business needs.

**Description**
- Over 12+ years’ experience as a Data Architect including extensive experience in Databricks.
- Experience in Spark, SQL performance tuning, and optimization.
- Good hands-on experience in AWS services like EC2, S3, RDS, KMS, IAM, STS, Redshift etc.
- Good knowledge and experience in creating, securing, and managing Databricks clusters of Amazon Elastic Compute Cloud (Amazon EC2) instances.
- Strong programming background with Java, Python and Pyspark.
- Practical exposure to end-to-end design and implementation process of Near-Real-Time and Batch Data Pipelines.
- Strong knowledge and understanding of Databricks Lakehouse Platform.
- Knowledge of Databricks scheduling features to automate Databricks jobs.
- Strong knowledge and experience in Databricks Lakehouse platform and Delta Lake.
- Experience in managing, using and scheduling notebooks in Databricks.
- Good experience in integrating and ingesting data from external data sources with Databricks including automating ETL using Delta Live Tables and Databricks Autoloader.
- Strong SQL (Hive/Spark/Databricks) skills and experience tuning complex queries.
- Good to have Databricks Lakehouse Data Engineer Associate or Data Engineer Professional certification.
- Experience in solutioning Enterprise Applications on AWS cloud platform.
- Good to have hands-on experience in Java, Spring and Node JS.
- Good to have experience in React/Redux is mandatory.
- Good to have experience in other AWS Services like EKS, ECS, Elastic Beanstalk, Lambda, and AWS DevOps services.
- Need to stay on top of the latest trends and technologies and keep an eye on software, service and hardware that might improve business process.
- Proven work experience as a Solution/Technical Data Architect or similar role.
- Strong understanding of SDLC, Engineering and QA practices.
- Capable of working with the technical teams to provide a complete review and assessment of current state architecture readiness
- Addressing real-time streaming use cases, security/governance considerations, BI integrations, existing cloud optimizations, cost engineering of existing infrastructure and modernization recommendations based on future products requirement.
- Evaluating systems engineering, talent recruiting and accounting models for discrepancies and vulnerabilities
- Excellent technical, analytical and project management skills
- Good understanding of Agile development practices and tools.
- Strong communication and interpersonal skills
- Good leadership and motivational skills
- Good to have TOGAF or similar certifications
- Serves as Data Architect for defining enterprise portfolio roadmaps that meet specific business needs.
- Lead team of solution and technical architects and collaborate with various stakeholders from business, IT, operation partners and vendors to define enterprise architecture blueprint.
- Drive the deployment of the customers’ workloads into AWS and provide guidance, cloud adoption model, service integrations, appropriate recommendations to overcome blockers and technical roadmaps for AWS cloud implementations.
- Work on providing solutions to multiple projects at once.
- Evaluating internal functions, business development strategies and IT processes and suggesting improvements.
- Creating business architecture models to reflect the organization's strategies and goals and creating and implementing business visions and goals.
- Suggesting ideas to reduce costs in IT and business leadership.
- Providing business architecture and systems processing guidance.
- Ensure the efficiency, security, and support of the organization’s goals.
- Creating methods for compliance architecture, such as data storage, metadata management and change control. Presents, justifies communicates to all stakeholders in business and IT
- Specifies Data Architecture framework, best practices, and tools.
- Establishes architecture, design and technology principles and guidelines
- Participates in solution design and development.
- Controls the consistency and compliancy of artifacts.
- Owns the solution repository and decides access rights.
- Recommends transformation roadmap and works with Program Management
- Establishes compliance checkpoints in major capability development processes
- Measures returned value at each iteration.