Azure Databricks Architect

Job Summary:

Are you someone who has a strong data engineering background who is passionate about tackling complex enterprise business challenges by designing data driven solutions? Then read on

ValueMomentum is looking for an experienced Databricks Architect to join our team and provide technical leadership and expertise in designing and implementing scalable and efficient data solutions using the Databricks platform. You will be part of a highly collaborative and growing team and solve complex business challenges leveraging the modern data and analytics technologies. As a Databricks Architect, you will play a critical role in driving the architectural direction, guiding the development team, and ensuring the successful delivery of complex data projects. This is an exciting opportunity to work with cutting-edge technologies, collaborate with cross-functional teams, and shape the future of our data infrastructure.

At ValueMomentum, we endorse a culture of experimentation and constantly strive for improvement and learning. You will be exposed to advanced tools, technologies, methodologies, and best practices that will help you develop your skills and grow in your career.

Know your team:

ValueMomentum’s (DL) team is trusted by leading insurance, financial services, and healthcare payers to empower businesses with real-time insights. The DL team is focussed on helping our customers modernize data infrastructure, create effective business intelligence capabilities and develop analytics models to generate business driven insights and outcomes. DL team provides a wide range of capabilities to our customers including advisory services, strategy consulting, data engineering, data management, data governance, BI and Analytics.

Responsibilities:

Job description

The Data Architect for presales will engage with clients to understand their data challenges, tailor technical solutions, and present compelling proposals. Bridge the gap between technical intricacies and client business needs, showcasing the value of our data architecture and domain expertise. Drive pre-sales success by leveraging deep understanding of data systems and strategic thinking.

Solution Development and Strategy

Develop and implement enterprise data architecture strategies aligned with organizational goals and industry best practices, tailoring solutions for presales engagements. Provide reference architecture and guidelines for technology adoption, emphasizing cloud migration, and data modernization.

Data Solutions Delivery

Collaborate with business stakeholders to understand data needs and design solutions. Create a unified data model showcasing the organization’s assets, relationships, and attributes. Design and oversee the implementation of data integration, storage, and retrieval solutions, ensuring data accessibility, reliability, and performance. Implement solutions leveraging AI and ML for better productivity.

Leadership and Innovation

 Provide technical guidance to data architects, engineers, and other data-related roles.  Drive data governance initiatives, ensuring compliance.  Research, architect, and deliver expanding solutions on the Data Analytics stack.  Work with cross-functional project teams and provide data strategy and architecture, resolving performance and technical issues during proposal and delivery stages.

Building and Growth of Practice

Customize solutions to fit client needs and industry requirements. Cultivate partnerships, emphasizing the long-term benefits of robust data architecture. Drive innovation, integrating cutting-edge technologies into practices. Establish industry thought leadership through active contributions. Develop scalable frameworks adaptable to evolving client needs and growth. Foster a collaborative team culture, encouraging knowledge sharing and skill development. Manage Centre of Excellence for Data engineering and Analytics.

Marketing Support

Contribute for White Paper, Case Studies and Technical blogs. Participate as a Panelist in technical session. Support in activities for adding or enhancing partnership with Tech product companies.

What we need in you

Proven experience in designing and implementing complex data solutions aligned with business objectives. Expertise in data modelling, integration, security, and governance Hands-on experience with guiding the virtual data model definition, defining Data Virtualization architecture and deployment with focus on Azure, Databricks, PySpark technologies. Prior experience with establishing best practices for business optimizations. Experience with relational and non-relational data stores (Hadoop, SQL, Mongo DB), ETL or ELT tools (SSIS, Informatica, Matillion, DBT), DevOps, Data Lake and Data Fabric concepts In-depth experience with data governance, data integration and related technologies. Proficiency in a variety of database technologies, both relational and non-relational. Knowledge of cloud-based data solutions (e.g., AWS, Azure). Excellent collaboration and communication skills Experience in Insurance Domain will be a differentiator. Data architecture certifications (e.g., TOGAF, DAMA) are a plus.

Requirements:

Candidates are required to have these mandatory skills:

Strong hands on in Pyspark and Apache Spark. Experience in Native Spark Migration to Databricks. Experience in Hadoop Migration to Databricks. Experience in Building Data Governance Solutions like Unity Catalog, StarBust …etc Build Very Strong Orchestration Layer in Databricks/ADF…. Workflows. Build CICD for Databricks in Azure Devops. Process near Real time Data thru Auto Loader, DLT Pipelines. Implement Security Layer in Delta Lake. Implement Massive Parallel Processing Layers in Spark SQL and PySpark. Implement Cost effective Infrastructure in Databricks. Experience In extracting logic and from on prem layers like SSIS, Stored procedures, Informatica, Vertica, Apache Hudi, Filesystems. etc into Pyspark. Ability to Build Solutions as Cloud Agnostic.

About the Company:

Headquartered in New Jersey, US, ValueMomentum is the largest standalone provider of IT Services and Solutions to Insurers. Our industry focus, expertise in technology backed by R&D, and our customer-first approach uniquely position us to deliver the value we promise and drive momentum to our customers’ initiatives. ValueMomentum is amongst the top 10 insurance-focused IT services firms in North America by number of customers. Leading Insurance firms trust ValueMomentum with their Digital, Data, Core, and IT Transformation initiatives.

Benefits:

We at ValueMomentum offer you a congenial environment to work and grow in the company of experienced professionals. Some benefits that are available to you are:

Career Advancement: Individual Career Development, coaching and mentoring programs for professional and leadership skill development. Comprehensive training and certification programs. Performance Management: Goal Setting, continuous feedback and year-end appraisal. Reward & recognition for the extraordinary performers. Benefits: Comprehensive health benefits, wellness and fitness programs. Paid time off and holidays. Culture: A highly transparent organization with an open-door policy and a vibrant culture

---