Azure Databricks Architect

4 weeks ago


Hyderabad, Telangana, India ValueMomentum Full time

Job Summary:

Are you someone who has a strong data engineering background who is passionate about tackling complex enterprise business challenges by designing data driven solutions? Then read on

ValueMomentum is looking for an experienced Databricks Architect to join our team and provide technical leadership and expertise in designing and implementing scalable and efficient data solutions using the Databricks platform. You will be part of a highly collaborative and growing team and solve complex business challenges leveraging the modern data and analytics technologies. As a Databricks Architect, you will play a critical role in driving the architectural direction, guiding the development team, and ensuring the successful delivery of complex data projects. This is an exciting opportunity to work with cutting-edge technologies, collaborate with cross-functional teams, and shape the future of our data infrastructure.

At ValueMomentum, we endorse a culture of experimentation and constantly strive for improvement and learning. You will be exposed to advanced tools, technologies, methodologies, and best practices that will help you develop your skills and grow in your career.

Know your team:

ValueMomentum's (DL) team is trusted by leading insurance, financial services, and healthcare payers to empower businesses with real-time insights. The DL team is focussed on helping our customers modernize data infrastructure, create effective business intelligence capabilities and develop analytics models to generate business driven insights and outcomes. DL team provides a wide range of capabilities to our customers including advisory services, strategy consulting, data engineering, data management, data governance, BI and Analytics.

Responsibilities:

Job description

The Data Architect for presales will engage with clients to understand their data challenges, tailor technical solutions, and present compelling proposals. Bridge the gap between technical intricacies and client business needs, showcasing the value of our data architecture and domain expertise. Drive pre-sales success by leveraging deep understanding of data systems and strategic thinking.

Solution Development and Strategy

Develop and implement enterprise data architecture strategies aligned with organizational goals and industry best practices, tailoring solutions for presales engagements. Provide reference architecture and guidelines for technology adoption, emphasizing cloud migration, and data modernization.

Data Solutions Delivery

Collaborate with business stakeholders to understand data needs and design solutions. Create a unified data model showcasing the organization's assets, relationships, and attributes. Design and oversee the implementation of data integration, storage, and retrieval solutions, ensuring data accessibility, reliability, and performance. Implement solutions leveraging AI and ML for better productivity.

Leadership and Innovation

 Provide technical guidance to data architects, engineers, and other data-related roles.  Drive data governance initiatives, ensuring compliance.  Research, architect, and deliver expanding solutions on the Data Analytics stack.  Work with cross-functional project teams and provide data strategy and architecture, resolving performance and technical issues during proposal and delivery stages.

Building and Growth of Practice

Customize solutions to fit client needs and industry requirements. Cultivate partnerships, emphasizing the long-term benefits of robust data architecture. Drive innovation, integrating cutting-edge technologies into practices. Establish industry thought leadership through active contributions. Develop scalable frameworks adaptable to evolving client needs and growth. Foster a collaborative team culture, encouraging knowledge sharing and skill development. Manage Centre of Excellence for Data engineering and Analytics.

Marketing Support

Contribute for White Paper, Case Studies and Technical blogs. Participate as a Panelist in technical session. Support in activities for adding or enhancing partnership with Tech product companies.

What we need in you

Proven experience in designing and implementing complex data solutions aligned with business objectives. Expertise in data modelling, integration, security, and governance Hands-on experience with guiding the virtual data model definition, defining Data Virtualization architecture and deployment with focus on Azure, Databricks, PySpark technologies. Prior experience with establishing best practices for business optimizations. Experience with relational and non-relational data stores (Hadoop, SQL, Mongo DB), ETL or ELT tools (SSIS, Informatica, Matillion, DBT), DevOps, Data Lake and Data Fabric concepts In-depth experience with data governance, data integration and related technologies. Proficiency in a variety of database technologies, both relational and non-relational. Knowledge of cloud-based data solutions (e.g., AWS, Azure). Excellent collaboration and communication skills Experience in Insurance Domain will be a differentiator. Data architecture certifications (e.g., TOGAF, DAMA) are a plus.

Requirements:

Candidates are required to have these mandatory skills:

Strong hands on in Pyspark and Apache Spark. Experience in Native Spark Migration to Databricks. Experience in Hadoop Migration to Databricks. Experience in Building Data Governance Solutions like Unity Catalog, StarBust …etc Build Very Strong Orchestration Layer in Databricks/ADF…. Workflows. Build CICD for Databricks in Azure Devops. Process near Real time Data thru Auto Loader, DLT Pipelines. Implement Security Layer in Delta Lake. Implement Massive Parallel Processing Layers in Spark SQL and PySpark. Implement Cost effective Infrastructure in Databricks. Experience In extracting logic and from on prem layers like SSIS, Stored procedures, Informatica, Vertica, Apache Hudi, Filesystems. etc into Pyspark. Ability to Build Solutions as Cloud Agnostic.

About the Company:

Headquartered in New Jersey, US, ValueMomentum is the largest standalone provider of IT Services and Solutions to Insurers. Our industry focus, expertise in technology backed by R&D, and our customer-first approach uniquely position us to deliver the value we promise and drive momentum to our customers' initiatives. ValueMomentum is amongst the top 10 insurance-focused IT services firms in North America by number of customers. Leading Insurance firms trust ValueMomentum with their Digital, Data, Core, and IT Transformation initiatives.

Benefits:

We at ValueMomentum offer you a congenial environment to work and grow in the company of experienced professionals. Some benefits that are available to you are:

Career Advancement: Individual Career Development, coaching and mentoring programs for professional and leadership skill development. Comprehensive training and certification programs. Performance Management: Goal Setting, continuous feedback and year-end appraisal. Reward & recognition for the extraordinary performers. Benefits: Comprehensive health benefits, wellness and fitness programs. Paid time off and holidays. Culture: A highly transparent organization with an open-door policy and a vibrant culture

  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    **Job Description**Tata Consultancy Services is seeking a highly skilled Azure Databricks Solutions Architect to join our team. As an Azure Databricks Solutions Architect, you will design and implement scalable and secure data solutions using Azure data services.In this role, you will work with various data sources and have experience with data ingestion and...

  • Azure Databricks

    7 days ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Azure Databricks (scala/pyspark)Azure Databricks (scala/pyspark)Location:Hyderabad, Kolkata, Delhi, ChennaiExperience: 4 years to 12 yearsInterview Mode: Online DriveInterview Date: 13th March 2025 (Thursday)Interview Time: 10: 00 AM to 5: 00 PMMust Have:4 or more years of experience working onAzure Databricks using Scala, PySpark4 or more years of...

  • Azure Databricks

    5 days ago


    Hyderabad, Telangana, India NuStar Technologies Full time

    Job DescriptionExp: 3-8yrsLocation: Hyderabad,Kolkata,Noida,Chennai,BangaloreQuick Joiners Are PreferredJDAzure Data Bricks (Python)Designing and building Databricks data pipelines is requiredExperience in transforming the data using Azure Databricks & Delta lakeHands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta...


  • Hyderabad, Telangana, India AIDEN AI PRIVATE LIMITED Full time

    Data Engineer (Teradata to Snowflake and Databricks on Azure Cloud). Position Overview : We are looking for a talented Data Engineer with strong expertise in data migration from Teradata to Snowflake and Databricks on Azure Cloud. This position will be pivotal in migrating legacy data systems to cloud-based solutions, ensuring a smooth transition with...


  • Hyderabad, Telangana, India Tiger Analytics Full time

    Job Description We are seeking a highly skilled and experienced Databricks Expert/Architect to join our global data services team. This individual will play a key role in designing, implementing, and optimizing Databricks solutions across our organization. The ideal candidate will have deep expertise in Databricks architecture, development, security, and...


  • Hyderabad, Telangana, India GENPACT Full time

    Job DescriptionData Engineer - Azure DatabricksWe are seeking an experienced Data Engineer to join our team as a Principal Consultant - Azure Databricks. As a key member of our data engineering team, you will be responsible for designing and developing data pipelines using Azure Databricks. Your expertise in data engineering best practices, including data...


  • Hyderabad, Telangana, India Hexaware Technologies Full time

    **Hexaware Technologies**We are seeking a highly skilled Azure Databricks Engineer to join our team. As a key member, you will be responsible for designing and implementing large-scale data processing systems using Azure Databricks.The ideal candidate should have:A minimum of 6 years of experience in big data engineering with Azure Databricks, Pyspark, and...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Role: Databricks DeveloperAbout the Job: We are seeking a highly skilled Databricks Developer to join our team at Tata Consultancy Services. The successful candidate will design and implement efficient data ingestion pipelines from multiple sources, ensuring high-quality and consistent data.Key Responsibilities:Designing and implementing end-to-end data...


  • Hyderabad, Telangana, India Leuwint Technologies Full time

    Job Description :- Minimum 4 years of experience in relevant field.- Hands on experience in Databricks, SQL, Azure Data Factory, Azure DevOps- Strong expertise in Microsoft Azure cloud platform services (Azure Data Factory, Azure Data Bricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse Analytics).- Proficient in CI-CD pipelines in Azure DevOps...


  • Hyderabad, Telangana, India Leuwint Technologies Full time

    Job Description :- Minimum 4 years of experience in relevant field.- Hands on experience in Databricks, SQL, Azure Data Factory, Azure DevOps- Strong expertise in Microsoft Azure cloud platform services (Azure Data Factory, Azure Data Bricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse Analytics).- Proficient in CI-CD pipelines in Azure DevOps...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Role: Databricks DeveloperKey Skills: Pyspark, Azure databricks, Azure datafactory, Azure Datalake, Azure synapse.Must-Have:Azure Databricks – E2Pyspark – E2Python – E2SQL - E2Effective Communication – L2Responsibility of / Expectations from the Role:Designing and implementing efficient data ingestion pipelines from multiple sources...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Role: Databricks DeveloperKey Skills: Pyspark, Azure databricks, Azure datafactory, Azure Datalake, Azure synapse.Must-Have:1. Azure Databricks – E22. Pyspark – E23. Python – E24. SQL - E25. Effective Communication – L2Responsibility of / Expectations from the Role:- Designing and implementing efficient data ingestion pipelines from multiple sources...


  • Hyderabad, Telangana, India Innova ESI Full time

    About the Role : - We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team. - As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform. - You will be responsible for building and maintaining...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Role: Databricks Developer Key Skills: Pyspark, Azure databricks, Azure datafactory, Azure Datalake, Azure synapse.Must-Have:Azure Databricks – E2 Pyspark – E2 Python – E2 SQL - E2 Effective Communication – L2 Responsibility of / Expectations from the Role:Designing and implementing efficient data ingestion pipelines from multiple sources...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Role: Databricks Developer Key Skills: Pyspark, Azure databricks, Azure datafactory, Azure Datalake, Azure synapse. Must-Have: Azure Databricks – E2 Pyspark – E2 Python – E2 SQL - E2 Effective Communication – L2 Responsibility of / Expectations from the Role: Designing and implementing efficient data ingestion pipelines from multiple...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title: Databricks Developer Key Skills: Pyspark, Azure databricks, Azure datafactory, Azure Datalake, Azure synapse. Essential Requirements: Azure Databricks – E2 Pyspark – E2 Python – E2 SQL - E2 Effective Communication – L2 Responsibilities and Expectations: Designing and implementing efficient data ingestion pipelines from multiple...


  • Hyderabad, Telangana, India Innova ESI Full time

    About the Role : - We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team.- As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform.- You will be responsible for building and maintaining...


  • Hyderabad, Telangana, India IT & Services Full time

    Job Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...


  • Hyderabad, Telangana, India IT & Services Full time

    Job Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...


  • Hyderabad, Telangana, India AIDEN AI PRIVATE LIMITED Full time

    Company OverviewAIDEN AI PRIVATE LIMITED is a leading company in the field of data engineering, specializing in data migration and cloud-based solutions. We are committed to delivering high-quality services to our clients and strive to be the go-to partner for all their data-related needs.Job SummaryWe are looking for a talented Azure Databricks Engineer to...