Azure Databricks Architect

2 weeks ago


Hyderabad, Telangana, India ValueMomentum Full time

Job Summary:

Are you someone who has a strong data engineering background who is passionate about tackling complex enterprise business challenges by designing data driven solutions? Then read on

ValueMomentum is looking for an experienced Databricks Architect to join our team and provide technical leadership and expertise in designing and implementing scalable and efficient data solutions using the Databricks platform. You will be part of a highly collaborative and growing team and solve complex business challenges leveraging the modern data and analytics technologies. As a Databricks Architect, you will play a critical role in driving the architectural direction, guiding the development team, and ensuring the successful delivery of complex data projects. This is an exciting opportunity to work with cutting-edge technologies, collaborate with cross-functional teams, and shape the future of our data infrastructure.

At ValueMomentum, we endorse a culture of experimentation and constantly strive for improvement and learning. You will be exposed to advanced tools, technologies, methodologies, and best practices that will help you develop your skills and grow in your career.

Know your team:

ValueMomentum's (DL) team is trusted by leading insurance, financial services, and healthcare payers to empower businesses with real-time insights. The DL team is focussed on helping our customers modernize data infrastructure, create effective business intelligence capabilities and develop analytics models to generate business driven insights and outcomes. DL team provides a wide range of capabilities to our customers including advisory services, strategy consulting, data engineering, data management, data governance, BI and Analytics.

Responsibilities:

Job description

The Data Architect for presales will engage with clients to understand their data challenges, tailor technical solutions, and present compelling proposals. Bridge the gap between technical intricacies and client business needs, showcasing the value of our data architecture and domain expertise. Drive pre-sales success by leveraging deep understanding of data systems and strategic thinking.

Solution Development and Strategy

Develop and implement enterprise data architecture strategies aligned with organizational goals and industry best practices, tailoring solutions for presales engagements. Provide reference architecture and guidelines for technology adoption, emphasizing cloud migration, and data modernization.

Data Solutions Delivery

Collaborate with business stakeholders to understand data needs and design solutions. Create a unified data model showcasing the organization's assets, relationships, and attributes. Design and oversee the implementation of data integration, storage, and retrieval solutions, ensuring data accessibility, reliability, and performance. Implement solutions leveraging AI and ML for better productivity.

Leadership and Innovation

Provide technical guidance to data architects, engineers, and other data-related roles. Drive data governance initiatives, ensuring compliance. Research, architect, and deliver expanding solutions on the Data Analytics stack. Work with cross-functional project teams and provide data strategy and architecture, resolving performance and technical issues during proposal and delivery stages.

Building and Growth of Practice

Customize solutions to fit client needs and industry requirements. Cultivate partnerships, emphasizing the long-term benefits of robust data architecture. Drive innovation, integrating cutting-edge technologies into practices. Establish industry thought leadership through active contributions. Develop scalable frameworks adaptable to evolving client needs and growth. Foster a collaborative team culture, encouraging knowledge sharing and skill development. Manage Centre of Excellence for Data engineering and Analytics.

Marketing Support

Contribute for White Paper, Case Studies and Technical blogs. Participate as a Panelist in technical session. Support in activities for adding or enhancing partnership with Tech product companies.

What we need in you

Proven experience in designing and implementing complex data solutions aligned with business objectives. Expertise in data modelling, integration, security, and governance Hands-on experience with guiding the virtual data model definition, defining Data Virtualization architecture and deployment with focus on Azure, Databricks, PySpark technologies. Prior experience with establishing best practices for business optimizations. Experience with relational and non-relational data stores (Hadoop, SQL, Mongo DB), ETL or ELT tools (SSIS, Informatica, Matillion, DBT), DevOps, Data Lake and Data Fabric concepts In-depth experience with data governance, data integration and related technologies. Proficiency in a variety of database technologies, both relational and non-relational. Knowledge of cloud-based data solutions (e.g., AWS, Azure). Excellent collaboration and communication skills Experience in Insurance Domain will be a differentiator. Data architecture certifications (e.g., TOGAF, DAMA) are a plus.

Requirements:

Candidates are required to have these mandatory skills:

Strong hands on in Pyspark and Apache Spark. Experience in Native Spark Migration to Databricks. Experience in Hadoop Migration to Databricks. Experience in Building Data Governance Solutions like Unity Catalog, StarBust Build Very Strong Orchestration Layer in Databricks/ADF.... Workflows. Build CICD for Databricks in Azure Devops. Process near Real time Data thru Auto Loader, DLT Pipelines. Implement Security Layer in Delta Lake. Implement Massive Parallel Processing Layers in Spark SQL and PySpark. Implement Cost effective Infrastructure in Databricks. Experience In extracting logic and from on prem layers like SSIS, Stored procedures, Informatica, Vertica, Apache Hudi, Filesystems. etc into Pyspark. Ability to Build Solutions as Cloud Agnostic.

About the Company:

Headquartered in New Jersey, US, ValueMomentum is the largest standalone provider of IT Services and Solutions to Insurers. Our industry focus, expertise in technology backed by R&D, and our customer-first approach uniquely position us to deliver the value we promise and drive momentum to our customers' initiatives. ValueMomentum is amongst the top 10 insurance-focused IT services firms in North America by number of customers. Leading Insurance firms trust ValueMomentum with their Digital, Data, Core, and IT Transformation initiatives.

Benefits:

We at ValueMomentum offer you a congenial environment to work and grow in the company of experienced professionals. Some benefits that are available to you are:

Career Advancement: Individual Career Development, coaching and mentoring programs for professional and leadership skill development. Comprehensive training and certification programs. Performance Management: Goal Setting, continuous feedback and year-end appraisal. Reward & recognition for the extraordinary performers. Benefits: Comprehensive health benefits, wellness and fitness programs. Paid time off and holidays. Culture: A highly transparent organization with an open-door policy and a vibrant culture

  • Hyderabad, Telangana, India ValueMomentum Full time

    Job Summary:Are you someone who has a strong data engineering background who is passionate about tackling complex enterprise business challenges by designing data driven solutions? Then read onValueMomentum is looking for an experienced Databricks Architect to join our team and provide technical leadership and expertise in designing and implementing scalable...


  • Hyderabad, Telangana, India Advitha Tech Solutions Full time

    Job Description : Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...


  • Hyderabad, Telangana, India RapidBraiins Full time

    No. of openings - 10+Primary Skill : SQL, Azure DatabricksSecondary Skills : PySpark, Azure Data FactoryResponsibilities :As an Azure Data Engineer, your day-to-day work activities will be as follows : Design & develop the ETL Good experience in writing SQL, Python and PySpark programming Create the Pipelines (simple and complex) using ADF. Work with other...

  • Databricks Engineer

    2 weeks ago


    Hyderabad, Telangana, India Arting Digital Private Limited Full time

    Job Title:Databricks EngineerExperience:-7+yrLocation:Hyderabad, Indore, Ahmadabad, Pune, GurgaonWork Mode:OnsiteQualification:B.TECH, M.tech, MCASkills:Databricks, Databricks Admin, Spark, Azure, Docker, Github, Jenkins and Linux/Unix etc.Requirements:-∙Bachelor's degree in computer science or related field.∙7+ years of IT experience, including 5+ years...

  • Databricks Engineer

    2 weeks ago


    Hyderabad, Telangana, India Arting Digital Private Limited Full time

    Job DescriptionJob Title:Databricks EngineerExperience:-7+yrLocation:Hyderabad, Indore, Ahmadabad, Pune, GurgaonWork Mode:OnsiteQualification:B.TECH, M.tech, MCASkills:Databricks, Databricks Admin, Spark, Azure, Docker, Github, Jenkins and Linux/Unix etc.Requirements:-∙Bachelor's degree in computer science or related field. ∙7+ years of IT experience,...


  • Hyderabad, Telangana, India EMentor Enterprises Private Limited Full time

    Skills Required: Azure ADFDatabricks with Pyspark PythonData Engineer with Pyspark Databricksskillset 8 yearsof experience Data Engineering with min 5 years hands on experiencein Pyspark for datatransformations.Sound Knowledge on Azure DataBricks Azure DataLake. Soundknowledge in Data Bricks & Logic AppsDelta Lake Azure SQLand Azure blob storage Azure logic...

  • Azure Data Architect

    2 weeks ago


    Hyderabad, Telangana, India Coeo Ltd Full time

    Azure Data ArchitectWe are recruiting for a strong Azure Data Architect to join our exciting Hyderabad office as we continue to grow. Partners with other solution architects to assess solution alignment to the overall architectural blueprint and drive proposal writing, solution direction, pricing and costing Hands on experience with data modelling. Owns...

  • Azure Data Architect

    2 weeks ago


    Hyderabad, Telangana, India Ray Business Technologies (A CMMI Level 3 Company) Full time

    Azure Data Architect Responsibilities: Design and implement scalable, reliable, and secure data solutions on Azure Collaborate with data engineers and developers to integrate data solutions into existing systems Develop and maintain data models, data flows, and data dictionaries Optimize data storage, processing, and retrieval for performance and...

  • Azure Data Engineer

    2 months ago


    Hyderabad, Telangana, India Insightsquared Full time

    Responsibilities :- Design and develop business-critical backend systems using high-quality data pipelines.- Assemble large, complex data sets that meet functional / non-functional business requirements.- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure databricks...

  • Azure Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Insightsquared Full time

    Responsibilities :- Design and develop business-critical backend systems using high-quality data pipelines.- Assemble large, complex data sets that meet functional / non-functional business requirements.- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure databricks...

  • Data Engineer

    1 day ago


    Hyderabad, Telangana, India Ojas Innovative Technologies Pvt Ltd Full time

    Job Description : As a Databricks Engineer or Administrator, you'll play a crucial role in designing, building, and maintaining Databricks pipelines and infrastructure. Your responsibilities will span various areas, including data integration, pipeline development, and database management. 1. Databricks Expertise :- Strong experience with Databricks in...


  • Hyderabad, Telangana, India KPI Partners Full time

    Databricks Platform with Unity Catalog AdministratorResponsibilities:Manage and administer the Databricks platform, including the Unity Catalog, to support data engineering and data science workflows.Collaborate with data engineers and data scientists to understand their requirements and configure the Databricks platform accordingly.Create and manage...

  • Azure Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Ztek Consulting Full time

    Hi,I would like to share an excellent opening for a full-time "Azure Data Engineer (Production Support)" do go through the details and kindly send me your updated resumeLocation :Hyderabad Telangana (Onsite)Job Description :Must have : Azure, ADF, Pyspark, SQL At least three years of professional experience in designing and engineering/architecting Data...

  • Azure Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Ztek Consulting Full time

    Hi, I would like to share an excellent opening for a full-time "Azure Data Engineer (Production Support)" do go through the details and kindly send me your updated resume.Location : Hyderabad Telangana (Onsite)Job Description : Must have : Azure, ADF, Pyspark, SQL At least three years of professional experience in designing and engineering/architecting Data...

  • Azure Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Ztek Consulting Full time

    Hi,I would like to share an excellent opening for a full-time "Azure Data Engineer (Production Support)" do go through the details and kindly send me your updated resume.Location: Hyderabad Telangana (Onsite)Job Description :Must have : Azure, ADF, Pyspark, SQL• At least three years of professional experience in designing and engineering/architecting Data...

  • Azure Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Ztek Consulting Full time

    Hi,I would like to share an excellent opening Full time"Azure Data Engineer"do go through the details and kindly send me your updated resume.Location : Hyderabad Telangana (Onsite)Job Description :Must have : Azure, ADF, Pyspark, SQL At least three years of professional experience in designing and engineering/architecting Data platform (Entity based)....

  • Azure Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Ztek Consulting Full time

    Hi, I would like to share an excellent opening Full time "Azure Data Engineer" do go through the details and kindly send me your updated resumeLocation :Hyderabad Telangana (Onsite)Job Description : Must have : Azure, ADF, Pyspark, SQL At least three years of professional experience in designing and engineering/architecting Data platform (Entity based). ...


  • Hyderabad, Telangana, India Saxon AI Full time

    Only Immediate Joiners Azure Data Engineer Hyderabad, TG Looking for people with strong technical expertise in Microsoft Azure Cloud data platform to join the group of our Modern Data Solutions team. This is a fantastic opportunity to be part of a startup culture whilst being instrumental in the growth of new service offering. Key Responsibilities: ...


  • Hyderabad, Telangana, India Huquo Full time

    Job Listing Description:Are you a skilled Data Engineer looking for an exciting opportunity? Look no further! Join our team to showcase your 7+ years of experience in Data engineering, with a focus on hands-on Databricks expertise for at least 3 years. Must excel in creating jobs using Pyspark and demonstrate proficiency in SQL and Python. Ability to...

  • Azure Architect

    2 weeks ago


    Hyderabad, Telangana, India Revalsys Technologies Full time

    Role : Azure ArchitectWe are seeking an experienced Azure Architect to lead the design and implementation of our cloud computing platform on Microsoft Azure. The successful candidate will have a deep understanding of Azure services, including compute, storage, networking, and security. The Azure Architect will work closely with our development teams to...