Databricks Architect

1 month ago

Hyderabad, India HS Solutions Inc Full time

About the Job

We are having an Urgent opening for one of our MNC client for PAN India Locations.


Position Title: Databricks Architect

Notice Period: Immediate to 30 days maximum

Location: PAN India

Experience: 10-15 Yrs


In this role, the Databricks Architect is responsible for providing technical direction and lead a

group of one or more developer to address a goal.

Responsibilities

• Architect and design solutions to meet functional and non-functional requirements.

• Create and review architecture and solution design artifacts.

• Evangelize re-use through the implementation of shared assets.

• Enforce adherence to architectural standards/principles, global product-specific guidelines,

usability design standards, etc.

• Proactively guide engineering methodologies, standards, and leading practices.

• Guidance of engineering staff and reviews of as-built configurations during the construction

phase.

• Provide insight and direction on roles and responsibilities required for solution operations.

• Identify, communicate and mitigate Risks, Assumptions, Issues, and Decisions throughout the

full lifecycle.

• Considers the art of the possible, compares various architectural options based on feasibility

and impact, and proposes actionable plans.

• Demonstrate strong analytical and technical problem-solving skills.

• Ability to analyze and operate at various levels of abstraction.

• Ability to balance what is strategically right with what is practically realistic.

• Growing the Data Engineering business by helping customers identify opportunities to deliver

improved business outcomes, designing and driving the implementation of those solutions.

• Growing & retaining the Data Engineering team with appropriate skills and experience to

deliver high quality services to our customers.

• Supporting and developing our people, including learning & development, certification &

career development plans

• Providing technical governance and oversight for solution design and implementation

• Should have technical foresight to understand new technology and advancement.

• Leading team in the definition of best practices & repeatable methodologies in Cloud Data

Engineering, including Data Storage, ETL, Data Integration & Migration, Data Warehousing and Data Governance

• Should have Technical Experience in Azure, AWS & GCP Cloud Data Engineering services and

solutions.

• Contributing to Sales & Pre-sales activities including proposals, pursuits, demonstrations, and proof of concept initiatives

• Evangelizing the Data Engineering service offerings to both internal and external stakeholders

• Development of Whitepapers, blogs, webinars and other though leadership material

• Development of Go-to-Market and Service Offering definitions for Data Engineering

• Working with Learning & Development teams to establish appropriate learning & certification paths for their domain.

• Expand the business within existing accounts and help clients, by building and sustaining

strategic executive relationships, doubling up as their trusted business technology advisor.

• Position differentiated and custom solutions to clients, based on the market trends, specific

needs of the clients and the supporting business cases.

• Build new Data capabilities, solutions, assets, accelerators, and team competencies.

• Manage multiple opportunities through the entire business cycle simultaneously, working

with cross-functional teams as necessary.


Preferred qualifications

• Must have designed the E2E architecture of unified data platform covering all the aspect of

data lifecycle starting from Data Ingestion, Transformation, Serve and consumption.

• Must have excellent coding skills either Python or Scala, preferably Python.

• Must have experience in Data Engineering domain with total

• Must have designed and implemented at least 2-3 project end-to-end in Databricks.

• Must have experience on various data bricks components.

• Must have knowledge of new features available in Databricks and its implications along with

various possible use-case.

• Must have followed various architectural principles to design best suited per problem.

• Must be well versed with Databricks Lakehouse concept and its implementation in enterprise

environments.

• Must have strong understanding of Data warehousing and various governance and security

standards around Databricks.

• Must have knowledge of cluster optimization and its integration with various cloud services.

• Must have good understanding to create complex data pipeline.

• Must be strong in SQL and spark-sql.

• Must have extensive knowledge of Spark and Hive data processing framework.

• Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3,

ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.

• Must be strong in writing unit test case and integration test.

• Responsible to set best practices around Databricks CI/CD.

• Must understand composable architecture to take fullest advantage of Databricks capabilities.

• Experience around DevSecOps including docker and Kubernetes.

• Software development full lifecycle methodologies, patterns, frameworks, libraries, and tools

• Knowledge of programming and scripting languages such as JavaScript, PowerShell, Bash,

SQL, Java, Python, etc.

• Experience with data ingestion technologies such as Azure Data Factory, SSIS, Pentaho,

Alteryx

• Experience with visualization tools such as Tableau, Power BI

• Experience with machine learning tools such as mlFlow, Databricks AI/ML, Azure ML, AWS

sagemaker, etc.

• Experience in distilling complex technical challenges to actionable decisions for stakeholders

and guiding project teams by building consensus and mediating compromises when necessary.

• Experience coordinating the intersection of complex system dependencies and interactions

• Experience in solution delivery using common methodologies especially SAFE Agile but also

Waterfall, Iterative, etc.

Demonstrated knowledge of relevant industry trends and standards


Please share your Profile only if the JD matches at

  • Databricks - Architect

    6 months ago

    Hyderabad, India Tiger Analytics Full time

    Job Description We are seeking a highly skilled and experienced Databricks Expert/Architect to join our global data services team. This individual will play a key role in designing, implementing, and optimizing Databricks solutions across our organization. The ideal candidate will have deep expertise in Databricks architecture, development, security,...

  • Databricks Architect

    4 weeks ago

    Hyderabad, India HS Solutions Inc Full time

    About the Job We are having an Urgent opening for one of our MNC client for PAN India Locations.Position Title: Databricks ArchitectNotice Period: Immediate to 30 days maximumLocation: PAN IndiaExperience: 10-15 YrsIn this role, the Databricks Architect is responsible for providing technical direction and lead agroup of one or more developer to address a...

  • Databricks Architect

    4 weeks ago

    hyderabad, India HS Solutions Inc Full time

    About the Job We are having an Urgent opening for one of our MNC client for PAN India Locations.Position Title: Databricks ArchitectNotice Period: Immediate to 30 days maximumLocation: PAN IndiaExperience: 10-15 YrsIn this role, the Databricks Architect is responsible for providing technical direction and lead agroup of one or more developer to address a...

  • Databricks architect

    1 month ago

    Hyderabad, India HS Solutions Inc Full time

    About the JobWe are having an Urgent opening for one of our MNC client for PAN India Locations.Position Title: Databricks ArchitectNotice Period: Immediate to 30 days maximumLocation: PAN IndiaExperience: 10-15 YrsIn this role, the Databricks Architect is responsible for providing technical direction and lead agroup of one or more developer to address a...

  • Databricks Architect

    1 month ago

    Hyderabad, India HS Solutions Inc Full time

    About the JobWe are having an Urgent opening for one of our MNC client for PAN India Locations.Position Title: Databricks ArchitectNotice Period: Immediate to 30 days maximumLocation: PAN IndiaExperience: 10-15 YrsIn this role, the Databricks Architect is responsible for providing technical direction and lead agroup of one or more developer to address a...

  • Enterprise Databricks Solutions Architect

    3 weeks ago

    Hyderabad, Telangana, India Tiger Analytics Full time

    We are seeking a highly skilled and experienced Enterprise Databricks Solutions Architect to join our global data services team at Tiger Analytics. This individual will play a key role in designing, implementing, and optimizing Databricks solutions across our organization.About the RoleThis is a full-time opportunity with an estimated salary of $140,000 -...

  • Azure Databricks Architect

    7 months ago

    Hyderabad, India ValueMomentum Full time

    Job Summary: Are you someone who has a strong data engineering background who is passionate about tackling complex enterprise business challenges by designing data driven solutions? Then read on! ValueMomentum is looking for an experienced Databricks Architect to join our team and provide technical leadership and expertise in designing and...

  • Databricks Architect

    4 weeks ago

    Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore, India Black Turtle India Private Limited Full time

    Databricks Architect (Azure, AWS, GCP) Transformation happens here. Come, be a part of our exciting journey! Are you the one we are looking for Inviting applications for the role of Databricks Architect! In this role, the Databricks Architect is responsible for providing technical direction and lead a group of one or more developer to address a...

  • Databricks Architect

    7 months ago

    Hyderabad, India KPI Partners Full time

    Strong Azure architecture Experience - Indepth knowledge on Databrick capabilities - Knowledge on Spark architecture & Designing on Databricks - Nice to have exposure towards Delta Lake, Delta Live Tables

  • Senior Data Architect

    1 month ago

    Hyderabad, Telangana, India TechVedika Full time

    At Tech Vedika, we are seeking a highly skilled Senior Data Architect to lead our Databricks initiatives. This role requires expertise in designing and implementing scalable data architectures, including Data Lakes, Lakehouses, and Data Warehouses.Key Responsibilities:· Serve as the subject matter expert for all Databricks-related activities, including...

  • Databricks Solutions Architect

    2 days ago

    Hyderabad, Telangana, India Wenger & Watson Inc. Full time

    Job Description: We are seeking an experienced Data Engineer Leader to join our team at Wenger & Watson Inc. The successful candidate will have a strong background in data engineering, with expertise in designing and implementing large-scale data pipelines on the Databricks platform.Responsibilities:Develop and maintain ETL processes using Databricks...

  • Technical Data Architect with Azure Databricks Expertise

    3 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    About TCS">Tata Consultancy Services (TCS) is a global leader in consulting and information technology services, dedicated to helping clients succeed in the constantly changing world of business. With a rich legacy spanning over 50 years, TCS has earned an unparalleled reputation for delivering exceptional value to clients through its unmatched expertise in...

  • Senior Principal Consultant

    1 month ago

    hyderabad, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Principal Consultant

    1 month ago

    hyderabad, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Principal Consultant

    1 month ago

    Hyderabad, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Principal Consultant

    1 month ago

    hyderabad, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Principal Consultant

    1 month ago

    Hyderabad, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Principal Consultant

    1 month ago

    Hyderabad, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Azure Databricks

    1 month ago

    hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market. As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • Azure databricks

    1 month ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market.As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...