Current jobs related to Databricks Architect - India - Zenfinet
-
Cloud Architect
6 days ago
India Zenfinet Full timeWelcome to ZenfinetWe're a technology-driven organization that's passionate about empowering businesses to succeed.We're currently seeking an experienced Cloud Architect - Databricks to join our team and help shape our data strategy.Responsibilities:Develop and implement scalable Databricks architectures to meet business demands.Liaise with cross-functional...
-
Databricks Architect
4 weeks ago
India Tredence Full timeAbout Tredence- Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey, focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...
-
Azure Databricks Architect
7 days ago
India LTIMindtree Full timeLTIMindtree is proud to be an equal opportunity employer. We are committed to equal employment opportunity regardless of race, ethnicity, nationality, gender, gender-identity, gender expression, language, age, sexual orientation, religion, marital status, veteran status, socio-economic status, disability or any other characteristic protected by applicable...
-
Databricks Subject Matter Expert
2 weeks ago
India Coders Brain Technology Private Limited Full timeDatabricks SME with GCP Expertise Experience Required : 4 to 6 Years Notice Period : Immediate Joiners Preferred Job Overview : We are looking for a Databricks Subject Matter Expert (SME) with GCP expertise to architect, optimize, and maintain data engineering workflows on Google Cloud Platform (GCP). The ideal candidate will have strong experience with...
-
AWS/Azure Databricks Architect
3 weeks ago
India HCLTech Full timeHCLTech is hiring AWS/Azure Databricks Architect || Bangalore/Chennai/Noida/Pune Overall Experience: 13 to 18 years. Location: Bangalore or Pan India Skills: Azure/AWS - Data Lake, Synapse, Databricks, Data Factory, Pyspark, Cloud Certification Education: B.Tech/Masters No of positions: 5 Key Responsibilities: Skills and Experience: Good...
-
Enterprise Azure Databricks Strategist
4 days ago
India LTIMindtree Full time**About the Role:** We are seeking a seasoned Azure Databricks Architect to drive our data architecture strategy and implementation. As a key member of the team, you will be responsible for designing, overseeing, and mentoring junior data architects.**Responsibilities:**Develop and implement data architectures that support use by citizen developers, data...
-
Databricks Technical Architect
4 minutes ago
India Prime Ideas Consultancy Services Full time**About Prime Ideas Consultancy Services**We are a trusted executive search and corporate hiring firm specializing in connecting high-caliber professionals with leading organizations. Our deep industry knowledge, expert sourcing strategies, and results-driven approach enable us to deliver effective solutions for our clients.**Job Description:** We are...
-
Consultant-databricks
2 weeks ago
India Tredence Full timeAbout TredenceTredence is a global analytics services and solutions company We are one of the fastest growing private companies in the country for three straight years according to the Inc 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space Our capabilities range...
-
AWS Databricks Enterprise Specialist
4 days ago
India LTIMindtree Full time**About the Role**We are seeking a seasoned Cloud Data Information Architect to lead our team in implementing cloud data pipelines for LTIMindtree.The ideal candidate will have hands-on experience with AWS Databricks, Snowflake, and Python, as well as a deep understanding of cloud-native data architecture and services like S3, Lambda, Glue, and EMR.Key...
-
India MonoSpear Technologies Pvt Ltd Full timeWe're looking for a highly skilled Cloud Data Architect to lead our team's efforts in big data processing and cloud-based data solutions. The successful candidate will have extensive experience in designing and implementing scalable data pipelines using Databricks, Spark, and PySpark, as well as a strong understanding of cloud technologies and Azure...
-
Solution Architect
3 weeks ago
India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full timeJob Description : Solution Architect - Data Modeling (Databricks, Azure/GCP) Experience Level : 10 years About the Role : A highly skilled Solution Architect with expertise in data modeling and cloud-based data platforms (Databricks, Azure, GCP) to design and implement enterprise-grade data solutions. This role focuses on developing data models within a...
-
Chief Data Architect
4 days ago
India LTIMindtree Full time**Job Title:** Chief Data ArchitectAzure Databricks Architect plays a pivotal role in shaping LTIMindtree's data architecture strategy and implementation. This position requires a highly skilled professional to lead the team in designing, overseeing, and mentoring junior architects.**Key Responsibilities:Develop and implement scalable, high-performance data...
-
Data Architect
3 weeks ago
India Peepal consulting Full timeData Architect - JD for Offshore Architect position. - Databricks & Snowflake experience : Must to Have - Hands on experience in development of Azure cloud DWH & data lakes using Azure technologies like Spark (Scala or Python), ADF, Azure Databricks, Terraform & CI/CD. : Must to Have - Solution, Design and Building data Lakehouse architecture on the cloud....
-
Azure Databricks
3 weeks ago
India Zensar Technologies Full timeAs an Azure Developer, you will be responsible for migration to Azure Data Cloud or implementing data solutions using Azure Data Cloud services. Here's how you'll contribute: You will contribute to the role by: - Creating/maintaining scalable ETL pipeline with Azure data factory or Azure Data BricksIngesting data from various sources and building scalable...
-
Data Solutions Architect
58 minutes ago
India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full timeXANDER CONSULTING AND ADVISORY PRIVATE LIMITED seeks a highly skilled Data Solutions Architect to design and implement enterprise-grade data solutions using cloud-based data platforms.This role focuses on developing data models within a modern data lakehouse architecture, leveraging Databricks and GCP services.Main Responsibilities:Data Modeling and...
-
Data Architect
4 days ago
India Zensar Technologies Full time**Key Responsibilities**: - **Platform Architecture Design**: Lead the design and architecture of the **digital platform**, ensuring that the data infrastructure is scalable, secure, and reliable. Focus on utilizing **AWS services**(e.g., **S3**, **Redshift**, **Glue**, **Lambda**, **Kinesis**) and **Databricks**to build a robust, cloud-based data...
-
Big Data Architect
3 days ago
India NEXUS CONSULTING SOLUTIONS Full timeWe are seeking a highly skilled Big Data Architect to join our team at NEXUS CONSULTING SOLUTIONS. As a key member of our data engineering team, you will design, develop, and optimize big data pipelines using Databricks and Spark for real-time and batch data processing.About the RoleThe ideal candidate will be highly proficient in big data technologies,...
-
Big Data Solutions Architect
2 weeks ago
India TransOrg Analytics Full timeWe are excited to announce the opening of a Big Data Solutions Architect position at TransOrg Analytics. As a key member of our team, you will play a crucial role in designing and implementing scalable and efficient big data solutions using Azure Databricks.About the RoleThis is an exceptional opportunity to join a dynamic team and contribute to the...
-
Data Architect
2 weeks ago
India Tredence Inc. Full timeOverall professional experience of the candidate should be atleast 8 years with a maximum experience upto 14 years.The candidate must understand the usage of data Engineering tools for solving business problems and help clients in their data journey. Must have knowledge of emerging technologies used in companies for data management including data governance,...
-
Data Architect
1 week ago
India Tredence Inc. Full timeRequired Experience: The ideal candidate should have at least 8 years of overall professional experience, with a maximum experience of up to 14 years. The candidate must possess in-depth knowledge of data Engineering tools and their application in solving business problems, as well as assisting clients in their data journey. They should be familiar with...
Databricks Architect
1 month ago
Role : Senior Principal Consultant - Databricks Architect
In this role, the Databricks Architect is responsible for providing technical direction and lead a group of one or more developer to address a goal.
Responsibilities :
- Architect and design solutions to meet functional and non-functional requirements.
- Create and review architecture and solution design artifacts.
- Evangelize re-use through the implementation of shared assets.
- Enforce adherence to architectural standards/principles, global product-specific guidelines, usability design standards, etc.
- Proactively guide engineering methodologies, standards, and leading practices.
- Guidance of engineering staff and reviews of as built configurations during the construction phase.
- Provide insight and direction on roles and responsibilities required for solution operations.
- Identify, communicate and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.
- Considers the art of the possible, compares various architectural options based on feasibility and impact, and proposes actionable plans.
- Demonstrate strong analytical and technical problem-solving skills.
- Ability to analyze and operate at various levels of abstraction.
- Ability to balance what is strategically right with what is practically realistic.
- Growing the Data Engineering business by helping customers identify opportunities to deliver improved business outcomes, designing and driving the implementation of those solutions.
- Growing & retaining the Data Engineering team with appropriate skills and experience to deliver high quality services to our customers.
- Supporting and developing our people, including learning & development, certification & career development plans
- Providing technical governance and oversight for solution design and implementation
- Should have technical foresight to understand new technology and advancement.
- Leading team in the definition of best practices & repeatable methodologies in Cloud Data Engineering, including Data Storage, ETL, Data Integration & Migration, Data Warehousing and Data Governance-
- Should have Technical Experience in Azure, AWS & GCP Cloud Data Engineering services and solutions.
- Contributing to Sales & Pre-sales activities including proposals, pursuits, demonstrations, and proof of concept initiatives
- Evangelizing the Data Engineering service offerings to both internal and external stakeholders
- Development of Whitepapers, blogs, webinars and other though leadership material
- Development of Go-to-Market and Service Offering definitions for Data Engineering
- Working with Learning & Development teams to establish appropriate learning & certification paths for their domain.
- Expand the business within existing accounts and help clients, by building and sustaining strategic executive relationships, doubling up as their trusted business technology advisor.
- Position differentiated and custom solutions to clients, based on the market trends, specific needs of the clients and the supporting business cases.
- Build new Data capabilities, solutions, assets, accelerators, and team competencies.
- Manage multiple opportunities through the entire business cycle simultaneously, working with cross-functional teams as necessary.
Qualifications we seek in you
Minimum qualifications :
- Excellent technical architecture skills, enabling the creation of future-proof, complex global solutions.
- Excellent interpersonal communication and organizational skills are required to operate as a leading member of global, distributed teams that deliver quality services and solutions.
- Ability to rapidly gain knowledge of the organizational structure of the firm to facilitate work with groups outside of the immediate technical team.
- Knowledge and experience in IT methodologies and life cycles that will be used.
- Familiar with solution implementation/management, service/operations management, etc.
- Leadership skills can inspire others and persuade.
- Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
- Bachelor's Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience
- Experience in a solution architecture role using service and hosting solutions such as private/public cloud IaaS, PaaS, and SaaS platforms.
- Experience in architecting and designing technical solutions for cloud-centric solutions based on industry standards using IaaS, PaaS, and SaaS capabilities.
- Must have strong hands-on experience on various cloud services like ADF/Lambda, ADLS/S3, Security, Monitoring, Governance
- Must have experience to design platform on Databricks.
- Hands-on Experience to design and build Databricks based solution on any cloud platform.
- Hands-on experience to design and build solution powered by DBT models and integrate with databricks.
- Must be very good designing End-to-End solution on cloud platform.
- Must have good knowledge of Data Engineering concept and related services of cloud.
- Must have good experience in Python and Spark.
- Must have good experience in setting up development best practices.
- Intermediate level knowledge is required for Data Modelling.
- Good to have knowledge of docker and Kubernetes.
- Experience with claims-based authentication (SAML/OAuth/OIDC), MFA, RBAC, SSO etc.
- Knowledge of cloud security controls including tenant isolation, encryption at rest, encryption in transit, key management, vulnerability assessments, application firewalls, SIEM, etc.
- Experience building and supporting mission-critical technology components with DR capabilities.
- Experience with multi-tier system and service design and development for large enterprises
- Extensive, real-world experience designing technology components for enterprise solutions and defining solution architectures and reference architectures with a focus on cloud technologies.
- Exposure to infrastructure and application security technologies and approaches
- Familiarity with requirements gathering techniques.
Preferred qualifications :
- Must have designed the E2E architecture of unified data platform covering all the aspect of data lifecycle starting from Data Ingestion, Transformation, Serve and consumption.
- Must have excellent coding skills either Python or Scala, preferably Python.
- Must have experience in Data Engineering domain with total
- Must have designed and implemented at least 2-3 project end-to-end in Databricks.
- Must have strong performance optimization skills to improve efficiency and reduce cost.
- Must have worked on designing both Batch and streaming data pipeline.
- Must have extensive knowledge of Spark and Hive data processing framework.
- Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.
- Must be strong in writing unit test case and integration test.
- Must have strong communication skills and have worked with cross platform team.
- Must have great attitude towards learning new skills and upskilling the existing skills.
- Responsible to set best practices around Databricks CI/CD.
- Must understand composable architecture to take fullest advantage of Databricks capabilities.
- Good to have Rest API knowledge.
- Good to have understanding around cost distribution.
- Good to have if worked on migration project to build Unified data platform.
- Good to have knowledge of DBT.
- Experience around DevSecOps including docker and Kubernetes.
- Software development full lifecycle methodologies, patterns, frameworks, libraries, and tools
- Knowledge of programming and scripting languages such as JavaScript, PowerShell, Bash, SQL, Java, Python, etc.
- Experience with data ingestion technologies such as Azure Data Factory, SSIS, Pentaho, Alteryx
- Experience with visualization tools such as Tableau, Power BI
- Experience with machine learning tools such as mlFlow, Databricks AI/ML, Azure ML, AWS sagemaker, etc.
- Experience in distilling complex technical challenges to actionable decisions for stakeholders and guiding project teams by building consensus and mediating compromises when necessary.
- Experience coordinating the intersection of complex system dependencies and interactions :
- Architect and design solutions to meet functional and non-functional requirements.
- Create and review architecture and solution design artifacts.- Evangelize re-use through the implementation of shared assets.
- Enforce adherence to architectural standards/principles, global product-specific guidelines, usability design standards, etc.
- Proactively guide engineering methodologies, standards, and leading practices.
- Guidance of engineering staff and reviews of as-built configurations during the construction phase.
- Provide insight and direction on roles and responsibilities required for solution operations.
- Identify, communicate and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.
- Considers the art of the possible, compares various architectural options based on feasibility and impact, and proposes actionable plans.
- Demonstrate strong analytical and technical problem-solving skills.
- Ability to analyze and operate at various levels of abstraction.
- Ability to balance what is strategically right with what is practically realistic.
- Growing the Data Engineering business by helping customers identify opportunities to deliver improved business outcomes, designing and driving the implementation of those solutions.
- Growing & retaining the Data Engineering team with appropriate skills and experience to deliver high quality services to our customers.
- Supporting and developing our people, including learning & development, certification & career development plans
- Providing technical governance and oversight for solution design and implementation
- Should have technical foresight to understand new technology and advancement.
- Leading team in the definition of best practices & repeatable methodologies in Cloud Data Engineering, including Data Storage, ETL, Data Integration & Migration, Data Warehousing and Data Governance-
- Should have Technical Experience in Azure, AWS & GCP Cloud Data Engineering services and solutions.
- Contributing to Sales & Pre-sales activities including proposals, pursuits, demonstrations, and proof of concept initiatives
- Evangelizing the Data Engineering service offerings to both internal and external stakeholders
- Development of Whitepapers, blogs, webinars and other though leadership material
- Development of Go-to-Market and Service Offering definitions for Data Engineering
- Working with Learning & Development teams to establish appropriate learning & certification paths for their domain.
- Expand the business within existing accounts and help clients, by building and sustaining strategic executive relationships, doubling up as their trusted business technology advisor.
- Position differentiated and custom solutions to clients, based on the market trends, specific needs of the clients and the supporting business cases.
- Build new Data capabilities, solutions, assets, accelerators, and team competencies.
- Manage multiple opportunities through the entire business cycle simultaneously, working with cross-functional teams as necessary.
(ref:hirist.tech)
