Databricks Architect

Pune***

**About Us**
- We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.
- Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.
- Using centuries of cumulative experience, research and leadership, we help our clients eliminate the complexities & risk of legacy modernization and safely deliver big data hubs, operational data integration, business intelligence, risk & compliance solutions and traditional data warehouses & marts.
- At Hoonartek, we work to ensure that our customers, partners and employees all benefit from our unstinting commitment to delivery, quality and value. Hoonartek is increasingly the choice for customers seeking a trusted partner of vision, value and integrity

**How We Work?**

Define, Design and Deliver (D3) is our in-house delivery philosophy. It’s culled from agile and rapid methodologies and focused on ‘just enough design’. We embrace this philosophy in everything we do, leading to numerous client success stories and indeed to our own success.
- We embrace change, empowering and trusting our people and building long and valuable relationships with our employees, our customers and our partners. We work flexibly, even adopting traditional/waterfall methods where circumstances demand it. At Hoonartek, the focus is always on delivery and value.
- **Design and Architecture**:Develop and maintain the architecture for Databricks environments to support data processing, analytics, and machine learning workflows.
Design scalable and efficient data pipelines to ingest, process, and transform large volumes of data from various sources.
- **Implementation and Development**:Lead the implementation of Databricks solutions, ensuring best practices for performance, security, and reliability.
Develop and optimize ETL processes using Databricks, Apache Spark, and other relevant tools.
- **Collaboration**:Work closely with data engineers, data scientists, and business stakeholders to understand data requirements and deliver solutions that meet their needs.
Provide technical guidance and mentorship to team members on Databricks and related technologies.
- **Optimization and Maintenance**:Monitor and optimize Databricks performance, ensuring efficient use of resources and cost-effectiveness.
Maintain and support existing Databricks environments, including troubleshooting and resolving issues.
- **Security and Compliance**:Implement and enforce security best practices to protect sensitive data within Databricks environments.
Ensure compliance with data governance and regulatory requirements.
- Qualifications
- **Education**:Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. Master's degree preferred.
- **Experience**:Proven experience as a Databricks Architect or in a similar role, with a strong focus on data architecture and engineering.
Extensive experience with Databricks, Apache Spark, and related big data technologies.
Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- **Technical Skills**:Proficiency in programming languages such as Python, Scala, and SQL.
Strong understanding of data modeling, ETL processes, and data warehousing concepts.
Experience with data visualization tools and techniques.
Familiarity with machine learning and AI frameworks is a plus.
- **Soft Skills**:Excellent problem-solving and analytical skills.
Strong communication and collaboration abilities.
Ability to work effectively in a fast-paced, dynamic environment.
- Preferred Qualifications
- Certifications in Databricks, Apache Spark, or related technologies.
- Experience with DevOps practices and tools for continuous integration and deployment.
- Knowledge of data governance and compliance standards.