Data Architect

About Position: We are seeking a highly skilled and experienced Azure Databricks Architect to lead the design, development, and implementation of scalable data solutions using Azure Databricks. This role involves working closely with cross-functional teams to architect data pipelines, optimize performance, and ensure secure and efficient data processing across cloud platforms. - Role: Data Architect - Location: Pune - Experience: 12 to 17 Years - Job Type: Full Time Employment What You'll Do: - Design and implement scalable data architectures using Azure Databricks, Delta Lake, and Azure Synapse Analytics. - Lead data migration strategies and cloud-based analytics transformation initiatives. - Collaborate with stakeholders to gather requirements and translate them into technical solutions. - Develop and optimize Spark-based data processing workflows using PySpark, Scala, and SQL. - Ensure data security, governance, and compliance using Azure Purview and other tools. - Integrate Databricks with Azure Data Factory, Azure Data Lake, and other Azure services. - Monitor and tune performance of Databricks clusters and jobs. - Provide technical leadership and mentorship to data engineers and developers. - Document architecture designs, processes, and best practices. - Stay updated with the latest Databricks features, Azure services, and industry trends. Expertise You'll Bring: - Proven experience architecting and implementing large-scale data solutions using Azure Databricks and Apache Spark. - Deep understanding of Lakehouse architecture, Delta Lake, and data lake optimization strategies. - Strong programming skills in Python, Scala, and SQL for data engineering and analytics. - Hands-on experience with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage. - Expertise in data modeling, ETL/ELT pipeline design, and real-time data processing. - Familiarity with CI/CD practices, DevOps tools, and infrastructure-as-code (e.g., Terraform, ARM templates). - Knowledge of data governance, security, and compliance frameworks within Azure. - Ability to lead technical discussions, mentor teams, and collaborate with cross-functional stakeholders. - Experience integrating Databricks with Power BI, MLflow, and other analytics or ML tools. Benefits: - Competitive salary and benefits package - Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications - Opportunity to work with cutting-edge technologies - Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards - Annual health check-ups - Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents Values-Driven, People-Centric & Inclusive Work Environment: Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds. - We support hybrid work and flexible hours to fit diverse lifestyles. - Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities. - If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment Let's unleash your full potential at Persistent - "Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."