Databricks Architect

Job Description Job Description We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS. The role involves designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data. Responsibilities Key Responsibilities - Define and design cloud-native data architectures on Databricks using Delta Lake, Unity Catalog, and related components. - Develop and execute migration strategies for moving on-premises data workloads (Oracle, Exadata, Hadoop) to Databricks on Azure or AWS. - Architect and oversee data pipelines that support ingestion, curation, transformation, and analytics within the bronze/silver/gold architecture model. - Lead data modeling, schema design, and performance optimization, ensuring scalability and governance compliance. - Collaborate with data engineering, platform, and security teams to deliver robust, production-ready solutions. - Establish standards for ingestion frameworks, orchestration (Airflow, Databricks Workflows), and data quality validation. - Drive cost optimization, scalability design, and operational monitoring best practices. - Mentor engineering teams, providing architectural guidance during development and migration phases. - Qualifications & Skills Mandatory: - 10+ years in data architecture or engineering, including 3+ years in cloud-based big data environments. - Proven hands-on experience with Databricks on Azure or AWS. - Deep understanding of Delta Lake, Medallion Architecture, and data governance tools such as Unity Catalog or Purview. - Expertise in Spark (PySpark/Scala) and large-scale data processing optimization. - Strong background in migrating large datasets and batch/streaming pipelines from on-prem to cloud. - Familiarity with ingestion from RDBMS systems (Oracle, SQL Server) and Hadoop ecosystems. - Proficiency with orchestration tools like Databricks Workflows, Airflow, Azure Data Factory, or AWS Glue. - Solid grasp of cloud-native servicesstorage, compute, networking, and security. Good-to-Have: - Databricks Certified Data Engineer or Architect Certification. - Azure or AWS Cloud Certifications. - Experience with real-time data ingestion (Kafka, Kinesis, Event Hubs). - Knowledge of data quality frameworks (Deequ, Great Expectations). - Exposure to BFSI or financial data environments. Self-Assessment Questions Use the following questions to assess your readiness for this role: - Have I architected or migrated enterprise-scale data solutions from on-premises systems (e.g., Oracle, Hadoop) to Databricks on Azure or AWS - Do I have hands-on experience implementing Medallion Architecture (bronze/silver/gold) and using Delta Lake effectively - Can I confidently design and optimize Spark-based data pipelines for performance and scalability - Have I worked with data governance and security frameworks such as Unity Catalog or Purview in a production environment - Am I comfortable acting as an individual contributor and architectural leader, collaborating across engineering and platform teams Qualifications Career Level - IC3 About Us As a world leader in cloud solutions, Oracle uses tomorrow's technology to tackle today's challenges. We've partnered with industry-leaders in almost every sectorand continue to thrive after 40+ years of change by operating with integrity. We know that true innovation starts when everyone is empowered to contribute. That's why we're committed to growing an inclusive workforce that promotes opportunities for all. Oracle careers open the door to global opportunities where work-life balance flourishes. We offer competitive benefits based on parity and consistency and support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs. We're committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing [Confidential Information] or by calling +1 888 404 2494 in the United States. Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.