Databricks Architect
2 days ago
Role DescriptionThis is a full-time hybrid role ( Multiple roles) for a Databricks lead and Architect located in Chennai and Pondicherry, with the flexibility to work remotely on occasion. The Databricks Architect will be responsible for designing scalable architectures, developing software solutions, integrating Databricks with other platforms, and creating efficient architectural designs. Additionally, the role involves collaborating with cross-functional teams, managing projects to ensure timely delivery, and supporting the implementation of Databricks solutions that align with business goals.Key Responsibilities: Be the go to person for everything related to solutioning and Architecture. Should be leading the the team.Lead the migration of Oracle Data Warehouse to Databricks, ensuring minimal downtime and data integrity. Work on data pipelines using Databricks best practices for performance, cost, and reliability, while guiding junior engineers. Optimize Spark/PySpark jobs for performance and efficiency in processing large datasets. Implement data quality checks, validation, and reconciliation processes during migration. Work on Hadoop ecosystem (HDFS, Hive, Sqoop) for legacy data integration where needed. Leverage AWS cloud services (S3, EMR, EC2, Lamda, RDS, Glue) for data storage and processing. Implement CI/CD pipelines for automated deployment of Databricks workflows. Ensure data governance, security, and compliance in the cloud environment. Mandatory Skills & Experience: 5+ years in Data Engineering, with strong expertise in Databricks, Oracle, and Data Warehousing. Hands-on experience in migrating on-prem data warehouses (Oracle) to Databricks. Hands on expertise using key features of Databricks ( Lakeflow connect, Lakebridge, Autoloader, Unity Catalog, Spark Declarative Pipelines, Lakehouse Architecture)Proficiency in PySpark, SQL, and ETL/ELT frameworks. Strong knowledge of Hadoop ecosystem (HDFS, Hive, Sqoop). Experience with AWS cloud services (S3, EMR, Glue, Lambda, RDS). Familiarity with data modeling, CDC, and performance tuning in Databricks. Good understanding of orchestration tools (Airflow, Control-M) and CI/CD pipelines. Proficiency in Architecture, Architectural Design, and IntegrationStrong Project Management skills to lead and ensure project milestones are metAbility to work with cloud-based platforms and familiarity with AI/ML and Big Data technologiesExcellent problem-solving and analytical skillsStrong communication and collaboration skills to work effectively in a hybrid environmentExperience with Databricks and end-to-end deployment of data solutions is highly desirableBachelor’s or Master’s degree in Computer Science, Engineering, or a related field
-
Databricks Architect
3 hours ago
Chennai, India Mastech Digital Full timeJob Title: Databricks Architect Location: Chennai/Hyderabad/Bangalore Experience: 10–15 years of overall experience, at least 6 to 8 years in Databricks 5+ years in Data Architecture Budget: Open to discuss Notice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 days About the Role We are seeking a seasoned Databricks...
-
Databricks Architect
2 weeks ago
Chennai, India Mastech Digital Full timeJob Title: Databricks Architect Location: Chennai/Hyderabad/Bangalore Experience: 10–15 years of overall experience and 5+ years in Data Architecture Budget: Open to discuss Notice Period : Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 days About the Role We are seeking a seasoned Databricks Architect with 10–15 years of...
-
Databricks Architect
2 weeks ago
Chennai, India Mastech Digital Full timeJob Title: Databricks Architect Location: Chennai/Hyderabad/Bangalore Experience: 10–15 years of overall experience and 5+ years in Data Architecture Budget: Open to discuss Notice Period : Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 days About the Role We are seeking a seasoned Databricks Architect with 10–15 years of...
-
Databricks Architect
7 days ago
chennai, India Mastech Digital Full timeJob Title: Databricks Architect Location: Chennai/Hyderabad/Bangalore Experience: 10–15 years of overall experience and 5+ years in Data Architecture Budget: Open to discuss Notice Period : Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 days About the Role We are seeking a seasoned Databricks Architect with 10–15 years of...
-
Databricks Architect
2 weeks ago
Chennai, India Mastech Digital Full timeJob Title: Databricks ArchitectLocation: Chennai/Hyderabad/BangaloreExperience: 10–15 years of overall experience and 5+ years in Data ArchitectureBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are seeking a seasoned Databricks Architect with 10–15 years of overall...
-
Databricks Architect
9 hours ago
Chennai, India Mastech Digital Full timeJob Title: Databricks ArchitectLocation: Chennai/Hyderabad/BangaloreExperience: 10–15 years of overall experience, at least 6 to 8 years in Databricks 5+ years in Data ArchitectureBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are seeking a seasoned Databricks...
-
Databricks Architect
6 hours ago
Chennai, India Mastech Digital Full timeJob Title: Databricks ArchitectLocation: Chennai/Hyderabad/BangaloreExperience: 10–15 years of overall experience, at least 6 to 8 years in Databricks 5+ years in Data ArchitectureBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are seeking a seasoned Databricks...
-
Databricks Architect
5 hours ago
Chennai, India Mastech Digital Full timeJob Title: Databricks ArchitectLocation: Chennai/Hyderabad/BangaloreExperience: 10–15 years of overall experience, at least 6 to 8 years in Databricks 5+ years in Data ArchitectureBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are seeking a seasoned Databricks...
-
Databricks Architect
2 weeks ago
Chennai, India Mastech Digital Full timeJob Title: Databricks ArchitectLocation: Chennai/Hyderabad/BangaloreExperience: 10–15 years of overall experience and 5+ years in Data ArchitectureBudget: Open to discussNotice Period : Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are seeking a seasoned Databricks Architect with 10–15 years of...
-
Databricks Architect
2 weeks ago
Chennai, India Mastech Digital Full timeJob Title: Databricks ArchitectLocation: Chennai/Hyderabad/BangaloreExperience: 10–15 years of overall experience and 5+ years in Data ArchitectureBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are seeking a seasoned Databricks Architect with 10–15 years of overall...
