
Architect (Unity Catalog & Hive Metastore)
2 weeks ago
Job Profile- Architect-1/ Data Engineer/ Migration Specialist
Contract Duration- 6-7 months (ext)
Mode of work- Remote
Working Hours- UK Shift
JD- Qualifications & Skills
- 9-10 years of hands-on experience in data platform engineering or migration projects
- Strong proficiency in Databricks, Unity Catalog, Hive Metastore, and UCX assessment tools
- Cloud platform expertise (Azure ) including IAM and networking setup
- Familiarity with BI/reporting tools integration and security policy governance
- Excellent documentation and cross-functional collaboration skills
Good to have
- Experience with cluster policy design and UC-enabled environments
- Knowledge of ACL mapping strategies and data governance best practices
- Ability to create migration dashboards or reports for leadership visibility
R&R-
HMS Assessment & Migration Planning
- Run UCX Assessment Tool to evaluate Hive Metastore (HMS) state, migration complexity, and readiness
- Identify external and managed tables, BI dependencies, and environmental separation needs
- Prepare and deliver a detailed migration plan and finalize a migration runbook
Platform Setup
- Configure necessary cloud resources: storage accounts, IAM roles, and networking
- Set up Unity Catalog Metastore(s) and assign workspace mappings
- Establish and validate admin roles including Account, Metastore, and Workspace Admins
Unity Catalog Design & Cluster Enablement
- Inventory and categorize data assets including catalogs, schemas, tables, views, and files
- Design catalog/schema hierarchy aligned with business units or domains
- Develop and test ACL/permission migration strategy and validate cluster policies for - UC enablement
Migration Execution
- Use UCX tools and upgrade notebooks to migrate tables and views from HMS to Unity Catalog
- Migrate and validate ACLs and permissions using audit scripts
- Update BI tool configurations and modify application connection strings as required
- Transition and test job cluster policies for post-migration functionality.
Post-Migration Validation & Handover
- Verify data integrity, job executions, BI report accuracy, and access control mechanisms
- Document rollback procedures and highlight unresolved findings
- Conduct handover workshops and knowledge transfer sessions with operational stakeholders
-
Senior Software Engineer
4 weeks ago
Bengaluru, Karnataka, India Microhire LLP Full timeJob Profile :- Data Engineer/ Migration SpecialistContract Duration :- 6-7 months (ext)Mode of work :- RemoteWorking Hours :- UK ShiftJob Overview :We are seeking an experienced Data Engineer / Migration Specialist to lead the assessment, planning, execution, and validation of a complex data migration project involving Databricks Unity Catalog and Hive...
-
Data Architect
3 days ago
Bengaluru, Karnataka, India Tech Mahindra Full timeData ArchitectJob Summary:** We are seeking a highly skilled Senior Data Architect with extensive experience in data modeling, Azure Databricks, Azure OpenAI, and associated services. The ideal candidate will be responsible for designing and implementing a scalable, secure, and reliable global data store that supports both batch and near-real-time processing...
-
Data Architect
12 hours ago
Bengaluru, Karnataka, India Tech Mahindra Full timeData Architect Job Summary:** We are seeking a highly skilled Senior Data Architect with extensive experience in data modeling, Azure Databricks, Azure OpenAI, and associated services. The ideal candidate will be responsible for designing and implementing a scalable, secure, and reliable global data store that supports both batch and near-real-time...
-
Only 24h Left) Data Architect
8 hours ago
Bengaluru, Karnataka, India Tech Mahindra Full timeData ArchitectJob Summary:** We are seeking a highly skilled Senior Data Architect with extensive experience in data modeling, Azure Databricks, Azure OpenAI, and associated services. The ideal candidate will be responsible for designing and implementing a scalable, secure, and reliable global data store that supports both batch and near-real-time processing...
-
Data Architect
12 hours ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job DescriptionWe are seeking a Data Architect to design and develop scalable data architectures using cutting-edge technologies. This role requires strong expertise in Apache Trino (PrestoSQL) and distributed computing frameworks.About the RoleDevelop and implement large-scale data systems using Trino (PrestoSQL), Hive Metastore, Iceberg, Delta Lake, HDFS,...
-
Senior Manager, Accounts Payable
3 weeks ago
Bengaluru, Karnataka, India Unity Full timeJob DescriptionThe opportunityWe are looking for a Senior Manager of A/P Services for Unity to join our team in India You will lead a sizable team of AP professionals to ensure the successful operation of the global end-to-end A/P process (vendor set-up, invoicing, payments, queries, expense reimbursements). As the team leader you will be responsible for...
-
Account Executive- Industry Sales
3 weeks ago
Bengaluru, Karnataka, India Unity Full timeJob DescriptionThe opportunityWe are looking for a Client Partner to join our team. At Unity, you&aposll make a difference and help transform an entire market place. In a collaborative, fast-growing environment, we are democratizing development, solving hard problems, and enabling the success of Industry customers in the SAPAC region.As a Client Partner...
-
Urgent Manager, Credit
3 weeks ago
Bengaluru, Karnataka, India Unity Full timeJob DescriptionThe opportunityUnity Technologies is looking for a Credit and Collections Manager to be an integral part of our revenue accounting operations team You will be working cross functionally with our Sale Operations, Finance and Revenue accounting operations team. The ideal candidate will have a strong attention to detail and be able to work in a...
-
Accounts Payable Manager
4 weeks ago
Bengaluru, Karnataka, India Unity Full timeJob DescriptionThe opportunityWe are looking for a Manager, Accounts Payable, to join our team in India As the Manager of Accounts Payable, you will be part of the global FinOps organization based in India reporting to the Senior Manager, Accounts Payable. As a team lead, you will be responsible for the successful and seamless execution of the daily A/P...
-
Lead/Azure Data Engineer
3 weeks ago
Bengaluru, Karnataka, India On Time Solutions Full timeDesignation : Lead Azure Data EngineerExperience : 5+Location : Bangalore/HyderabadSkills : Azure Data Engiineer, ADF, ADB, ADLS, Python, PyparkKey technical skills :- Hands-on experience in designing and building scalable data pipelines using Databricks with PySpark, supporting batch and near-real-time ingestion, transformation, and processing.- Ability to...