Data Engineer Unity Catalog Migration
3 days ago
Position: Azure Data Engineer
Technical Skills:
- 4-6 years of relevant work experience.
- Fully conversant with big-data processing approaches and schema-on-read methodologies are a must and knowledge of Azure Data Factory / Azure Databricks (PySpark) / Azure Data Lake Storage (ADLS Gen 2) / Azure Synapse is a must.
- Good to have an excellent development skills & extensive hand-on development & coding experience in a variety of languages, e.g., Python (compulsory PySpark), SQL, Power BI DAX (good to have), etc.
- Experience in designing solutions for Cloud Data Warehouse and working with Architect for generic implementation design of ETL / ELT Pipelines.
- Experience implementing robust ETL / ELT pipelines within Azure Data Factory / Azure Synapse Pipelines along with error handling and performance improvements, identifying performance bottlenecks.
- Should have knowledge of designing Reporting Framework layer for Power BI / Tableau.
Roles and Responsibilities:
- Experience in Designing, implementing, and delivering solutions on batch and streaming data.
- Good to have Experience in working on Data Warehouse using different data modelling techniques (Kimball, SCD2 (Slowly Changing Dimensions)).
- Work in collaborative and Agile environment to deliver data products.
- Adapting new technology advancements and learning new things on Microsoft Azure and competing technologies no hands-on experience needed, but need to know comparisons.
- Ensuring that client deliveries are made on time, with quality.
- Coordinate with Engineering Team, Architect and Client through PM for delivery.
- Align with organization's vision for data practices and work towards improvising skills as needed
-
Unity Catalog and Databricks Engineer
2 weeks ago
Pune, Maharashtra, India Growel Softech Pvt. Ltd. Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJD for Unity Catalog and Databricks EngineerRole C2HExperience-6 to 9yrs overall,Also experience in Pyspark, DatabricksLocation-PAN INDIA(except Hyderabad and Chennai as preferred location)NP-Immediate/15 daysHybrid-2 or 3 days WFOUnity Catalog Adoption Data Engineer 3-6 Years, PySpark, Databricks, Unity Catalog JD Design, develop, and maintain efficient and...
-
Databricks Unity Catalog Engineer
19 hours ago
Hyderabad, Bengaluru, Chennai, India Tata Consultancy Services Limited Full timeJob Description Role & responsibilities: Databricks Unity Catalog Engineer (6+ yrs) - Hands-on experience with Databricks, including Unity Catalog, Delta Lake, and workspace management - Experience in design and implementing Databricks Unity Catalog for centralized governance across workspaces and data domains - Strong understanding of cloud platforms...
-
Bengaluru, India Genpact Full timeReady to shape the future of work? At Genpact, we don’t just adapt to change—we drive it. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster,...
-
Data Engineer
7 days ago
Bengaluru, India The Glove Full timeJob Summary (Databricks -Sr. Associate 5 to 8 yrs/Manager 8 to 12 yrs)We are seeking a talented Data Engineer with strong expertise in Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. You'll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity Catalog.Key...
-
Data Engineer
2 weeks ago
Bengaluru, India The Glove Full timeJob Summary (Databricks -Sr. Associate 5 to 8 yrs/Manager 8 to 12 yrs)We are seeking a talented Data Engineer with strong expertise in Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. You’ll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity...
-
Data Engineer
1 week ago
Bengaluru, India The Glove Full timeJob Summary (Databricks -Sr. Associate 5 to 8 yrs/Manager 8 to 12 yrs)We are seeking a talented Data Engineer with strong expertise in Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. You’ll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity...
-
Data Engineer
1 week ago
Bengaluru, India The Glove Full timeJob Summary (Databricks -Sr. Associate 5 to 8 yrs/Manager 8 to 12 yrs)We are seeking a talented Data Engineer with strong expertise in Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. You’ll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity...
-
Senior Data Engineer
6 days ago
Mumbai, India hirezy.ai Full timeDescription : Roles & Responsibilities : - Data Engineering Excellence : Design and implement data pipelines using formats like JSON, Parquet, CSV, and ORC, utilizing batch and streaming ingestion.- Cloud Data Migration Leadership : Lead cloud migration projects, developing scalable Spark pipelines.- Medallion Architecture : Implement Bronze, Silver, and...
-
Data engineer
1 week ago
Bengaluru, India The Glove Full timeJob Summary (Databricks -Sr. Associate 5 to 8 yrs/Manager 8 to 12 yrs) We are seeking a talented Data Engineer with strong expertise in Databricks , specifically in Unity Catalog, Py Spark, and SQL, to join our data team. You’ll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity...
-
Data engineer
1 week ago
Bengaluru, India The Glove Full timeJob Summary (Databricks -Sr. Associate 5 to 8 yrs/Manager 8 to 12 yrs) We are seeking a talented Data Engineer with strong expertise in Databricks , specifically in Unity Catalog, Py Spark, and SQL, to join our data team. You’ll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity...
