Azure Databricks with Unity catalog

3 weeks ago


tamil nadu, India LTIMindtree Full time
Job Title: Specialist-Data Engineering
Experience Range: 5.5 to 10 years
Hiring Locations: Bangalore, Hyderabad, Chennai, Kolkata, Noida, Pune, Mumbai
Target Notice Period: Immediate Joiner
Key Skills to Look for: Databricks, Data Lake, Pyspark with Unity catalog
Databricks -Module Lead -Job Description
The individual will be working in Unity Catalog migration for adidas domains. This job will require developing and building governance frameworks to migrate various datasets within databricks.
Skills:
•Experience on Databricks Unity catalog governance frameworks
•Proficient with migration projects involving various datasets and process.
•Problem solving skills and hands on attitude
•Strong interpersonal and communication skills
Tools
•AWS Cloud & Databricks solutions
•Strong fundamental knowledge of Datawarehouse, DataLakes, Lakehouse & Relational Database
•Knowledge and or experience using AWS cloud products
•Experience working with Agile methodologies (Scrum, Kanban)
•Extensive experience in using DevOps concepts and usage of CI CD tools in previous engagements
Should Have:
•Databricks, Pyspark, Python, Data Management, Unity Catalog
•Atlassian Tools, JIRA, Confluence
•Agile Scrum methodology.
Soft Skills:
•Process Oriented
•Excellent verbal/written communication skills, including communicating technical issues to non-technical audiences and presentation skills .
•Experience in working directly with customer stakeholders

  • Tamil Nadu, India LTIMindtree Full time

    Job Title: Specialist-Data EngineeringExperience Range: 5.5 to 10 years Hiring Locations: Bangalore, Hyderabad, Chennai, Kolkata, Noida, Pune, MumbaiTarget Notice Period: Immediate JoinerKey Skills to Look for:Databricks, Data Lake, Pyspark with Unity catalogDatabricks -Module Lead -Job DescriptionThe individual will be working in Unity Catalog migration for...


  • Tamil Nadu, India LTIMindtree Full time

    Job Title: Specialist-Data Engineering Experience Range: 5.5 to 10 years Hiring Locations: Bangalore, Hyderabad, Chennai, Kolkata, Noida, Pune, Mumbai Target Notice Period: Immediate Joiner Key Skills to Look for: Databricks, Data Lake, Pyspark with Unity catalog Databricks -Module Lead -Job Description The individual will be working in Unity Catalog...


  • Tamil Nadu, India LTIMindtree Full time

    Job Title: Specialist-Data EngineeringExperience Range: 5.5 to 10 years Hiring Locations: Bangalore, Hyderabad, Chennai, Kolkata, Noida, Pune, MumbaiTarget Notice Period: Immediate JoinerKey Skills to Look for:Databricks, Data Lake, Pyspark with Unity catalogDatabricks -Module Lead -Job DescriptionThe individual will be working in Unity Catalog migration for...


  • Chennai, Tamil Nadu, India Tiger Analytics Full time

    Strong in Pyspark, Python, PLSQL, SQL - Desirable to have ETL with batch and streaming (Kinesis). - Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using data ingestion and transformation components. The following technology skills are required - Advanced working SQL knowledge and experience...

  • Azure Databricks

    4 weeks ago


    Chennai, Tamil Nadu, India Cognizant Full time

    **Technical Lead** **Qualification**: Bachelors in science, engineering or equivalent ** Responsibility**: **Project Planning and Setup**: - Understand the project scope, identify activities/ tasks, task level estimates, schedule, dependencies, risks and provide inputs to Module Lead for review. - Provide inputs to testing strategy, configuration,...


  • Chennai, Tamil Nadu, India Desirous Global Consulting Full time

    IT Full-Time Job ID: DGC00032 Chennai, Tamil Nadu 5-10 Yrs ₹1000000 - ₹1200000 Yearly **Education**: UG: Any Graduate **Job description**: **Responsibilities**: - Engage Data Science, Data Engineering, and Analytics Teams to identify and implement the efficient security roles - Be able to resolve Databricks Unity Catalog problems and concerns as they...


  • Bangalore/Chennai/Karnataka/Tamil Nadu, India Mobile Programming llc Full time

    Experience: 7+ years Location: Bangalore Skills: Azure SQL/T-SQL, Azure Data Factory, Azure Function apps, Azure Blob, Azure Databricks, Unity Catalog, Microsoft Purview Interview: L1 Virtual, L2 Face to Overall 7 - 8 years of experience with a minimum 5+ years of relevant professional work Experience. Design, implement, and maintain data pipelines for...


  • Bangalore/Chennai/Karnataka/Tamil Nadu, IN Mobile Programming llc Full time

    Experience: 7+ yearsLocation: BangaloreSkills: Azure SQL/T-SQL, Azure Data Factory, Azure Function apps, Azure Blob, Azure Databricks, Unity Catalog, Microsoft PurviewInterview: L1 Virtual, L2 Face to - Overall 7 - 8 years of experience with a minimum 5+ years of relevant professional work Experience. - Design, implement, and maintain data pipelines for data...


  • Bangalore/Chennai/Karnataka/Tamil Nadu, India Mobile Programming llc Full time

    Experience: 7+ years Location: Bangalore Skills: Azure SQL/T-SQL, Azure Data Factory, Azure Function apps, Azure Blob, Azure Databricks, Unity Catalog, Microsoft Purview Interview: L1 Virtual, L2 Face to - Overall 7 - 8 years of experience with a minimum 5+ years of relevant professional work Experience. - Design, implement, and maintain data...

  • Data Engineering Lead

    3 weeks ago


    Coimbatore/Tamil Nadu/Kerala/Chennai/Pondicherry/Bangalore/Cochin/Kochi/Hosur, India QBrainX Full time

    Job Title : Data Engineering Lead (With Architecture Experience) Exp level : 10+ years Location : Coimbatore Position Type : Full-Time No of opening : 2- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business...

  • Data Engineering Lead

    1 month ago


    Coimbatore/Tamil Nadu/Kerala/Chennai/Pondicherry/Bangalore/Cochin/Kochi/Hosur, India QBrainX Full time

    Job Title : Data Engineering Lead (With Architecture Experience) Exp level : 10+ years Location : Coimbatore Position Type : Full-Time No of opening : 2- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business...

  • Data Engineering Lead

    1 month ago


    Coimbatore/Tamil Nadu/Kerala/Chennai/Pondicherry/Bangalore/Cochin/Kochi/Hosur, IN QBrainX Full time

    Job Title : Data Engineering Lead (With Architecture Experience) Exp level : 10+ yearsLocation : Coimbatore Position Type : Full-Time No of opening : 2- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business...

  • Data Engineering Lead

    3 weeks ago


    Coimbatore/Tamil Nadu/Kerala/Chennai/Pondicherry/Bangalore/Cochin/Kochi/Hosur, IN QBrainX Full time

    Job Title : Data Engineering Lead (With Architecture Experience) Exp level : 10+ yearsLocation : Coimbatore Position Type : Full-Time No of opening : 2- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business...

  • Azure Databricks

    7 days ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Good knowledge and hands on experience in Azure data bricks. Good knowledge and hands on experience in data pipeline. Good knowledge and hands on experience in Data modelling. Good communication skills are required. Knowledge on SQL for analyzing data. **Primary Skills**: Azure data bricks, data pipeline, bugs in data pipeline, datamodelling, python,...


  • Coimbatore, Tamil Nadu, India Prognova Partners Pvt Ltd Full time

    **Databricks with Pyspark & Python** **Primary Skills**: Databricks with Pyspark, Python **Secondary skills**: ADF **Experience**:6 - 12 yrs - 6+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools. - 4+ years of work experience with very large data warehousing environment - 4+ years...


  • tamil nadu, India Hexaware Technologies Full time

    Dear Candidate,I hope this email finds you well. We are thrilled to announce an exciting opportunity for talented professionals like yourself to join our team as an Azure Data Engineer.We are hosting an Open Walk-in Drive in Pune on 11 th May (Saturday), 2024 , and we believe your skills in Databricks, Data Factory, SQL, and Pyspark or Spark align...


  • tamil nadu, India Hexaware Technologies Full time

    Dear Candidate,I hope this email finds you well. We are thrilled to announce an exciting opportunity for talented professionals like yourself to join our team as an Azure Data Engineer.We are hosting an Open Walk-in Drive in Pune on 11 th May (Saturday), 2024 , and we believe your skills in Databricks, Data Factory, SQL, and Pyspark or Spark align...


  • Coimbatore, Tamil Nadu, India Prognova Partners Pvt Ltd Full time

    **Azure ADF with Synapse** **Experience**:6 - 12 yrs **Key Responsibilities**: - Design, develop, and maintain data pipelines using Azure Data Factory (ADF). - Work closely with customers to understand their business requirements and translate them into scalable, performant, and secure data integration solutions. - Develop and maintain technical...

  • Azure Data Factory

    2 months ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time

    **Job Role**: Data Engineer - Proficient and having relevant project experience in using the following to create data processing solutions: - Primary Skillset (must have): - Scala - Spark - Secondary Skillset (added ): - Azure Data Factory - Databricks - Parquet - Possess practiced abilities to - Design and implement data storage - Develop data processing...

  • Azure Data Factory

    2 weeks ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time

    Proficient and having relevant project experience in using the following to create data processing solutions: - Primary Skillset (must have): - Scala - Spark - Secondary Skillset (added ): - Azure Data Factory - Databricks - Parquet - Possess practiced abilities to - Design and implement data storage - Develop data processing solution - Secure, monitor,...