Data Lake Architect

2 months ago


Pune Maharashtra, India NewVision Softcom & Consultancy Full time

DataPunePosted On
- 19 Feb 2024
- Required Experience
- 10 - 14 Years
Basic SectionGrade

Role

Architect

Employment Type

Full Time

Employee Category

OrganisationalGroup Company

NewVision

Company Name

New Vision Softcom & Consultancy Pvt. Ltd

Function

Business Units (BU)

Department/Practice

Data

Department/Practice

Data Engineering

Region

APAC

Country

India

Base Office Location

Pune

Working Model

Hybrid

Weekly Off

Pune Office Standard

State

Maharashtra
- SkillsSkill

Highest Education

POST GRADUATE

CERTIFICATION

No data available

Working Language

ENGLISH
- Job DescriptionWe are seeking a highly skilled and experienced Data Lake Architect to join our dynamic team. This role offers the opportunity to shape our data architecture, drive innovation, and contribute to the success of data-driven initiatives.

**Responsibilities**:

- Data Lake Design and Architecture: Develop and implement a robust and scalable data lake architecture.
- Data Modeling: Design and implement effective data models that align with business requirements and ensure optimal performance.
- Data Governance: Establish and enforce data governance policies, including data quality, security, and compliance standards.
- Metadata Management: Implement metadata management strategies to catalog and document data assets within the data lake, ensuring proper data lineage and accessibility.
- Data Integration and Ingestion: Lead the development of data integration processes to ingest data from various sources into the data lake.
- Security and Access Control: Implement robust security measures, including encryption, access controls, and authentication mechanisms.
- Scalability and Performance Optimization: Design and implement strategies to scale the data lake infrastructure and optimize performance based on evolving business needs.
- Collaboration and Stakeholder Management: Collaborate with cross-functional teams, including data engineers, analysts, and business stakeholders.
- Technology Evaluation and Adoption: Evaluate and recommend new tools and technologies to enhance the data lake ecosystem.
- Training and Documentation: Assist in developing training content and provide documentation to support the platform.

**Qualifications**
- Bachelor's or Master’s degree in Computer Science, or Information Technology.
- 14+ year of proven experience as a Data Engineer with 4+ year as Data Lake Architect.
- In-depth knowledge of data lake architectures, technologies, and best practices.
- Strong expertise in data modeling, data governance, and metadata management.
- Proficiency in programming languages such as Python, PySpark, Scala.
- Experience with cloud-based data lake platforms (e.g., Azure, AWS).
- Hands on experience with (one or more from each line):

- Apache Airflow | Apache NiFi | Apache Oozie
- AWS Glue Data Catalog | Azure Purview
- Apache Sqoop | AWS DataSync | Azure Data Factory
- Apache Kafka | AWS Kinesis | Azure Event Hubs
- Experience working with version control platform e.g. git
- Experience with JIRA, Confluence



  • Pune, India MICHELIN Full time

    Data Lake Technical Leader- - - - - - - - - - - -MISSIONAs any other member of the team, you will :Explain Michelin employees what the Corporate Data Lake can do for themSetup workspaces for themProvide coaching and expertise through face to face meeting or on community channelsParticipate to the platform support effort in a "you build it you run it"...


  • Pune, India MICHELIN Full time

    Data Lake Technical Leader - - - - - - - - - - - - MISSION As any other member of the team, you will : Explain Michelin employees what the Corporate Data Lake can do for them Setup workspaces for them Provide coaching and expertise through face to face meeting or on community channels Participate to the platform support effort in a "you build it you...


  • pune, India MICHELIN Full time

    Data Lake Technical Leader - - - - - - - - - - - - MISSION As any other member of the team, you will : Explain Michelin employees what the Corporate Data Lake can do for them Setup workspaces for them Provide coaching and expertise through face to face meeting or on community channels Participate to the platform support effort in a "you build...

  • Data Lake Admin

    1 week ago


    Pune, India Vertiv Full time

    Position Summary:This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration, and...


  • pune, India Jade Global Full time

    ob DescriptionResponsibilities: Configure, fine-tune, and optimize Spark and YARN administration for high performanceand resource efficiency. Setup, configuring and manage Data Lake Houses using Hudi and/or Delta Lake forefficient data storage and processing. Collaborate with cross-functional teams to design and maintain scalable and reliabledata...


  • Pune, India Jade Global Full time

    ob DescriptionResponsibilities: Configure, fine-tune, and optimize Spark and YARN administration for high performanceand resource efficiency. Setup, configuring and manage Data Lake Houses using Hudi and/or Delta Lake forefficient data storage and processing. Collaborate with cross-functional teams to design and maintain scalable and reliabledata...


  • Pune, India Jade Global Full time

    ob DescriptionResponsibilities: Configure, fine-tune, and optimize Spark and YARN administration for high performanceand resource efficiency. Setup, configuring and manage Data Lake Houses using Hudi and/or Delta Lake forefficient data storage and processing. Collaborate with cross-functional teams to design and maintain scalable and reliabledata...


  • pune, India Jade Global Full time

    ob Description Responsibilities:  Configure, fine-tune, and optimize Spark and YARN administration for high performance and resource efficiency.  Setup, configuring and manage Data Lake Houses using Hudi and/or Delta Lake for efficient data storage and processing.  Collaborate with cross-functional teams to design and maintain scalable and reliable...

  • Data Lake Admin

    2 months ago


    Pune, India Vertiv Full time

    Position Summary : This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration, and...

  • Data Lake Admin

    1 month ago


    pune, India Vertiv Full time

    Position Summary : This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration,...

  • Data Architect

    1 month ago


    Pune, India Saaki Argus & Averil Consulting Full time

    Looking to Hire for Supply Chain Focused Data Architects:Client :Our client is headquartered in Finland, has its Engineering and R&D Operations in India having 5000+ employees with regional offices in four major cities and 50+ branches across India & Nepal.Data Architect works closely with Data Engineers, Global Data Owners, Enterprise Data Architects, Data...

  • Data Architect

    1 month ago


    Pune, India Blazeclan Technologies Full time

    **Data Architect with Data Modeller** **Must have** **Data Architect experience** **Experience in Data modelling using datavault methodology** **10+ years of experience as a Data Architect & Data Modelling** **Good to Have** **Snowflake experience** **AWS/Azure experience** **Role and Experience expected**: - Experience with implementations of the...


  • Pune, Maharashtra, India Expleo Group Full time

    Overview: As a Cloud Data Solution Architect, you will be responsible for designing, architecting, and implementing cloud-based data solutions that meet our business requirements and support our data analytics and decision-making initiatives. You will work closely with cross-functional teams, including data engineering, data science, and business units, to...

  • Data Architect

    2 months ago


    pune, India Saaki Argus & Averil Consulting Full time

    Looking to Hire for Supply Chain Focused Data Architects: Client : Our client is headquartered in Finland, has its Engineering and R&D Operations in India having 5000+ employees with regional offices in four major cities and 50+ branches across India & Nepal. Data Architect works closely with Data Engineers, Global Data Owners, Enterprise Data...

  • Data Architect

    1 month ago


    Pune, India WorkiFicient Full time

    Role - Data Architect Location : Pune/ Mumbai Experience : 7 + years Notice period: Immediate joiner - 45 Days Skills : Databricks, Data lake, Snowflake, Data warehouse, Architecture, Started as DBA, Done migration, design data, on premise to AWS Note : Profile should be AWS heavy. Exposure/hands-on with Other Clouds would be a plus. **Data...


  • Pune, India Nilasu consulting Full time

    Position Overview:We are seeking a highly skilled and experienced Azure-Cloud Data Solution Architect to join our team. The Solution Architect will be responsible for designing and implementing end-to-end data solutions, including Data Warehouse, ETL, Data Lake, and Cloud Migration projects. The ideal candidate will have extensive experience in data...

  • Solution Architect

    1 day ago


    Hinjawadi, Pune, Maharashtra, India BirlaSoft Full time

    Country/Region: IN- Requisition ID: 13410- Work Model: - Position Type: - Salary Range: - Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI**Title**:Solution Architect**: - Description: - Azure Data Architect Experience: 14 to 16 Years, 3+ Years of experience in Azure Data Architect - Cloud Architect with experience in Azure ADF, Databricks, PySpark...


  • Pune, India Ciklum Full time

    DescriptionCiklumis looking for anEnterprise Data Architectto join our team full-time in India.We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we...

  • Data Architect

    2 months ago


    Pune, India Saaki Argus & Averil Consulting Full time

    Looking to Hire for Supply Chain Focused Data Architects: Client : Our client is headquartered in Finland, has its Engineering and R&D Operations in India having 5000+ employees with regional offices in four major cities and 50+ branches across India & Nepal. Data Architect works closely with Data Engineers, Global Data Owners, Enterprise Data Architects,...

  • Data Architect

    2 months ago


    Pune, India Trigyn Technologies Full time

    Job Description: Trigyn has an opportunity Data Architect. This resource will work at our client sites in Mumbai/Pune/Chennai/Bangalore/Hyderabad. Job Responsibilities: •10+ years of professional experience in Data Management, Information Systems and other BI-related fields is required. •+2 years of data architect experience. •+1 year of...