Data Lake Architect

3 weeks ago

Pune Maharashtra, India NewVision Softcom & Consultancy Full time

DataPunePosted On
- 19 Feb 2024
- Required Experience
- 10 - 14 Years
Basic SectionGrade

Role

Architect

Employment Type

Full Time

Employee Category

OrganisationalGroup Company

NewVision

Company Name

New Vision Softcom & Consultancy Pvt. Ltd

Function

Business Units (BU)

Department/Practice

Data

Department/Practice

Data Engineering

Region

APAC

Country

India

Base Office Location

Pune

Working Model

Hybrid

Weekly Off

Pune Office Standard

State

Maharashtra
- SkillsSkill

Highest Education

POST GRADUATE

CERTIFICATION

No data available

Working Language

ENGLISH
- Job DescriptionWe are seeking a highly skilled and experienced Data Lake Architect to join our dynamic team. This role offers the opportunity to shape our data architecture, drive innovation, and contribute to the success of data-driven initiatives.

**Responsibilities**:

- Data Lake Design and Architecture: Develop and implement a robust and scalable data lake architecture.
- Data Modeling: Design and implement effective data models that align with business requirements and ensure optimal performance.
- Data Governance: Establish and enforce data governance policies, including data quality, security, and compliance standards.
- Metadata Management: Implement metadata management strategies to catalog and document data assets within the data lake, ensuring proper data lineage and accessibility.
- Data Integration and Ingestion: Lead the development of data integration processes to ingest data from various sources into the data lake.
- Security and Access Control: Implement robust security measures, including encryption, access controls, and authentication mechanisms.
- Scalability and Performance Optimization: Design and implement strategies to scale the data lake infrastructure and optimize performance based on evolving business needs.
- Collaboration and Stakeholder Management: Collaborate with cross-functional teams, including data engineers, analysts, and business stakeholders.
- Technology Evaluation and Adoption: Evaluate and recommend new tools and technologies to enhance the data lake ecosystem.
- Training and Documentation: Assist in developing training content and provide documentation to support the platform.

**Qualifications**
- Bachelor's or Master’s degree in Computer Science, or Information Technology.
- 14+ year of proven experience as a Data Engineer with 4+ year as Data Lake Architect.
- In-depth knowledge of data lake architectures, technologies, and best practices.
- Strong expertise in data modeling, data governance, and metadata management.
- Proficiency in programming languages such as Python, PySpark, Scala.
- Experience with cloud-based data lake platforms (e.g., Azure, AWS).
- Hands on experience with (one or more from each line):

- Apache Airflow | Apache NiFi | Apache Oozie
- AWS Glue Data Catalog | Azure Purview
- Apache Sqoop | AWS DataSync | Azure Data Factory
- Apache Kafka | AWS Kinesis | Azure Event Hubs
- Experience working with version control platform e.g. git
- Experience with JIRA, Confluence

  • Data Lake Admin

    2 weeks ago

    Pune, Maharashtra, India Vertiv Group Corp Full time

    Position Summary: He will have hands on experience in big data architecture and data warehousing principles as well as hands on experience in full information lifecycle for large scale big data environments - from data origination to data consumption. Key Duties: Administer our data lake organizing access controls processes Support the ETL development team...

  • Data Lake Admin

    3 weeks ago

    Pune, Maharashtra, India Vertiv Group Corp Full time

    **Position Summary**: He will have hands on experience in big data architecture and data warehousing principles as well as hands on experience in full information lifecycle for large scale big data environments - from data origination to data consumption. Key Duties - Administer our data lake organizing access controls processes - Support the ETL...

  • Data Lake Technical Leader

    2 months ago

    pune, India MICHELIN Full time

    Data Lake Technical Leader - - - - - - - - - - - - MISSION As any other member of the team, you will : Explain Michelin employees what the Corporate Data Lake can do for them Setup workspaces for them Provide coaching and expertise through face to face meeting or on community channels Participate to the platform support effort in a "you build...

  • Data Lake Technical Leader

    2 months ago

    Pune, India MICHELIN Full time

    Data Lake Technical Leader - - - - - - - - - - - - MISSION As any other member of the team, you will : Explain Michelin employees what the Corporate Data Lake can do for them Setup workspaces for them Provide coaching and expertise through face to face meeting or on community channels Participate to the platform support effort in a "you build it you...

  • Data Lake Technical Leader

    1 week ago

    Pune, Maharashtra, India MICHELIN Full time

    Data Lake Technical Leader MISSION As any other member of the team, you will : Explain Michelin employees what the Corporate Data Lake can do for them Setup workspaces for them Provide coaching and expertise through face to face meeting or on community channels Participate to the platform support effort in a "you build it you run it" approach ...

  • Data Lake Technical Leader

    3 weeks ago

    pune, India MICHELIN Full time

    Data Lake Technical Leader - - - - - - - - - - - - MISSION As any other member of the team, you will : Explain Michelin employees what the Corporate Data Lake can do for them Setup workspaces for them Provide coaching and expertise through face to face meeting or on community channels Participate to the platform support effort in a "you build...

  • Data Lake Technical Leader

    4 weeks ago

    Pune, India MICHELIN Full time

    Data Lake Technical Leader - - - - - - - - - - - - MISSION As any other member of the team, you will : Explain Michelin employees what the Corporate Data Lake can do for them Setup workspaces for them Provide coaching and expertise through face to face meeting or on community channels Participate to the platform support effort in a "you build it you...

  • Data Lake Admin

    2 weeks ago

    Pune, India Vertiv Full time

    Position Summary:This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration, and...

  • Data Lake Admin

    1 week ago

    Pune, Maharashtra, India Vertiv Full time

    Position Summary:This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration, and...

  • Data Lake Admin

    1 week ago

    Pune, Maharashtra, India Vertiv Group Corp Full time

    Position Summary:He will have hands on experience in big data architecture and data warehousing principles as well as hands on experience in full information lifecycle for large scale big data environments - from data origination to data consumption.Key Duties Administer our data lake organizing access controls processes Support the ETL development team...

  • Sr. Spark and Data Lake Administrator

    1 week ago

    Pune, Maharashtra, India Jade Global Full time

    ob Description Responsibilities:  Configure, fine-tune, and optimize Spark and YARN administration for high performance and resource efficiency.  Setup, configuring and manage Data Lake Houses using Hudi and/or Delta Lake for efficient data storage and processing.  Collaborate with cross-functional teams to design and maintain scalable and reliable...

  • Sr. Spark and Data Lake Administrator

    2 months ago

    pune, India Jade Global Full time

    ob Description Responsibilities:  Configure, fine-tune, and optimize Spark and YARN administration for high performance and resource efficiency.  Setup, configuring and manage Data Lake Houses using Hudi and/or Delta Lake for efficient data storage and processing.  Collaborate with cross-functional teams to design and maintain scalable and reliable...

  • Data Lake Admin

    2 months ago

    pune, India Vertiv Full time

    Position Summary : This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration,...

  • Data Lake Admin

    2 months ago

    Pune, India Vertiv Full time

    Position Summary : This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration, and...

  • Data Lake Admin

    3 weeks ago

    pune, India Vertiv Full time

    Position Summary : This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration,...

  • Data Lake Admin

    1 week ago

    Pune, Maharashtra, India Vertiv Full time

    Position Summary : This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration,...

  • Data Lake Admin

    4 weeks ago

    Pune, India Vertiv Full time

    Position Summary : This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration,...

  • Big Data Architect

    4 weeks ago

    Pune, Maharashtra, India NewVision Softcom & Consultancy Full time

    DataPunePosted On - 31 May 2024 - Required Experience - 12 - 16 Years Basic SectionGrade Role Data Architect Employment Type Full Time Employee Category OrganisationalGroup Company NewVision Company Name New Vision Softcom & Consultancy Pvt. Ltd Function Business Units (BU) Department/Practice Data Department/Practice Data...

  • Big Data Architect

    2 days ago

    Pune, Maharashtra, India NewVision Softcom & Consultancy Full time

    DataPunePosted On - 31 May 2024 - Required Experience - 12 - 16 Years Basic SectionGrade Role Data Architect Employment Type Full Time Employee Category OrganisationalGroup Company NewVision Company Name New Vision Softcom & Consultancy Pvt. Ltd Function Business Units (BU) Department/Practice Data Department/Practice Data...

  • Data Architect

    2 days ago

    Balewadi, Pune, Maharashtra, India Soft-brilliance Full time

    **Job Title**: Sr. Data Architect/Modeler This person will work with Insurance clients and business analysts to gather data requirements, and then design and develop data solutions to provide business insights and manage business performance. The person will be responsible for the _data modeling and architecture_analysis, modelling, design and delivery of...