Data Lake Architect
2 months ago
DataPunePosted On
- 19 Feb 2024
- Required Experience
- 10 - 14 Years
Basic SectionGrade
Role
Architect
Employment Type
Full Time
Employee Category
OrganisationalGroup Company
NewVision
Company Name
New Vision Softcom & Consultancy Pvt. Ltd
Function
Business Units (BU)
Department/Practice
Data
Department/Practice
Data Engineering
Region
APAC
Country
India
Base Office Location
Pune
Working Model
Hybrid
Weekly Off
Pune Office Standard
State
Maharashtra
- SkillsSkill
Highest Education
POST GRADUATE
CERTIFICATION
No data available
Working Language
ENGLISH
- Job DescriptionWe are seeking a highly skilled and experienced Data Lake Architect to join our dynamic team. This role offers the opportunity to shape our data architecture, drive innovation, and contribute to the success of data-driven initiatives.
**Responsibilities**:
- Data Lake Design and Architecture: Develop and implement a robust and scalable data lake architecture.
- Data Modeling: Design and implement effective data models that align with business requirements and ensure optimal performance.
- Data Governance: Establish and enforce data governance policies, including data quality, security, and compliance standards.
- Metadata Management: Implement metadata management strategies to catalog and document data assets within the data lake, ensuring proper data lineage and accessibility.
- Data Integration and Ingestion: Lead the development of data integration processes to ingest data from various sources into the data lake.
- Security and Access Control: Implement robust security measures, including encryption, access controls, and authentication mechanisms.
- Scalability and Performance Optimization: Design and implement strategies to scale the data lake infrastructure and optimize performance based on evolving business needs.
- Collaboration and Stakeholder Management: Collaborate with cross-functional teams, including data engineers, analysts, and business stakeholders.
- Technology Evaluation and Adoption: Evaluate and recommend new tools and technologies to enhance the data lake ecosystem.
- Training and Documentation: Assist in developing training content and provide documentation to support the platform.
**Qualifications**
- Bachelor's or Master’s degree in Computer Science, or Information Technology.
- 14+ year of proven experience as a Data Engineer with 4+ year as Data Lake Architect.
- In-depth knowledge of data lake architectures, technologies, and best practices.
- Strong expertise in data modeling, data governance, and metadata management.
- Proficiency in programming languages such as Python, PySpark, Scala.
- Experience with cloud-based data lake platforms (e.g., Azure, AWS).
- Hands on experience with (one or more from each line):
- Apache Airflow | Apache NiFi | Apache Oozie
- AWS Glue Data Catalog | Azure Purview
- Apache Sqoop | AWS DataSync | Azure Data Factory
- Apache Kafka | AWS Kinesis | Azure Event Hubs
- Experience working with version control platform e.g. git
- Experience with JIRA, Confluence
-
Data Lake Technical Leader
1 month ago
Pune, India MICHELIN Full timeData Lake Technical Leader- - - - - - - - - - - -MISSIONAs any other member of the team, you will :Explain Michelin employees what the Corporate Data Lake can do for themSetup workspaces for themProvide coaching and expertise through face to face meeting or on community channelsParticipate to the platform support effort in a "you build it you run it"...
-
Data Lake Technical Leader
2 months ago
Pune, India MICHELIN Full timeData Lake Technical Leader - - - - - - - - - - - - MISSION As any other member of the team, you will : Explain Michelin employees what the Corporate Data Lake can do for them Setup workspaces for them Provide coaching and expertise through face to face meeting or on community channels Participate to the platform support effort in a "you build it you...
-
Data Lake Technical Leader
1 month ago
pune, India MICHELIN Full timeData Lake Technical Leader - - - - - - - - - - - - MISSION As any other member of the team, you will : Explain Michelin employees what the Corporate Data Lake can do for them Setup workspaces for them Provide coaching and expertise through face to face meeting or on community channels Participate to the platform support effort in a "you build...
-
Data Lake Admin
1 week ago
Pune, India Vertiv Full timePosition Summary:This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration, and...
-
Sr. Spark and Data Lake Administrator
4 weeks ago
pune, India Jade Global Full timeob DescriptionResponsibilities: Configure, fine-tune, and optimize Spark and YARN administration for high performanceand resource efficiency. Setup, configuring and manage Data Lake Houses using Hudi and/or Delta Lake forefficient data storage and processing. Collaborate with cross-functional teams to design and maintain scalable and reliabledata...
-
Sr. Spark and Data Lake Administrator
4 weeks ago
Pune, India Jade Global Full timeob DescriptionResponsibilities: Configure, fine-tune, and optimize Spark and YARN administration for high performanceand resource efficiency. Setup, configuring and manage Data Lake Houses using Hudi and/or Delta Lake forefficient data storage and processing. Collaborate with cross-functional teams to design and maintain scalable and reliabledata...
-
Sr. Spark and Data Lake Administrator
4 weeks ago
Pune, India Jade Global Full timeob DescriptionResponsibilities: Configure, fine-tune, and optimize Spark and YARN administration for high performanceand resource efficiency. Setup, configuring and manage Data Lake Houses using Hudi and/or Delta Lake forefficient data storage and processing. Collaborate with cross-functional teams to design and maintain scalable and reliabledata...
-
Sr. Spark and Data Lake Administrator
4 weeks ago
pune, India Jade Global Full timeob Description Responsibilities: Configure, fine-tune, and optimize Spark and YARN administration for high performance and resource efficiency. Setup, configuring and manage Data Lake Houses using Hudi and/or Delta Lake for efficient data storage and processing. Collaborate with cross-functional teams to design and maintain scalable and reliable...
-
Data Lake Admin
2 months ago
Pune, India Vertiv Full timePosition Summary : This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration, and...
-
Data Lake Admin
1 month ago
pune, India Vertiv Full timePosition Summary : This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration,...
-
Data Architect
1 month ago
Pune, India Saaki Argus & Averil Consulting Full timeLooking to Hire for Supply Chain Focused Data Architects:Client :Our client is headquartered in Finland, has its Engineering and R&D Operations in India having 5000+ employees with regional offices in four major cities and 50+ branches across India & Nepal.Data Architect works closely with Data Engineers, Global Data Owners, Enterprise Data Architects, Data...
-
Data Architect
1 month ago
Pune, India Blazeclan Technologies Full time**Data Architect with Data Modeller** **Must have** **Data Architect experience** **Experience in Data modelling using datavault methodology** **10+ years of experience as a Data Architect & Data Modelling** **Good to Have** **Snowflake experience** **AWS/Azure experience** **Role and Experience expected**: - Experience with implementations of the...
-
Cloud Data Solution Architect
3 days ago
Pune, Maharashtra, India Expleo Group Full timeOverview: As a Cloud Data Solution Architect, you will be responsible for designing, architecting, and implementing cloud-based data solutions that meet our business requirements and support our data analytics and decision-making initiatives. You will work closely with cross-functional teams, including data engineering, data science, and business units, to...
-
Data Architect
2 months ago
pune, India Saaki Argus & Averil Consulting Full timeLooking to Hire for Supply Chain Focused Data Architects: Client : Our client is headquartered in Finland, has its Engineering and R&D Operations in India having 5000+ employees with regional offices in four major cities and 50+ branches across India & Nepal. Data Architect works closely with Data Engineers, Global Data Owners, Enterprise Data...
-
Data Architect
1 month ago
Pune, India WorkiFicient Full timeRole - Data Architect Location : Pune/ Mumbai Experience : 7 + years Notice period: Immediate joiner - 45 Days Skills : Databricks, Data lake, Snowflake, Data warehouse, Architecture, Started as DBA, Done migration, design data, on premise to AWS Note : Profile should be AWS heavy. Exposure/hands-on with Other Clouds would be a plus. **Data...
-
Azure Cloud Data Solution Architect
4 weeks ago
Pune, India Nilasu consulting Full timePosition Overview:We are seeking a highly skilled and experienced Azure-Cloud Data Solution Architect to join our team. The Solution Architect will be responsible for designing and implementing end-to-end data solutions, including Data Warehouse, ETL, Data Lake, and Cloud Migration projects. The ideal candidate will have extensive experience in data...
-
Solution Architect
1 day ago
Hinjawadi, Pune, Maharashtra, India BirlaSoft Full timeCountry/Region: IN- Requisition ID: 13410- Work Model: - Position Type: - Salary Range: - Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI**Title**:Solution Architect**: - Description: - Azure Data Architect Experience: 14 to 16 Years, 3+ Years of experience in Azure Data Architect - Cloud Architect with experience in Azure ADF, Databricks, PySpark...
-
Enterprise Data Architect
1 month ago
Pune, India Ciklum Full timeDescriptionCiklumis looking for anEnterprise Data Architectto join our team full-time in India.We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we...
-
Data Architect
2 months ago
Pune, India Saaki Argus & Averil Consulting Full timeLooking to Hire for Supply Chain Focused Data Architects: Client : Our client is headquartered in Finland, has its Engineering and R&D Operations in India having 5000+ employees with regional offices in four major cities and 50+ branches across India & Nepal. Data Architect works closely with Data Engineers, Global Data Owners, Enterprise Data Architects,...
-
Data Architect
2 months ago
Pune, India Trigyn Technologies Full timeJob Description: Trigyn has an opportunity Data Architect. This resource will work at our client sites in Mumbai/Pune/Chennai/Bangalore/Hyderabad. Job Responsibilities: •10+ years of professional experience in Data Management, Information Systems and other BI-related fields is required. •+2 years of data architect experience. •+1 year of...