Data Lake

**Experience**: 10 to 14 years
**Location**: Bengaluru, Gurgaon, Pune
**Job code**: 101127
**Posted on**: Feb 13, 2025

About Us:
AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare, supply chain & logistics, consumer retail, manufacturing, eGovernance and other industry sectors.
We are looking for hungry, highly skilled and motivated individuals to join our dynamic team. If you’re passionate about technology and thrive in a fast-paced environment, we want to hear from you.

Job Summary:
Additionally, the architect will serve as an AI Subject Matter Expert (SME), guiding AI-driven data solutions, ensuring advanced analytics integration, and aligning AI strategy with enterprise goals.

Key Responsibilities:
1.Data Lake Design & Implementation
- Architect, implement, and manage a Microsoft Azure Fabric Data Lake.
- Design efficient and simplified data pipelines without unnecessary layers to improve performance and maintainability.
- Establish best practices for data ingestion, transformation, and storage.

2.Data Enrichment, Curation & Exploration
- Develop strategies for data enrichment, ensuring data is processed and contextualized for analytics.
- Implement data curation processes to organize, standardize, and maintain high-quality datasets.
- Enable self-service data discovery & exploration for business users and data scientists.

3.Security & Governance
- Integrate Azure Active Directory (AAD) for authentication and role-based access control (RBAC).
- Implement Microsoft Purview on Fabric for metadata management, data lineage, and compliance.
- Define and enforce data security policies, encryption, and access management best practices.

4.AI-Driven Data Architecture & AI SME Leadership
- Design AI-ready data architectures that support machine learning and advanced analytics.
- Work closely with data science teams to optimize AI/ML model performance through well-structured data pipelines.
- Provide technical leadership as an AI Subject Matter Expert (SME), guiding AI-driven data strategies.
- Ensure compatibility with Azure Machine Learning, Synapse Analytics, Databricks, and AI frameworks like TensorFlow/PyTorch.

5.Stakeholder Collaboration & AI Strategy Alignment
- Collaborate with business leaders, data engineers, and AI/ML teams to align data strategies with AI initiatives.
- Define AI and data governance strategies to ensure responsible AI adoption.
- Act as a trusted advisor on AI architecture, providing guidance on data-driven AI implementations.

6.Performance Optimization & Scalability
- Monitor and optimize the performance of the Fabric Data Lake and AI-driven pipelines.
- Implement cost-effective, scalable, and fault-tolerant architectures.
- Utilize AI techniques to enhance data processing efficiency and automation.

Role Requirements and Qualifications:

- Proven experience in Microsoft Azure Fabric Data Lake architecture.
- Expertise in data pipeline design (minimizing unnecessary layers).
- Strong knowledge of Azure Data Factory, Synapse Analytics, Databricks, and Purview.
- Hands-on experience with Azure Active Directory (AAD) integration.
- Deep understanding of AI/ML architectures and AI-driven data strategies.
- Proficiency in Python, Scala, or SQL for data engineering and AI workflows.
- Experience designing AI-ready data lakes to support machine learning and deep learning.
- Familiarity with AI model lifecycle management, MLOps, and data versioning.
- Knowledge of AI frameworks like TensorFlow, PyTorch, or Azure ML.
- Azure Data Architect or AI Engineer certification (preferred).
- Experience with real-time data streaming (Kafka, Event Hub, Stream Analytics).
- Knowledge of AI ethics, responsible AI, and data privacy compliance.
- Background in graph analytics, NLP, or generative AI is a plus.

Why Join Us:

- Opportunities to work on transformative projects, cutting-edge technology and innovative solutions with leading global firms across industry sectors.
- Continuous investment in employee growth and professional development with a strong focus on up & re-skilling.
- Competitive compensation & benefits, ESOPs and international assignments.
- Supportive environment with healthy work-life balance and a focus on employee well-being.
- Open culture that values diverse perspectives, encourages transparent communication and rewards contributions.

How to Apply: