Big Data Lead

About the Role : We are seeking a highly experienced Big Data Lead with deep technical expertise in Informatica Intelligent Cloud Services (IICS) and Snowflake Cloud Data Platform. The ideal candidate will have a strong background in data engineering, solution architecture, and system integration with proven experience in retail and supply chain domain.You will be responsible for designing, implementing, and optimizing large-scale data integration and analytics solutions that support business intelligence, reporting, and advanced analytics initiatives across the organization.Key Responsibilities : - Design and implement end-to-end data integration and analytics solutions using IICS and Snowflake.- Develop scalable, secure, and high-performance data pipelines for ingesting, transforming, and loading data from multiple sources (structured, semi-structured, and unstructured).- Define data modeling standards, data governance practices, and naming conventions within Snowflake.- Architect data warehouse/lakehouse solutions optimized for performance, scalability, and cost efficiency.- Collaborate with enterprise architects to align solutions with organizational data strategies.- Develop and maintain ETL/ELT workflows using Informatica IICS, leveraging advanced transformations like Aggregator, Lookup, Joiner, Expression, and Router.- Create and optimize Snowflake SQL scripts, stored procedures, UDFs, and task automation for performance tuning and parallel processing.- Manage data ingestion from diverse sources Oracle, flat files, APIs, cloud storage (e.g., AWS S3, Azure Blob), etc.- Migrate legacy Oracle PL/SQL and Informatica PowerCenter workflows to modern IICS and Snowflake environments.- Implement data quality checks, error handling, and reconciliation mechanisms in ETL processes.- Develop and manage IICS integrations between Snowflake and other enterprise applications (ERP, CRM, Supply Chain systems).- Work with cloud platforms (AWS, Azure, GCP) to design secure and scalable data architectures.- Integrate Snowflake with BI and analytics tools (Power BI, Tableau, Qlik, etc.) for reporting and visualization.- Optimize cloud resources and pipelines for cost efficiency and performance improvements.- Manage IICS tasks, schedules, runtime environments, and monitoring for operational excellence.- Leverage domain experience in Retail and Supply Chain to understand business processes like inventory management, sales forecasting, demand planning, logistics, and order fulfillment.- Work closely with business users to translate domain-specific requirements into robust data models and analytics solutions.- Ensure data structures are designed to support key retail KPIs such as sales performance, customer segmentation, and supply chain efficiency.- Enforce data governance, security, and compliance policies across all data assets.- Implement role-based access controls (RBAC) and data masking in Snowflake.- Monitor data usage, lineage, and quality using IICS data profiling and governance capabilities.- Ensure all solutions adhere to data protection regulations (GDPR, CCPA, etc.) and organizational policies.- Lead and mentor a team of data engineers and developers, providing technical direction and best practice guidance.- Collaborate with business stakeholders, architects, project managers, and QA teams to deliver high-quality solutions on time.- Conduct code reviews, enforce development standards, and promote a DevOps mindset for continuous integration and delivery.- Stay abreast of emerging technologies in data integration, cloud data platforms, and analytics ecosystems.Required Skills & Experience : - 8+ years of overall experience in data engineering, data integration, or solution architecture.- 5+ years of hands-on experience in Informatica IICS (Cloud Data Integration) tasks, mappings, workflows, and runtime environments.- Strong expertise in Snowflake warehouse design, data modeling, SQL optimization, stored procedures, and Snowpipe.- Experience with data migration from on-premises Oracle and Informatica PowerCenter to IICS and Snowflake.- Proficiency in SQL, PL/SQL, Python (optional), or Shell scripting.- Experience integrating IICS with cloud platforms (AWS, Azure, GCP) and using services like S3, Lambda, Event Hub, or Pub/Sub.- Strong understanding of ETL/ELT performance tuning, data partitioning, and pipeline optimization.- Familiarity with BI/Analytics integration (Power BI, Tableau, Looker, etc.).- Experience managing data quality, lineage, and governance processes.- Proven experience working in or supporting retail/supply chain data systems. (ref:hirist.tech)