Big Data Lead

About the Role :

We are seeking a highly experienced Big Data Lead with deep technical expertise in Informatica Intelligent Cloud Services (IICS) and Snowflake Cloud Data Platform. The ideal candidate will have a strong background in data engineering, solution architecture, and system integration with proven experience in retail and supply chain domain.

You will be responsible for designing, implementing, and optimizing large-scale data integration and analytics solutions that support business intelligence, reporting, and advanced analytics initiatives across the organization.

Key Responsibilities :

- Design and implement end-to-end data integration and analytics solutions using IICS and Snowflake.

- Develop scalable, secure, and high-performance data pipelines for ingesting, transforming, and loading data from multiple sources (structured, semi-structured, and unstructured).

- Define data modeling standards, data governance practices, and naming conventions within Snowflake.

- Architect data warehouse/lakehouse solutions optimized for performance, scalability, and cost efficiency.

- Collaborate with enterprise architects to align solutions with organizational data strategies.

- Develop and maintain ETL/ELT workflows using Informatica IICS, leveraging advanced transformations like Aggregator, Lookup, Joiner, Expression, and Router.

- Create and optimize Snowflake SQL scripts, stored procedures, UDFs, and task automation for performance tuning and parallel processing.

- Manage data ingestion from diverse sources Oracle, flat files, APIs, cloud storage (e.g., AWS S3, Azure Blob), etc.

- Migrate legacy Oracle PL/SQL and Informatica PowerCenter workflows to modern IICS and Snowflake environments.

- Implement data quality checks, error handling, and reconciliation mechanisms in ETL processes.

- Develop and manage IICS integrations between Snowflake and other enterprise applications (ERP, CRM, Supply Chain systems).

- Work with cloud platforms (AWS, Azure, GCP) to design secure and scalable data architectures.

- Integrate Snowflake with BI and analytics tools (Power BI, Tableau, Qlik, etc.) for reporting and visualization.

- Optimize cloud resources and pipelines for cost efficiency and performance improvements.

- Manage IICS tasks, schedules, runtime environments, and monitoring for operational excellence.

- Leverage domain experience in Retail and Supply Chain to understand business processes like inventory management, sales forecasting, demand planning, logistics, and order fulfillment.

- Work closely with business users to translate domain-specific requirements into robust data models and analytics solutions.

- Ensure data structures are designed to support key retail KPIs such as sales performance, customer segmentation, and supply chain efficiency.

- Enforce data governance, security, and compliance policies across all data assets.

- Implement role-based access controls (RBAC) and data masking in Snowflake.

- Monitor data usage, lineage, and quality using IICS data profiling and governance capabilities.

- Ensure all solutions adhere to data protection regulations (GDPR, CCPA, etc.) and organizational policies.

- Lead and mentor a team of data engineers and developers, providing technical direction and best practice guidance.

- Collaborate with business stakeholders, architects, project managers, and QA teams to deliver high-quality solutions on time.

- Conduct code reviews, enforce development standards, and promote a DevOps mindset for continuous integration and delivery.

- Stay abreast of emerging technologies in data integration, cloud data platforms, and analytics ecosystems.

Required Skills & Experience :

years of overall experience in data engineering, data integration, or solution architecture.

years of hands-on experience in Informatica IICS (Cloud Data Integration) tasks, mappings, workflows, and runtime environments.

- Strong expertise in Snowflake warehouse design, data modeling, SQL optimization, stored procedures, and Snowpipe.

- Experience with data migration from on-premises Oracle and Informatica PowerCenter to IICS and Snowflake.

- Proficiency in SQL, PL/SQL, Python (optional), or Shell scripting.

- Experience integrating IICS with cloud platforms (AWS, Azure, GCP) and using services like S3, Lambda, Event Hub, or Pub/Sub.

- Strong understanding of ETL/ELT performance tuning, data partitioning, and pipeline optimization.

- Familiarity with BI/Analytics integration (Power BI, Tableau, Looker, etc.).

- Experience managing data quality, lineage, and governance processes.

- Proven experience working in or supporting retail/supply chain data systems.