Snowflake Developer

Description :

We are seeking a highly skilled and experienced Snowflake Lead responsible for leading the design, development, and implementation of Snowflake-based data warehousing solutions. You will leverage your deep understanding of ETL and Data Warehousing concepts to build robust and scalable data pipelines. A key aspect of this role involves direct interaction with business users to gather and clarify requirements, ensuring that the delivered solutions meet their analytical needs.

Responsibilities :

Leadership & Delivery :

- Lead a module or a team of developers in the design, development, and deployment of Snowflake solutions.

- Take ownership of the end-to-end delivery of Snowflake modules, ensuring adherence to timelines and quality standards.

- Provide technical guidance and mentorship to team members, fostering a collaborative and high-performing environment.

- Contribute to project planning, estimation, and risk management activities.

Snowflake Expertise :

- Utilize in-depth knowledge of Snowflake architecture, features, and best practices to design efficient and scalable data models and ETL/ELT processes.

- Develop and optimize complex SQL queries and Snowflake scripting for data manipulation and transformation.

- Implement Snowflake utilities such as SnowSQL, Snowpipe, Tasks, Streams, Time Travel, and Cloning as needed.

- Ensure data security and implement appropriate access controls within the Snowflake environment.

- Monitor and optimize the performance of Snowflake queries and data pipelines.

- Integrate PySpark with Snowflake for data ingestion and processing.

- Understand and apply PySpark best practices and performance tuning techniques.

- Experience with Spark architecture and its components (e.g., Spark Core, Spark SQL, DataFrames).

ETL & Data Warehousing :

- Apply strong understanding of ETL/ELT concepts, data warehousing principles (including dimensional modeling, star/snowflake schemas), and data integration techniques.

- Design and develop data pipelines to extract data from various source systems, transform it according to business rules, and load it into Snowflake.

- Work with both structured and semi-structured data, including JSON and XML.

- Experience with ETL tools (e.g., Informatica, Talend, pyspark) is a plus, particularly in the context of integrating with Snowflake.

Requirements Gathering & Clarification :

- Actively participate in requirement gathering sessions with business users and stakeholders.

- Translate business requirements into clear and concise technical specifications and design documents.

- Collaborate with business analysts and users to clarify ambiguities and ensure a thorough understanding of data and reporting needs.

- Validate proposed solutions with users to ensure they meet expectations.

Collaboration & Communication :

- Work closely with other development teams, data engineers, and business intelligence analysts to ensure seamless integration of Snowflake solutions with other systems.

- Communicate effectively with both technical and non-technical stakeholders.

- Provide regular updates on progress and any potential roadblocks.

Best Practices & Continuous Improvement :

- Adhere to and promote best practices in Snowflake development, data warehousing, and ETL processes.

- Stay up-to-date with the latest Snowflake features and industry trends.

- Identify opportunities for process improvement and optimization.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- Minimum of 5 years of relevant experience in data warehousing and ETL development, with a significant focus on Snowflake.

- Strong proficiency in SQL and experience working with large datasets.

- Solid understanding of data modeling concepts (dimensional modeling, star/snowflake schemas).

- Experience in designing and developing ETL or ELT pipelines.

- Proven ability to gather and document business and technical requirements.

- Excellent communication, interpersonal, and problem-solving skills.

- Snowflake certifications (e.g., SnowPro Core) are a plus.