Capco - Senior Data Engineer - Python/Snowflake DB

2 weeks ago

Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

Position : Senior Data Engineer with Python and Snowflake

Experience : 9+ Years

Location : Hinjewadi, Pune

Shift Timings : 12 : 30 PM - 9 : 30 PM (IST)

Work Model : Hybrid (3 days WFO : Tuesday, Wednesday, Thursday)

Job Summary :

We are seeking a highly skilled and experienced Senior Data Engineer with 9+ years of experience. The ideal candidate will have extensive hands-on expertise in Python and Snowflake, with a proven track record of developing data engineering and data science projects on AWS. You must have a deep understanding of implementing object-oriented programming in Python and hands-on experience in building Snowflake applications using its AI/Cortex platform. This role requires a professional who can handle the entire data lifecycle, from building scalable pipelines and managing data governance to leveraging cutting-edge AI features to create innovative solutions.

Key Responsibilities :


Data Engineering & Development :

- Design and develop data engineering and data science projects on Snowflake/AI Cloud platform on AWS.

- Write and maintain clean, scalable, and object-oriented code in Python, utilizing data structures like Pandas and data frames.

- Build and deploy Python applications like Lambda on AWS, and deploy web applications using Docker containers or Kubernetes with CI/CD pipelines.

- Develop applications using Snowpipe and Snowpark to move and handle unstructured data from cloud sources like AWS S3 and data lakes.

Snowflake & AI/Cortex Development :

- Build applications using the Snowflake AI/Cortex platform, specifically with Cortex Agents, Cortex Search, and Cortex LLMs.

- Implement context enrichment using prompts or Retrieval-Augmented-Generation (RAG) methods.

- Design and implement applications for relevance search and custom interactions with LLMs.

Data Governance & Architecture :

- Implement Snowflake's Account hierarchy model and define robust account-role-permission strategies.

- Handle data sharing using Internal Data Marketplace and Data Exchanges.

- Apply data governance and security concepts, including dynamic row/column-level data masking using Snowflake Tags.

Problem-Solving & Collaboration :

- Continuously improve functionality through experimentation, performance tuning, and incorporating customer feedback.

- Use Agile and SCRUM methodologies with Jira for project management.

Required Skills & Qualifications :


Core Experience :

- 9+ years of experience in data engineering and data science.

- 7+ years of hands-on Python development experience.

Mandatory Technical Skills :

- Proven experience with Snowflake and AWS cloud platform.

- 1+ years of experience with Snowflake AI/Cortex platform.

- Deep understanding of Object-Oriented Programming (OOP) in Python, data structures, and multi-threading concepts.

- Experience with version control using Git or Bitbucket.

- Proficiency in Snowpipe, Snowpark, and developing applications for unstructured data.

- Strong knowledge of Snowflake's data governance and security features.

- Experience with containerization using Docker or Kubernetes.

Professional Attributes :

- Excellent analytical and problem-solving skills.

- The ability to communicate complex technical concepts clearly.

Preferred Skills :

- Experience with different data modeling techniques.

- Experience in building Snowflake native applications using Streamlit.

- Knowledge of application cache implementation within Python web applications.

- Experience with duckdb and Apache Arrow.

- Experience implementing CI/CD pipelines for Snowflake applications.

(ref:hirist.tech)

  • Mid-Data Engineer with Python

    1 day ago

    Pune, Maharashtra, India Capco Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Data Engineer with Python & Snowflake- PuneAbout UsCapco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+...

  • Capco - Python Full Stack Developer - Django/

    2 weeks ago

    Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

    Job Title : Python Full-Stack Developer -PuneAbout Us :Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients...

  • DBT Engineer

    2 weeks ago

    Pune, Maharashtra, India Capco Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title: DBT Developer - PuneAbout UsCapco, a Wipro company, is a global technology and management consulting firm.Awarded with Consultancy of the year in the British Bank Award and has been ranked Top100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presenceacross 32 cities across globe, we support 100+ clients across banking,...

  • Fullstack with Python

    2 weeks ago

    Pune, Maharashtra, India Capco Full time US$ 90,000 - US$ 1,20,000 per year

    About Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy...

  • Senior Data SRE

    2 weeks ago

    Pune, Maharashtra, India Capco Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    About Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded withConsultancy of the year in the British Bank Awardand has been rankedTop 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We...

  • Snowflake Data Engineer- Senior

    2 weeks ago

    Pune, Maharashtra, India HYrEzy Tech Solutions Full time US$ 90,000 - US$ 1,20,000 per year

    Role: Senior Data Engineer (Snowflake)Location: Pune/ HyderabadExperience: 3 - 6 YearsWork model- WFO onlyNotice period: Only 15 days or lessAbout company:We are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first thinking and AI-native execution to help clients achieve...

  • Capco - Big Data Tester - Python/PySpark

    2 weeks ago

    Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

    Position : Big Data TesterExperience : 5-9 YearsLocation : Pune, IndiaJob Summary :We are seeking an experienced Big Data Tester with 5-9 years of experience in software quality assurance, with a dedicated focus on data. The ideal candidate will have a strong background in Python, PySpark, and SQL, along with a proven track record of implementing best...

  • Snowflake Data Engineer Lead Position

    2 weeks ago

    Pune, Maharashtra, India beBeeSnowflake Full time ₹ 18,42,500 - ₹ 23,17,500

    Senior Data Engineer - Snowflake SpecialistWe are seeking an experienced Senior Data Engineer to lead our Snowflake team. The successful candidate will be responsible for designing and developing scalable data pipelines, data models, and transformations using Snowflake.Main Responsibilities:Design, develop, and maintain complex Snowflake databases and data...

  • Snowflake Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jobtravia Pvt. Ltd. Full time

    Job Title : Snowflake Data Engineer Location : Pune, Hyderabad | Hybrid Experience : 5+ YearsAbout the Role :We are looking for a Snowflake Data Engineer with strong expertise in data architecture, pipeline development, and cloud-native solutions. Youll play a key role in designing, optimizing, and maintaining scalable data platforms that transform raw data...

  • Snowflake Data Engineer

    2 weeks ago

    Pune, Maharashtra, India BlueCloud Full time

    Location : Pune (On-Site)SnowFlake Expertise ProfileSummary :- Should hold 10 + years of experience with strong skills with core understanding of cloud data warehouse principles and extensive experience in designing, building, optimizing, and maintaining robust and scalable data solutions on the Snowflake platform.- Possesses a strong background in data...