Data Steward

We are seeking a highly skilled Data Engineer with hands-on experience in SQL, PySpark, Databricks, Snowflake and CI/CD processes. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support our data analytics and business intelligence needs. You will work closely with data scientists, analysts, and Novartis internal customers (CPOs & Regional marketing and sales teams) to ensure the efficient processing and delivery of high-quality data.

Key Responsibilities:

• Design, develop, and optimize data pipelines using Python / PySpark to process and analyze large datasets.
• Write complex SQL queries for data extraction, transformation, and loading (ETL).
• Work with Databricks to build and maintain collaborative and scalable data solutions.
• Implement and manage CI/CD processes for data pipeline deployments to ensure seamless and efficient integration and deployment.
• Collaborate with data scientists and business analysts to understand data requirements and deliver appropriate solutions.
• Ensure data quality, integrity, and security across all data processes.
• Monitor and troubleshoot data pipelines and workflows to resolve issues promptly.
• Continuously improve data and code quality through automation and best practices.
• Ensure projects are delivered on schedule and within established deadlines.
• Aid in the creation and maintenance of Standard Operating Procedures (SOPs).
• Support the development and upkeep of knowledge repositories that capture both qualitative and quantitative reports.

Qualifications:

• Bachelor's degree in computer science, Engineering, Information Technology, or a related field with 4+ years of relevant work experience.
• Proven experience with PySpark, including developing and tuning data processing applications.
• Advanced proficiency in SQL and experience in writing complex queries and optimizing them for performance.
• Hands-on experience with Databricks, including notebooks, clusters, and integration with other data tools.
• Strong understanding of CI/CD pipelines and experience with tools such as Jenkins, GitLab CI/CD, or Azure DevOps.
• Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and related data services.
• Good understanding on data quality management concepts
• Ability to lead and own engagements independently with
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills, with the ability to work effectively in an Agile team environment.

Preferred Skills:

• Understanding of healthcare / life sciences domain data and know-how of pharma ecosystem
• Knowledge of data warehousing concepts and tools (e.g., Snowflake, Redshift).
• Good to have knowledge on kedro framework.

Understanding and applying effective data governance methods

Why Novartis: Helping people with disease and their families takes more than innovative science. It takes a community of smart, passionate people like you. Collaborating, supporting and inspiring each other. Combining to achieve breakthroughs that change patients' lives. Ready to create a brighter future together?

Join our Novartis Network: Not the right Novartis role for you? Sign up to our talent community to stay connected and learn about suitable career opportunities as soon as they come up:

Benefits and Rewards: Read our handbook to learn about all the ways we'll help you thrive personally and professionally:

Division

International

Business Unit

Universal Hierarchy Node

Location

India

Site

Hyderabad (Office)

Company / Legal Entity

IN10 (FCRS = IN010) Novartis Healthcare Private Limited

Functional Area

Marketing

Job Type

Full time

Employment Type

Regular

Shift Work

No

Novartis is committed to working with and providing reasonable accommodation to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the recruitment process, or in order to perform the essential functions of a position, please send an e-mail to [email protected] and let us know the nature of your request and your contact information. Please include the job requisition number in your message.

Novartis is committed to building an outstanding, inclusive work environment and diverse teams' representative of the patients and communities we serve.