Manager, Databricks Tech

Based in Hyderabad join a global healthcare biopharma company and be part of a 130-year legacy of success backed by ethical integrity forward momentum and an inspiring mission to achieve new milestones in global healthcare Be part of an organization driven by digital technology and data-backed approaches that supports a diversified portfolio of prescription medicines vaccines and animal health products Drive innovation and execution excellence Be the leaders who have a passion for using data analytics and insights to drive decision-making which will allow us to tackle some of the world s greatest health threats Our Technology Centers focus on creating a space where teams can come together to deliver business solutions that serve our company purpose to save and improve lives An integral part of our company IT operating model Tech Centers are globally distributed locations where each IT division has employees to enable our digital transformation journey and drive business outcomes These locations in addition to the other sites are essential to supporting our business and strategy A focused group of leaders in each Tech Center helps to ensure we can manage and improve each location from investing in growth success and well-being of our people to making sure colleagues from each IT division feel a sense of belonging in our global organization that partners across the entire company And together we must leverage the strength of our team to collaborate globally to optimize connections and share best practices across the Tech Centers Role Overview Are you ready to step into a leading IT role where you could help make a real difference in people s lives Become our new Data Integration Technology delivery lead and guide your team to deliver data-driven insights that better enable us all on our mission to bring hope to those battling the most challenging diseases of our time If you are ready make a difference and apply today What will you do in this role Develop and implement data engineering strategies and data mesh architectures on DatabricksDesign build and maintain ETL ELT pipelines using PySpark and other data engineering tools Collaborate with cross-functional teams to ensure data governance security and compliance Stay up to date with the latest Databricks features and advancements implementing them into our data engineering practices Leverage the toolset utilized by various types of Data Engineers ensuring seamless collaboration with cross-functional data teams across the organization Drive and manage the team of Data engineers to ensure the best performance during the project life cycle Design develop and maintain data pipelines to extract data from various sources and populate a data lake and data warehouse Collaborate with Data Analysts Data Scientists and Machine Learning Engineers to identify and transform data for ingestion exploration and modeling Work with the data governance team to implement data quality checks and maintain data catalogs Use data orchestration logging and monitoring tools to build resilient pipelines Use test-driven development methodology when building ELT ETL pipelinesUnderstand and apply concepts like a data lake data warehouse lake-house data mesh and data fabric where relevantDevelop data models for cloud data warehousesDevelop pipelines to ingest data into cloud data warehousesLead in an agile engineering environment providing guidance on complex data and unplanned data challenges Collaborate with peers in the Data Integration and Central Data and Analytics teams to provide feedback about the toolset and help define product strategies Engage with key project stakeholders to gain insight into short-term and long-term business objectives and value delivery strategies Participate in negotiations with vendors to secure favorable terms and conditions Retain and attract diverse exceptional talent fostering an inclusive environment Encourage a culture of continuous learning constructive collaboration and innovation within the team What Should you have Minimum of 8-10years in senior developer role of developing data pipelines data infrastructure ideally within a drug development or life sciences context Working on large data sets and handling raw SQLExperience using technologies such as Pyspark AWS DatabricksExperience creating ETL PipelineExperience leading teams and managing projects Strong understanding of data governance compliance and security best practices Excellent communication and problem-solving skills with the ability to manage multiple priorities Demonstrated expertise in delivering large-scale information management technology solutions encompassing data integration and self-service analytics enablement Expert in software data engineering practices including versioning release management deployment of datasets agile related software tools Strong working knowledge of at least one large-scale data processing technology e g High-performance computing distributed computing databases and underlying technology cloud or on-prem environments containerization distributed storage databases Cloud-native ideally AWS certified Strong interpersonal and communication skills verbal and written effectively bridging scientific and business needs experience working in a matrix environment Proven record of delivering high-quality resultsProduct and customer-centric approach Innovative thinking experimental mindset Our technology teams operate as business partners proposing ideas and innovative solutions that enable new organizational capabilities We collaborate internationally to deliver services and solutions that help everyone be more productive and enable innovation Who we are We are known as Merck Co Inc Rahway New Jersey USA in the United States and Canada and MSD everywhere else For more than a century we have been inventing for life bringing forward medicines and vaccines for many of the world s most challenging diseases Today our company continues to be at the forefront of research to deliver innovative health solutions and advance the prevention and treatment of diseases that threaten people and animals around the world What we look for Imagine getting up in the morning for a job as important as helping to save and improve lives around the world Here you have that opportunity You can put your empathy creativity digital mastery or scientific genius to work in collaboration with a diverse group of colleagues who pursue and bring hope to countless people who are battling some of the most challenging diseases of our time Our team is constantly evolving so if you are among the intellectually curious join usxe2x80x94and start making your impact today HYDIT2025Current Employees applyCurrent Contingent Workers applySearch Firm Representatives Please Read Carefully Merck Co Inc Rahway NJ USA also known as Merck Sharp Dohme LLC Rahway NJ USA does not accept unsolicited assistance from search firms for employment opportunities All CVs resumes submitted by search firms to any employee at our company without a valid written search agreement in place for this position will be deemed the sole property of our company No fee will be paid in the event a candidate is hired by our company as a result of an agency referral where no pre-existing agreement is in place Where agency agreements are in place introductions are position specific Please no phone calls or emails Employee Status RegularRelocation VISA Sponsorship Travel Requirements Flexible Work Arrangements HybridShift Valid Driving License Hazardous Material s Required Skills Business Intelligence BI Database Administration Data Engineering Data Management Data Modeling Data Visualization Design Applications Information Management Software Development Software Development Life Cycle SDLC System DesignsPreferred Skills Job Posting End Date 02 28 2025 A job posting is effective until 11 59 59PM on the day BEFORE the listed job posting end date Please ensure you apply to a job posting no later than the day BEFORE the job posting end date