Senior Data Engineer

5 hours ago


Hyderabad, Telangana, India Statistics & Data Corporation (SDC) Full time

Senior Data Engineer

Statistics & Data Corporation (SDC), a specialized contract research organization (CRO) headquartered in Arizona, delivering top-tier clinical trial services to pharmaceutical, biologic, and medical device/diagnostic companies since 2005. SDC providing a technology enabled service offering to provide clients with both clinical services expertise, as well as the technology they need to be successful in their clinical trials.

Job Summary

The Senior Data Engineer will design and automate the cleaning, processing, and analyzing of both clinical data and nonclinical data with the goal of transforming data into information that supports better understanding of the safety and efficacy of new clinical therapies. The role contributes to the organization's strong drive to be at the forefront of using Artificial Intelligence (AI) in clinical trials to simplify data processing and discover imperceptible correlations.

Primary Responsibilities


• Designs and develops data architecture for new and existing applications and data sources


• Establishes Data Quality, Data Governance and Master Data Management Best Practices to enable the business to maintain clean and accurate data


• Designs ETL frameworks and features to allow for robust and scalable data pipelines


• Incorporates new pipelines into the existing data model, augmenting as needed


• Manages and maintains several production systems


• Engages with various internal cross-functional departments to strategically design, develop and implement data pipelines while understanding the underlying data


• Increases team productivity by developing, identifying, and implementing better tools and processes


• Exemplifies good documentation, coding, and testing best practices


• Develops standard operating procedures for the use of artificial intelligence and data engineering principles within clinical trials


• Prototypes new ideas/technologies to create proof of concept and demos


• Provides mentorship for other data engineers


• Assists in executing responsibilities of Data Engineers including the following:

o Maintains and develops ETL pipelines

o Maintains an Enterprise Data Warehouse by updating and translation logic and support warehouse servers.

o Follows Data Quality, Data Governance and Master Data Management Best Practices

o Delivers high quality software design documentation

o Prototypes new ideas/technologies to create proof of concept and demos

o Contributes to the development of standard operating procedures

o Performs other related duties incidental to the work described herein


• Adherence to all essential systems and processes that are required at SDC to maintain compliance to business and regulatory requirements


• Act as a resource for other team members for debugging, code reviews and other software development lifecycle activities.


• Contract Research Organization experience and familiarity with its operations

The above statements describe the general nature and level of work being performed by individuals assigned to this classification. This document is not intended to be an exhaustive list of all responsibilities and duties required of personnel so classified.

Requirements

Required Skills


• Fluency in Python with experience parsing, manipulating, and converting data to and from a wide range of formats (CSV, json, XML, html, SQL tables, etc.)


• Deep understanding of modern RDBMS concepts (triggers, indexes, views, stored procedures) and SQL syntax, including experience with at least one modern RDBMS


• Ability to design efficient data warehouse following dimensional modeling principles for scalable reporting.


• Solid understanding of multiple database systems (No-SQL, SQL)


• System design capabilities to improve operational efficiency and costs.


• Experience in the software development lifecycle.


• Ability to mentor other data engineers and increase team productivity


• Ability to work with stakeholders to translate business requirements into clear technical specifications


• Ability to communicate effectively in writing and verbally.


• Ability to identify issues, present problems, and implement solutions


• Capability of communicating technical concepts clearly, concisely, and understandably to non-technical colleagues


• Good leadership, organizational and time management skills, with the ability to multi-task


• Strong interpersonal communication and presentation skills

Education or Equivalent Experience

· Bachelor's degree in a technical field with 7 years of technical experience with the last ~4 years being a Data Engineering centric role OR 10+ years in a technical role with the last ~5 years being a Data Engineering centric role

Benefits

Why SDC

SDC is a team of diversified professionals who deliver exceptional Biometric Services, Consulting, and Technology Solutions to pharmaceutical, biologic, and medical device/diagnostic companies. Since 2005 our purpose has been to partner with sponsors to provide high quality and experienced team members to develop great medicines that save lives and cure diseases in the most efficient manner possible. Our global team operates as a value partner to our clients by fulfilling their needs as our own and delivering exceptional results. We are a specialty CRO in that we provide scalable service offerings, focused services area specialists, efficient project timelines, optimal technology solutions, and proven success and experience. Our commitment to our clients is the same commitment to our employees. By offering strong benefits including competitive pay, generous time off, attainable career advances and positive work/life balance, we are able to attract some of the most talented people in the industry.


• We are committed to developing our employees. We recognize achievements, provide growth opportunities and career advancement, offer a flexible work schedule, engaging work culture and employee benefits.


• We are passionate about our company culture. Our recognition program is directly tied to our core values of Energy, Integrity, Engagement, Innovation, Ownership, and Commitment.


• We strive to provide a place of belonging to our employees with fun and engaging activities from SDC's culture club.


• We are constantly growing and innovating to support our client and employee needs. Global in nature, we bring diverse perspectives enabling our growth in this ever-evolving industry.


• With a proven track record, SDC has been successfully executing client clinical programs since 2005.

Take a look at how you can join our team

#LI-Hybrid


  • Senior Data Engineer

    12 hours ago


    Hyderabad, Telangana, India Statistics & Data Corporation (SDC) Full time

    Senior Data EngineerStatistics & Data Corporation (SDC), a specialized contract research organization (CRO) headquartered in Arizona, delivering top-tier clinical trial services to pharmaceutical, biologic, and medical device/diagnostic companies since 2005. SDC providing a technology enabled service offering to provide clients with both clinical services...

  • Senior Data Engineer

    6 hours ago


    Hyderabad, Telangana, India Statistics & Data Corporation (SDC) Full time

    Senior Data EngineerStatistics & Data Corporation (SDC), a specialized contract research organization (CRO) headquartered in Arizona, delivering top-tier clinical trial services to pharmaceutical, biologic, and medical device/diagnostic companies since 2005. SDC providing a technology enabled service offering to provide clients with both clinical services...

  • Senior Data Engineer

    8 hours ago


    Hyderabad, Telangana, India SDC (Statistics & Data Corporation) Full time

    Statistics & Data Corporation (SDC), a specialized contract research organization (CRO) headquartered in Arizona, delivering top-tier clinical trial services to pharmaceutical, biologic, and medical device/diagnostic companies since 2005. SDC providing a technology enabled service offering to provide clients with both clinical services expertise, as well as...

  • Azure Data Engineer

    1 week ago


    Hyderabad, Telangana, India Enable Data Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...


  • Hyderabad, Telangana, India Valzo Soft Solutions Full time

    Job Description– Senior Data EngineerExperience:5–7 YearsLocation:Hyderabad, Telangana, IndiaEmployment Type:Full-TimeJoining:Immediate HiringPosition OverviewWe are hiring a Senior Data Engineer to lead the development and optimization of scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and PySpark. The role involves managing Data Lake...

  • AI Data Engineer

    9 hours ago


    Hyderabad, Telangana, India NTT DATA, Inc. Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...


  • Hyderabad, Telangana, India WalkingTree Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Company DescriptionFounded in 2008, WalkingTree Technologies is a pioneering IT services company specializing in digital and data solutions. We collaborate with our clients to shape and execute their data and digital strategies, unlocking their full potential. Our core strengths in Product Engineering, Digital Transformation, and Modernization create a...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Sonatype Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    Role : Senior Data EngineerSonatype India - HybridWho We AreAt Sonatype, we help organizations build better, more secure software by enabling them to understand and control their software supply chains. Our products are trusted by thousands of engineering teams globally, providing critical insights into dependency health, license risk, and software security....


  • Hyderabad, Telangana, India Info Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Data EngineerJob SummaryWe are looking for a highly skilledSenior Data Engineerwith expertise in designing, building, and optimizing large-scale data pipelines and integration frameworks. The ideal candidate will have strong experience inbatch and near real-time data processingwithin theAWS ecosystem, with hands-on exposure toDatabricks,...

  • Senior Data Engineer

    11 hours ago


    Hyderabad, Telangana, India Careeco Full time

    Job Title : Senior-Level Data Engineer Healthcare DomainLocation: Remote OptionExperience: 5+ YearsEmployment Type: Full-TimeAbout the RoleWe are looking for a Senior Data Engineer with extensive experience in healthcare data ecosystems and Databricks-based pipelines. The ideal candidate brings deep technical expertise in building large-scale data platforms,...