
Data Engineer
4 days ago
Description
Who is USP?
The U.S. Pharmacopeial Convention (USP) is an independent scientific organization that collaborates with the world's leading health and science experts to develop rigorous quality standards for medicines, dietary supplements, and food ingredients. At USP, we believe that scientific excellence is driven by a commitment to fairness, integrity, and global collaboration. This belief is embedded in our core value of Passion for Quality and is demonstrated through the contributions of more than 1,300 professionals across twenty global locations, working to strengthen the supply of safe, high-quality medicines worldwide.
At USP, we value inclusive scientific collaboration and recognize that attracting diverse expertise strengthens our ability to develop trusted public health standards. We foster an organizational culture that supports equitable access to mentorship, professional development, and leadership opportunities. Our partnerships, standards, and research reflect our belief that ensuring broad participation in scientific leadership results in stronger, more impactful outcomes for global health.
USP is proud to be an equal employment opportunity employer (EEOE) and is committed to ensuring fair, merit-based selection processes that enable the best scientific minds—regardless of background—to contribute to advancing public health solutions worldwide. We provide reasonable accommodations to individuals with disabilities and uphold policies that create an inclusive and collaborative work environment.
Brief Job Overview
The Data Engineer position is a hands-on non-supervisory role within the Data Strategy & Analytics team. The position is an individual contributor role that will serve a critical function by designing, building, and executing efficient and governed data pipelines. This role is integral to transitioning our development of data assets into production environments. The data engineer will collaborate with the data strategy program manager and data scientists by establishing robust data processing practices and tools in support of a data science capability. The position requires some time overlap for meetings with team members based in other time zones, primarily Eastern Standard Time (EST).
How will YOU create impact here at USP?
As part of our mission to advance scientific rigor and public health standards, you will play a vital role in increasing global access to high-quality medicines through public standards and related programs. USP prioritizes scientific integrity, regulatory excellence, and evidence-based decision-making to ensure health systems worldwide can rely on strong, tested, and globally relevant quality standards.
Additionally, USP's People and Culture division, in partnership with the Equity Office, invests in leadership and workforce development to equip all employees with the skills to create high-performing, inclusive teams. This includes training in equitable management practices and tools to promote engaged, collaborative, and results-driven work environments.
The Data Engineer Has The Following Responsibilities
- Design, build, and implement data pipelines to support advanced use cases for product grade data science products
- Manage data ingestion, processing and production process as well as manage tools and platforms
- Integrate external datasets with USP data
- Interface with internal and external teams of data scientists and data engineers on process development
- Collaborate with IT to integrate data warehouse, analytics applications, and data science platforms
- Support transition to agile approaches for data asset development and deployment
- Support transition to a SDLC approach to data asset and data science product development and deployment
Who is USP Looking For?
The Successful Candidate Will Have a Demonstrated Understanding Of Our Mission, Commitment To Excellence Through Inclusive And Equitable Behaviors And Practices, Ability To Quickly Build Credibility With Stakeholders, Along With The Following Competencies And Experience
- Bachelor's Degree in Computer Science, Engineering, Mathematics, or related technical area
- Minimum 3 years of data engineering specific experience designing, building, and supporting data pipelines
- Experience in at least one modern relational database
- Strong core SQL development experience and writing efficient SQL
- Very strong development ability in Python including experience working with pandas, numpy, scikit-learn, selenium, beautifulsoup, and regex
- Hands-on experience with ETL/ELT tools and concepts
- Strong communication and collaboration skills with strength in working in teams
- Strong problem solving and time management skills
- Very strong learning agility- ability to pick up new tools and capabilities quickly
Additional Desired Preferences
- Experience with SDLC and Agile work environments
- Experience working in cloud platforms (AWS, Azure, Google Cloud Platform, etc.)
- Proven ability to clearly define priorities and focus on delivering work products
- Ability to handle multiple priorities and complex projects in a fast-paced environment.
- Substantial experience with Git for version control
- Core data modeling ability
- Ability to derive data modeling decisions and data engineering strategy to meet data strategy objectives
- Direct experience supporting Data Science teams in moving from development to production environments
- Prior experience in a scientific based industry or related content area a plus (pharma, life sciences, public health, research, etc.)
- Experience with Apache Spark and/or pySpark
- Experience working in cloud platforms (AWS, Azure, Google Cloud Platform, etc.)
- Experience with Continuous Integration and Continuous Delivery (Deployment) software development approach
Supervisory Responsibilities
None, this is an individual contributor role.
Benefits
USP provides the benefits to protect yourself and your family today and tomorrow. From company-paid time off and comprehensive healthcare options to retirement savings, you can have peace of mind that your personal and financial well-being is protected.
Note: USP does not accept unsolicited resumes from 3rd party recruitment agencies and is not responsible for fees from recruiters or other agencies except under specific written agreement with USP.
Job Category
Information Technology
Job Type
Full-Time
-
Senior Data Engineer
7 days ago
Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...
-
Azure Data Engineer ll
7 days ago
Hyderabad, Telangana, India Enable Data Full time US$ 90,000 - US$ 1,20,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Data Engineer
7 days ago
Hyderabad, Telangana, India ICE Data Services Full time US$ 1,25,000 - US$ 1,75,000 per yearJob PurposeAt Intercontinental Exchange (ICE), we engineer technology, exchanges and clearing houses that connect companies around the world to global capital and derivative markets. With a leading-edge approach to developing technology platforms, we have built market infrastructure in all major trading centers, offering customers the ability to manage risk...
-
Senior Data Engineer
1 week ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per yearDesign, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks. Gather and analyse data requirements from business stakeholders and identify opportunities for data-driven insights. Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks. Ensure data...
-
Senior Data Engineer
7 days ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...
-
Property Data Engineer
5 days ago
Hyderabad, Telangana, India ICE Data Services Full time ₹ 15,00,000 - ₹ 28,00,000 per yearJob PurposeThe Property Data Engineeris responsible for developing and maintaining data conversion programs that transform raw property assessment data into standardized formats based on specifications by Property Data Analyst and Senior Analysts. This role requires not only advanced programming and ETL skills but also a deep understanding of the structure,...
-
Lead/Senior Data Engineer
7 days ago
Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per yearWe are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...
-
Senior Data Engineer
6 days ago
Hyderabad, Telangana, India Enable Data Incorporated Full timeExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)- Translate business rules into technical specifications and implement scalable data solutions.- Manage...
-
Senior Data Engineer
6 days ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 28,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions. Manage a...
-
Aws Data Engineer
7 days ago
Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per yearWe are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions.Key...