
Data Engineer – Cloud Integration
1 day ago
Company Overview
Boston Insights is an innovative startup creating competitive advantage for pharmaceutical companies by unlocking their clinical supply chain data and enabling end-to-end visibility. We augment risk resiliency and agility to ensure uninterrupted supply of investigational drugs to patients on-time. Our mission is to transform how pharmaceutical companies manage their clinical supply chains through cutting-edge data solutions.
Position Overview
We are seeking a Data Engineer with 5+ years of experience, deep expertise in the Microsoft Azure technology stack, and proven ability in integrating data from external data lakes, AWS data warehouses, and enterprise supply chain solutions like SAP. The ideal candidate will also have strong experience in data governance and building data automation tools using Python and related languages.
Key Responsibilities
Data Integration & Pipeline Development
- Design, build, and maintain scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake
- Lead the integration strategy for ingesting and harmonizing data from external sources, including AWS-based data lakes/warehouses (such as S3, Redshift) and SAP systems.
- Automate ETL processes for data extraction, transformation, and loading across hybrid and multi-cloud environments.
- Build and maintain real-time and batch data integration workflows between Azure, AWS, and on-premises sources.
Data Architecture & Infrastructure
- Design and implement data lake and data warehouse solutions on Azure platform
- Establish data governance frameworks and ensure data quality across all pipelines
- Implement security best practices for handling sensitive pharmaceutical data
- Create and maintain data documentation and lineage tracking
Data Governance & Quality
- Define and enforce data governance frameworks: data cataloging, lineage, quality, privacy, and compliance
- Implement robust data validation, cleansing, and monitoring systems to ensure accuracy and reliability
- Support security standards through effective data management practices.
Automation & Tooling
- Develop data automation tools and reusable components using Python, PySpark (and other relevant frameworks/languages)
- Enable end-to-end process automation for data ingestion, processing, and reporting.
- Implement CI/CD processes for data solutions, including testing, monitoring, and alerting.
Analytics & Reporting Support
- Collaborate with data scientists and analysts to support advanced analytics
- Build data models that enable risk assessment and supply chain optimization
- Develop APIs and data services to support front-end applications
- Create monitoring and alerting systems for data pipeline health
Collaboration & Support
- Partner with supply chain, analytics, and business stakeholders to understand business requirements and translate them into scalable technical solutions.
- Collaborate with SAP functional and technical teams to optimize data extraction and synchronization.
Required Technical Qualifications
- 5+ years of professional data engineering experience.
- Data Integration: Proven track record integrating data from AWS services (S3, Redshift, Glue, etc.) into Azure or other cloud environments
- Azure Data Services : Expert-level knowledge of Azure Data Factory, Azure Synapse Analytics, Data Bricks, Azure Data Lake Storage, and Azure SQL Database, Apache Spark
- Database Technologies : Strong knowledge of both relational (SQL Server, PostgreSQL) and NoSQL (Cosmos DB) databases
- Programming Languages : Proficiency in Python, SQL, PySpark and PowerShell for data automation and wrangling
- Version Control : Proficiency with Git and Azure DevOps
- Hands-on experience with SAP data models and integrating SAP data with Azure data lake
Preferred Technical Skills
- Experience with API-based data integration for cloud and enterprise applications.
- Experience with Infrastructure as Code (ARM templates, Terraform)
- Familiarity with data quality tools, metadata management, and automated data lineage tracking.
- Knowledge of containerization (Docker, Kubernetes) for data automation workflows.
- Knowledge of machine learning pipelines and MLOps practices
- Experience with data visualization tool, Power BI
Professional Skills
- Strong problem-solving and analytical thinking abilities
- Excellent communication skills with ability to explain technical concepts to non-technical stakeholders
- Experience with Agile development methodologies
- Attention to detail and commitment to data quality
The opportunity we offer
- Competitive salary commensurate with experience.
- Professional development training and certifications.
Work Environment
- Remote work arrangement with flexible hours
- State-of-the-art technology and tools
- Collaborative, innovation-driven culture
- Access to cutting-edge pharmaceutical industry data and challenges
- Opportunity to shape an innovative pharma analytics platform.
Application Instructions
Please submit your resume and a cover letter highlighting:
- Experience in Azure, AWS data integration, and SAP data extraction.
- Examples of data automation tools or frameworks you have developed.
Join us to unlock new possibilities in pharmaceutical supply chain data through advanced engineering and multi-cloud innovation
Boston Insights is transforming pharmaceutical supply chains through innovative data solutions. Join us in ensuring that life-saving investigational drugs reach patients on-time, every time.
-
Oracle Cloud Integration
4 weeks ago
India Cloud Kinetics Full timeWork Time: General work timeMode of Work: Remote / Hybrid ( Bengaluru )Description:As Oracle Cloud Integration Analyst, you would be working on some of our latest ventures to implement cutting-edge SaaS/PaaS business applications. You will be helping us with coordination, documentation, test execution, conducting POC, post-production maintenance, and support...
-
Oracle Cloud Integration
4 weeks ago
India Cloud Kinetics Full timeWork Time: General work timeMode of Work: Remote / Hybrid ( Bengaluru ) Description:As Oracle Cloud Integration Analyst, you would be working on some of our latest ventures to implement cutting-edge SaaS/PaaS business applications. You will be helping us with coordination, documentation, test execution, conducting POC, post-production maintenance, and...
-
Senior Data Engineer
3 weeks ago
India Aptus Data Labs Full timeJob Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...
-
Cloud Data Engineer
2 weeks ago
India Lemongrass Full timeAbout Lemongrass Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders. We are...
-
India Blue Cloud Softech Solutions Limited Full timeAbout the Company At BCSS we strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business. The Analytics team at BCSS is part of the Organization...
-
India Blue Cloud Softech Solutions Limited Full timeAbout the CompanyAt BCSS we strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business. The Analytics team at BCSS is part of the Organization and...
-
Cloud Data Engineering Leader
1 day ago
India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title:Cloud Data Engineering LeaderJob Summary:A leading organization is seeking an experienced cloud data engineering leader to oversee the development and implementation of scalable data pipelines and analytics platforms.Key Responsibilities:Lead a team of data engineers in designing and delivering cloud-native data infrastructure solutions using Azure...
-
Data Engineer – Databricks
2 days ago
India Epergne Solutions Full timeProject Overview We are seeking skilled Data Engineers with strong hands-on experience in Databricks for a high-impact data platform project The project involves building scalable data pipelines integrating with cloud platforms and managing data governance using Unity Catalog Key Requirements Primary Skills Expertise in Databricks working on...
-
Senior Data Architect
4 weeks ago
India Blue Cloud Softech Solutions Limited Full timeWe are on an exciting journey to build and scale our advanced analytics practice.We are looking for a Senior Data Architect who has experience in building data lake and data warehouse architectures using On-Prem and Cloud technologies. We are seeking a highly skilled and experienced Data Architect with a strong background in Big Data technologies,...
-
Senior Data Engineer
3 days ago
India beBeeDatabricks Full time ₹ 12,00,000 - ₹ 18,00,000Azure Databricks Engineer PositionWe are seeking a seasoned data engineer to lead our Databricks team. The ideal candidate will have extensive experience with data ingestion processes and expertise in CI/CD and Kubernetes.This role offers an opportunity to design, develop, and optimize data ingestion pipelines for integrating multiple sources into...