Azure De
2 months ago
We are seeking an experienced and knowledgeable Azure Data Engineer with expert-level skills in Azure Databricks and Delta Architecture, specifically focused on supply chain and clinical trial data. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining our Azure data platform for supply chain and clinical trial data using state-of-the-art technologies and best practices.
**Responsibilities**:
Design, develop, and implement end-to-end data solutions on the Azure platform, leveraging Azure Databricks and Delta Architecture for supply chain and clinical trial data. Architect, build, and optimize data pipelines and ETL processes to ingest, transform, and load supply chain and clinical trial data from various sources into Azure Databricks.
Collaborate with stakeholders from the supply chain and clinical trial domains to understand data requirements and translate them into technical solutions.
Build scalable and efficient data models using Delta Lake for structured and unstructured supply chain and clinical trial data on Azure Databricks.
Develop and implement data ingestion frameworks, data validation processes, and data quality controls specific to supply chain and clinical trial data.Optimize performance and troubleshoot issues within Azure Databricks by tuning Spark configurations, optimizing query performance, and implementing caching strategies for supply chain and clinical trial data processing.
Monitor, manage, and ensure the security, reliability, and availability of data pipelines and the Azure data platform for supply chain and clinical trial data.
Implement best practices in data governance, data security, and data privacy for supply chain and clinical trial data, ensuring compliance with regulatory requirements.
Collaborate with infrastructure and DevOps teams to ensure effective deployment, configuration, and management of Azure Databricks clusters for supply chain and clinical trial data processing.
Stay up to date with the latest advancements and trends in Azure Databricks, Delta Architecture, and other relevant Azure data technologies for supply chain and clinical trial data, proactively bringing in new ideas and solutions to enhance the data platform.
**Requirements**:
Bachelor or master degree in computer science, information systems, or closely related field.
Strong experience as a data engineer, with a focus on Azure data solutions, specifically in the supply chain and clinical trial domains.
Expert-level skills in Azure Databricks and Delta Architecture for processing supply chain and clinical trial data. Proficiency in Apache Spark, Scala, Python, SQL, and other relevant programming languages for data processing and analytics.
In-depth knowledge of data warehousing concepts, data modeling, and ETL processes for supply chain and clinical trial data.
Experience with data integration and data ingestion techniques using various technologies and protocols for supply chain and clinical trial data REST APIs, Kafka, Azure Event Hubs, etc
Strong understanding of data governance, data security, and data privacy requirements specific to supply chain and clinical trial data.
Familiarity with Azure cloud services, such as Azure Data Factory, Azure SQL Database, Azure Storage, and Azure Functions for supply chain and clinical trial data processing.
**About Virtusa**
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.
-
Bengaluru, Karnataka, India Nike Full timeRejoignez l'équipe de sécurité de Nike, Inc. L'entreprise recherche des personnes capables d'évoluer, de réfléchir, de rêver et de créer. L'épanouissement de sa culture repose sur son ouverture à la diversité et sur sa façon d'encourager l'imagination. La marque a besoin de personnes talentueuses, de leaders et de...
-
Ingénieur en sécurité des plateformes senior
3 weeks ago
Bengaluru, Karnataka, India Nike Full timeRejoignez l'équipe de NIKE, Inc. pour un rôle en sécurité des plateformes senior. L'entreprise recherche des personnes capables d'évoluer, de réfléchir, de rêver et de créer. L'épanouissement de sa culture repose sur son ouverture à la diversité et sur sa façon d'encourager l'imagination. La marque a besoin de personnes...
-
INGENIEUR EN RESEAUX ET SECURITE DE RESEAUX
3 weeks ago
Bengaluru, Karnataka, India Alstom Full timeRequis ID : 446474À Alstom, nous avons une connaissance approfondie des réseaux de transport et comprenons ce qui motive les individus à les utiliser. Des trains à grande vitesse, métros, monorails et tramways aux systèmes intégrés, services, infrastructures, et solutions de signalisation et de mobilité numérique, nous offrons à la diversité de...
-
Azure Data Support
5 months ago
Bengaluru, Karnataka, India Kyndryl Full timeWho We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role Are...
-
Aws De
5 months ago
Bengaluru, Karnataka, India Virtusa Full time**Responsibilities**: Create and maintain optimal data pipeline architecture by designing and implementing data ingestion solutions on AWS using AWS native services (such as GLUE, Lambda) or using data management technologies (such as Talend or Informatica) Design and optimize data models on AWS Cloud using AWS data stores such as Redshift, DynamoDB, RDS,...
-
Attacama- Migration DE lead
3 weeks ago
Bengaluru, India NR Consulting - India Full timeJob Title: Attacama- Migration DE leadLocation: BangaloreExperience: 8-11 yearsJob Description:- 9 to 12 years of experience- Must-have skills: - Databricks - Python - SQL - Spark - Jenkins - Airflow - Bitbucket- Nice-to-have skills: - Advanced Python - ETL tool experience (Azure Data Factory, Informatica, etc.)- 5+ years in developing data lakes...
-
Attacama- Migration DE lead
1 week ago
Bengaluru, India NR Consulting - India Full timeJob Title: Attacama- Migration DE lead Location: Bangalore Experience: 8-11 years Job Description: - 9 to 12 years of experience - Must-have skills: - Databricks - Python - SQL - Spark - Jenkins - Airflow - Bitbucket - Nice-to-have skills: - Advanced Python - ETL tool experience (Azure Data Factory, Informatica, etc.) - 5+ years in...
-
Attacaam Migration- Sr DE
3 weeks ago
Bengaluru, India NR Consulting - India Full timeJob Title: Attacaam Migration- Sr DE Location: BangaloreExperience: 5-11 yearsJob Description:- Must have: - Databricks - Python - SQL - Spark - Jenkins - Airflow - Bitbucket - Nice to have: - Python - Understanding of ETL tools (Azure Data Factory, Informatica, etc.) Roles & Responsibilities:- 3+ years of experience in...
-
Attacaam Migration- Sr DE
1 week ago
Bengaluru, India NR Consulting - India Full timeJob Title: Attacaam Migration- Sr DE Location: Bangalore Experience: 5-11 years Job Description: - Must have: - Databricks - Python - SQL - Spark - Jenkins - Airflow - Bitbucket - Nice to have: - Python - Understanding of ETL tools (Azure Data Factory, Informatica, etc.) Roles & Responsibilities: - 3+ years of...
-
Azure Specialist
3 weeks ago
Bengaluru, India Version 1 Full timeJob DescriptionWe are seeking an experienced Azure Specialist to join our IT department. You will work closely with other IT teams to ensure seamless operations and contribute to continuous improvement initiatives within the cloud environment. This role requires deep technical expertise in Azure cloud services, a strong understanding of cloud architecture,...
-
Azure Cloud Engineer
3 weeks ago
Bengaluru, Karnataka, India Version 1 Full timeJob Title: Azure Cloud EngineerWe are seeking an experienced Azure Cloud Engineer to join our IT department at Version 1. As a key member of our team, you will work closely with other IT teams to ensure seamless operations and contribute to continuous improvement initiatives within the cloud environment.Key Responsibilities:Provide input on best practices...
-
Azure Big Data Engineer- New
5 months ago
Bengaluru, India Tiger Analytics Full timeJob Description Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, our + tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you’ll find our...
-
Specialist Software Engineer
5 months ago
Bengaluru, India Société Générale Assurances Full timeSpecialist Software Engineer - Devops , Public Cloud (AWS/Azure) CDI|Bangalore|IT (Systèmes d'information) Specialist Software Engineer - Devops , Public Cloud (AWS/Azure) Bangalore, Inde CDI IT (Systèmes d'information) Vos missions au quotidien * Test, build, and maintain landing zone environment in AWS based on security best...
-
Network and Network Security Architect
1 month ago
Bengaluru, Karnataka, India ALSTOM Full timeReq ID:446474 Chez Alstom, nous avons une connaissance pointue des réseaux de transport et comprenons ce qui conduit les individus à les emprunter. Des trains à grande vitesse, métros, monorails et tramways aux systèmes intégrés, services, infrastructures, et solutions de signalisation et de mobilité numérique, nous offrons à la diversité de nos...
-
Azure Big Data Architect
2 weeks ago
Bengaluru, Karnataka, India Tiger Analytics Full timeAbout the RoleTiger Analytics is a global AI and analytics consulting firm, and we're looking for a skilled Big Data Engineer to join our team. As a Big Data Engineer at Tiger Analytics, you'll be at the forefront of an AI revolution, working with cutting-edge technologies on Microsoft Azure.Your Key ResponsibilitiesDesign and build scalable data ingestion...
-
Azure Big Data Solutions Architect
7 days ago
Bengaluru, Karnataka, India Tiger Analytics Full timeJob OverviewTiger Analytics, a global AI and analytics consulting firm, seeks an experienced Big Data Engineer to join our team. As a key member of our data engineering team, you will design and build scalable data ingestion pipelines, process structured and unstructured data, and collaborate with cross-functional teams to deliver high-quality analytical...
-
Commvault Backup
5 months ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeVery strong working knowledge of CommVault, Performing Restores Backup Monitoring and Reporting Tool Installation Troubleshooting Backup Failures Handle issues related to CommVault Catalog databases, Storage Units, Policies, De-Duplication, vStorage APIs, etc. Experienced in Windows and Unix/Linux server administration including routine patching in a...
-
Bengaluru, India KPMG India Full timeAbout KPMG in India KPMG entities in India are professional services firm(s). These Indian member firms are affiliated with KPMG International Limited. KPMG was established in India in August 1993. Our professionals leverage the global network of firms, and are conversant with local laws, regulations, markets and competition. KPMG has offices across India in...
-
Forgerock
3 months ago
Bengaluru, Karnataka, India Wipro Limited Full timeOverview: **Installation and Configuration**: Install, configure, and maintain ForgeRock Identity and Access Management (IAM) components including OpenAM, OpenIDM, OpenDJ, and OpenIG. **System Administration**: Monitor system performance, availability, and security. Perform regular updates, patches, and upgrades to ensure systems are current and...
-
Principal Consultant
4 months ago
Bengaluru, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...
