Azure Bigdata Specialist
2 days ago
Job Description
Overall, 4 to 8 years of experience in IT Industry.
Min 4 years of experience working on Data Engineering using Azure Databricks, Synapse, ADF/Airflow.
At least 3 Project experience in Building and maintaining ETL / ELT pipelines for large data sets, complex data processing, transformations, business logics, cost monitoring & performance optimization, and feature engineering processes.
Must Have skills:
Extensive experience with Azure Databricks (ADB), Delta Lake, Azure Data Lake Storage (ADLS), Azure Data factory (ADF), Azure SQL Database (SQL DB), SQL, ELT / ETL Pipeline Development in Spark based environment.
Extensive Experience with SparkCore, PySpark, Python, SparkSQL, Scala, Azure Blob Storage.
Experience in Real-Time Data Processing using Apache Kafka/EventHub/IoT, Structured Streaming and Stream analytics.
Experience with Apache Airflow for ELT Orchestration.
Experience with infrastructure management, Infrastructure as code (e.g. Terraform)
Experience with CI/CD, Version control tools like GitHub, Azure DevOps.
Experience with Version control tools, building CI/CD pipelines.
Experience with Azure cloud platform.
Good to have:
Experience / Knowledge on Containerizations - Docker, Kubernetes
Experience working in Agile Methodology
Qualifications
Qualifications - BE, MS, M.Tech or MCA
Additional Information
Certifications: Azure Big Data, Databricks Certified Associate
-
Azure Integration Specialist
2 weeks ago
Bengaluru, Karnataka, India Capgemini Full time ₹ 15,00,000 - ₹ 25,00,000 per yearAzure Integration Specialist We're Hiring Azure Integration Specialist, passionate about cloud integration and automation. with hands-on experience with Azure Logic Apps and API Management (APIM). Join our dynamic team as we build scalable, secure, and intelligent solutions using Microsoft Azure Role: Azure Integration Consultant Experience: 4...
-
Azure Cloud Migration Specialist
2 weeks ago
Bengaluru, Karnataka, India SP Software Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearAzure Cloud Migration Specialist Primary Skill Set:4+ years of exp in Azure engineering/migration, strong knowledge of Azure infra (VMs, Networking, Storage, Security), Hands-on experience with Azure Migrate, DMS, Azure Site Recovery and Terraform. Good to have Azure Solution Architect or Azure Administrator certification Total Experience : 6+...
-
Bigdata Developer
1 week ago
Bengaluru, Karnataka, India IQVIA Full time ₹ 8,00,000 - ₹ 24,00,000 per yearBigdata Developer PRINCIPAL ACCOUNTABILITIES Should be able to understand the application requirement. • Responsible for application design and development in Azure Databricks, Big data technologies(Scala, Spark, Hive). • Handle complete unit testing of the component or application. • Support testing and UAT phases and resolve issues...
-
Azure API Integrations specialist
2 days ago
Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob DescriptionExperience: 9-14 yearsContract: 3-6 months + extendable Location: Bangalore / Hyderabad / Pune / Chennai (Any Brillio office) | Remote will also workADO Integrations/API Developer specialistKey ResponsibilitiesDiscover and assess the current CI/CD pipeline configurations, deployments, and integration readiness across different technology...
-
Azure IoT DevOps Specialist
3 days ago
Bengaluru, Karnataka, India Encycdata Full time ₹ 20,00,000 - ₹ 50,00,000 per yearWe're seeking Azure IoT DevOps Specialist(Freelancer) to lead the architecture, development, and operational excellence of our next-generation industrial Internet of Things (IIoT) solutions. This is a senior-level role demanding deep technical expertise in both Azure IoT services and advanced DevOps practices, with a focus on scalability, security, and...
-
Azure Kubernetes
1 day ago
Bengaluru, Karnataka, India Landmark Group Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Summary:We are seeking an experienced and knowledgeable Azure Kubernetes Expert to join our dynamicteam with 5-6 years of experience in managing and maintaining Kubernetes. The ideal candidatewill have a deep understanding of Azure services and extensive expertise in designing,implementing, and managing Kubernetes clusters within the Azure environment....
-
Azure Cloud Engineer
1 day ago
Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 9,00,000 - ₹ 12,00,000 per yearSkill Azure CloudAzure DevOpsDesigning and Implementing in Cloud AzureAzure services and featuresCloud SecurityIdentity Management PracticesData ProtectionSentinelJob Description:We are seeking a highly skilled Technical Specialist to join our team. As a Technical Specialist, you will be responsible for designing, implementing, and maintaining cloud-based...
-
Azure AD Specialist
2 weeks ago
Bengaluru, Karnataka, India Persistent Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAbout Position:We are seeking a skilled and proactive Active Directory & Entra ID Administrator to join our IT infrastructure team. This role is critical in ensuring the reliability, security, and performance of our identity and access management systems across both on-premises and cloud environments. You will be responsible for managing and optimizing...
-
ETL Testing Specialist – Azure
2 weeks ago
Bengaluru, Karnataka, India SWITS DIGITAL Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Description: Software Quality Engineer – ETL / Data Testing (Azure & SAP HANA)Experience Required:6+ yearsLocation:BangaloreRole SummaryWe are seeking an experiencedSoftware Quality Engineer / ETL Testing Specialistto work closely with business and delivery teams to execute test strategies and ensure high-quality data solutions. The candidate will be...
-
Big Data Specialist Programmer
2 weeks ago
Bengaluru, Karnataka, India Infosys Full time ₹ 8,00,000 - ₹ 24,00,000 per yearBigdata specialist programmer• Primary skills:Technology->Functional Programming->Scala • Knowledge of more than one technology • Basics of Architecture and Design fundamentals • Knowledge of Testing tools • Knowledge of agile methodologies • Understanding of Project life cycle activities on development and maintenance projects • Understanding...