Azure Bigdata Specialist
1 day ago
Job Description
Overall, 4 to 8 years of experience in IT Industry.
Min 4 years of experience working on Data Engineering using Azure Databricks, Synapse, ADF/Airflow.
At least 3 Project experience in Building and maintaining ETL / ELT pipelines for large data sets, complex data processing, transformations, business logics, cost monitoring & performance optimization, and feature engineering processes.
Must Have skills:
Extensive experience with Azure Databricks (ADB), Delta Lake, Azure Data Lake Storage (ADLS), Azure Data factory (ADF), Azure SQL Database (SQL DB), SQL, ELT / ETL Pipeline Development in Spark based environment.
Extensive Experience with SparkCore, PySpark, Python, SparkSQL, Scala, Azure Blob Storage.
Experience in Real-Time Data Processing using Apache Kafka/EventHub/IoT, Structured Streaming and Stream analytics.
Experience with Apache Airflow for ELT Orchestration.
Experience with infrastructure management, Infrastructure as code (e.g. Terraform)
Experience with CI/CD, Version control tools like GitHub, Azure DevOps.
Experience with Version control tools, building CI/CD pipelines.
Experience with Azure cloud platform.
Good to have:
Experience / Knowledge on Containerizations - Docker, Kubernetes
Experience working in Agile Methodology
Qualifications
Qualifications - BE, MS, M.Tech or MCA
Additional Information
Certifications: Azure Big Data, Databricks Certified Associate
-
Azure IoT DevOps Specialist
4 days ago
Bengaluru, Karnataka, India Encycdata Full time ₹ 20,00,000 - ₹ 50,00,000 per yearWe're seeking Azure IoT DevOps Specialist(Freelancer) to lead the architecture, development, and operational excellence of our next-generation industrial Internet of Things (IIoT) solutions. This is a senior-level role demanding deep technical expertise in both Azure IoT services and advanced DevOps practices, with a focus on scalability, security, and...
-
Azure API Integrations specialist
1 day ago
Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob DescriptionExperience: 9-14 yearsContract: 3-6 months + extendable Location: Bangalore / Hyderabad / Pune / Chennai (Any Brillio office) | Remote will also workADO Integrations/API Developer specialistKey ResponsibilitiesDiscover and assess the current CI/CD pipeline configurations, deployments, and integration readiness across different technology...
-
Azure Kubernetes
21 hours ago
Bengaluru, Karnataka, India Landmark Group Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Summary:We are seeking an experienced and knowledgeable Azure Kubernetes Expert to join our dynamicteam with 5-6 years of experience in managing and maintaining Kubernetes. The ideal candidatewill have a deep understanding of Azure services and extensive expertise in designing,implementing, and managing Kubernetes clusters within the Azure environment....
-
Azure Cloud Engineer
22 hours ago
Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 20,00,000 - ₹ 25,00,000 per yearSkill Azure CloudAzure DevOpsDesigning and Implementing in Cloud AzureAzure services and featuresCloud SecurityIdentity Management PracticesData ProtectionSentinelJob Description:We are seeking a highly skilled Technical Specialist to join our team. As a Technical Specialist, you will be responsible for designing, implementing, and maintaining cloud-based...
-
Azure AD Specialist
2 weeks ago
Bengaluru, Karnataka, India Persistent Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAbout Position:We are seeking a skilled and proactive Active Directory & Entra ID Administrator to join our IT infrastructure team. This role is critical in ensuring the reliability, security, and performance of our identity and access management systems across both on-premises and cloud environments. You will be responsible for managing and optimizing...
-
Specialist Software Engineer – Bigdata
4 days ago
Bengaluru, Karnataka, India Peoplelogic Full time ₹ 12,00,000 - ₹ 36,00,000 per yearResponsibilities Will work as an Individual contributor on Big Data Migration Project to Lakehouse migration project.Perform tasks related to migrating & testing applications on Snowflake, Snowpark, Apache Spark, Hive , on new retail banking data Lakehouse.Good to have knowledge on DBT.Perform extensive testing of the migrated code, debugging & fixing...
-
Hybrid Azure
3 days ago
Bengaluru, Karnataka, India Gainwell Technologies Full time ₹ 10,00,000 - ₹ 20,00,000 per yearGainwell Technologies LLCSummaryThe Hybrid Azure & AWS Engineer is responsible for designing, building, and maintaining both Azure and AWS infrastructure that powers product demo environments. This engineer leverages infrastructure automation (Terraform/Bicep/CloudFormation), and GenAI services across both clouds to deliver highly reliable, reproducible, and...
-
Azure Compliance Manager
1 day ago
Bengaluru, Karnataka, India Amicon Hub Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearCompliance & Backup Governance SpecialistJoin our team to supportcompliance, governance, and backup operationsacrossAzureandRubrikenvironments for a high-impact project with Teck.Key ResponsibilitiesDevelop & manage compliance alignment matrix (GDPR, SOX, etc.)Create & enforce Backup & Retention PolicyEnable audit trails and compliance reporting in Azure &...
-
Bengaluru, Karnataka, India AT&T Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description:Role – Senior Specialist Cybersecurity – Azure Systems AdministrationLocation: Hyderabad / BengaluruAbout the Company:Join AT&T and reimagine the communications and technologies that connect the world. Our Chief Security Office ensures that our assets are safeguarded through truthful transparency, enforce accountability and master...
-
Azure Data Engineer
1 week ago
Bengaluru, Karnataka, India SWITS DIGITAL Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Description: Azure Data EngineerLocations:Pan indiaExperience:5–8 YearsJob OverviewWe are looking for ahands-on Azure Data Engineer / Integration Specialistwith experience inAzure Databricks, Logic Apps, Data Lake, and Data Factory. The candidate will design, develop, and managedata integration pipelines, ETL/ELT processes, and workflow automationon...