Azure Bigdata Specialist

2 days ago


Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year


Job Description

Overall, 4 to 8 years of experience in IT Industry.

Min 4 years of experience working on Data Engineering using Azure Databricks, Synapse, ADF/Airflow.

At least 3 Project experience in Building and maintaining ETL / ELT pipelines for large data sets, complex data processing, transformations, business logics, cost monitoring & performance optimization, and feature engineering processes.

Must Have skills:

Extensive experience with Azure Databricks (ADB), Delta Lake, Azure Data Lake Storage (ADLS), Azure Data factory (ADF), Azure SQL Database (SQL DB), SQL, ELT / ETL Pipeline Development in Spark based environment.

Extensive Experience with SparkCore, PySpark, Python, SparkSQL, Scala, Azure Blob Storage.

Experience in Real-Time Data Processing using Apache Kafka/EventHub/IoT, Structured Streaming and Stream analytics.

Experience with Apache Airflow for ELT Orchestration.

Experience with infrastructure management, Infrastructure as code (e.g. Terraform)

Experience with CI/CD, Version control tools like GitHub, Azure DevOps.

Experience with Version control tools, building CI/CD pipelines.

Experience with Azure cloud platform.

Good to have:

Experience / Knowledge on Containerizations - Docker, Kubernetes

Experience working in Agile Methodology

Qualifications

Qualifications - BE, MS, M.Tech or MCA

Additional Information

Certifications: Azure Big Data, Databricks Certified Associate




  • Bengaluru, Karnataka, India Capgemini Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Azure Integration Specialist We're Hiring Azure Integration Specialist, passionate about cloud integration and automation. with hands-on experience with Azure Logic Apps and API Management (APIM). Join our dynamic team as we build scalable, secure, and intelligent solutions using Microsoft Azure Role: Azure Integration Consultant Experience: 4...


  • Bengaluru, Karnataka, India SP Software Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Azure Cloud Migration Specialist Primary Skill Set:4+ years of exp in Azure engineering/migration, strong knowledge of Azure infra (VMs, Networking, Storage, Security), Hands-on experience with Azure Migrate, DMS, Azure Site Recovery and Terraform. Good to have Azure Solution Architect or Azure Administrator certification Total Experience : 6+...

  • Bigdata Developer

    1 week ago


    Bengaluru, Karnataka, India IQVIA Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Bigdata Developer PRINCIPAL ACCOUNTABILITIES Should be able to understand the application requirement. • Responsible for application design and development in Azure Databricks, Big data technologies(Scala, Spark, Hive). • Handle complete unit testing of the component or application. • Support testing and UAT phases and resolve issues...


  • Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionExperience: 9-14 yearsContract: 3-6 months + extendable Location: Bangalore / Hyderabad / Pune / Chennai (Any Brillio office) | Remote will also workADO Integrations/API Developer specialistKey ResponsibilitiesDiscover and assess the current CI/CD pipeline configurations, deployments, and integration readiness across different technology...


  • Bengaluru, Karnataka, India Encycdata Full time ₹ 20,00,000 - ₹ 50,00,000 per year

    We're seeking Azure IoT DevOps Specialist(Freelancer) to lead the architecture, development, and operational excellence of our next-generation industrial Internet of Things (IIoT) solutions. This is a senior-level role demanding deep technical expertise in both Azure IoT services and advanced DevOps practices, with a focus on scalability, security, and...

  • Azure Kubernetes

    1 day ago


    Bengaluru, Karnataka, India Landmark Group Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Summary:We are seeking an experienced and knowledgeable Azure Kubernetes Expert to join our dynamicteam with 5-6 years of experience in managing and maintaining Kubernetes. The ideal candidatewill have a deep understanding of Azure services and extensive expertise in designing,implementing, and managing Kubernetes clusters within the Azure environment....


  • Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Skill Azure CloudAzure DevOpsDesigning and Implementing in Cloud AzureAzure services and featuresCloud SecurityIdentity Management PracticesData ProtectionSentinelJob Description:We are seeking a highly skilled Technical Specialist to join our team. As a Technical Specialist, you will be responsible for designing, implementing, and maintaining cloud-based...

  • Azure AD Specialist

    2 weeks ago


    Bengaluru, Karnataka, India Persistent Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About Position:We are seeking a skilled and proactive Active Directory & Entra ID Administrator to join our IT infrastructure team. This role is critical in ensuring the reliability, security, and performance of our identity and access management systems across both on-premises and cloud environments. You will be responsible for managing and optimizing...


  • Bengaluru, Karnataka, India SWITS DIGITAL Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description: Software Quality Engineer – ETL / Data Testing (Azure & SAP HANA)Experience Required:6+ yearsLocation:BangaloreRole SummaryWe are seeking an experiencedSoftware Quality Engineer / ETL Testing Specialistto work closely with business and delivery teams to execute test strategies and ensure high-quality data solutions. The candidate will be...


  • Bengaluru, Karnataka, India Infosys Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Bigdata specialist programmer• Primary skills:Technology->Functional Programming->Scala • Knowledge of more than one technology • Basics of Architecture and Design fundamentals • Knowledge of Testing tools • Knowledge of agile methodologies • Understanding of Project life cycle activities on development and maintenance projects • Understanding...