Azure Bigdata Specialist

1 day ago


Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year


Job Description

Overall, 4 to 8 years of experience in IT Industry.

Min 4 years of experience working on Data Engineering using Azure Databricks, Synapse, ADF/Airflow.

At least 3 Project experience in Building and maintaining ETL / ELT pipelines for large data sets, complex data processing, transformations, business logics, cost monitoring & performance optimization, and feature engineering processes.

Must Have skills:

Extensive experience with Azure Databricks (ADB), Delta Lake, Azure Data Lake Storage (ADLS), Azure Data factory (ADF), Azure SQL Database (SQL DB), SQL, ELT / ETL Pipeline Development in Spark based environment.

Extensive Experience with SparkCore, PySpark, Python, SparkSQL, Scala, Azure Blob Storage.

Experience in Real-Time Data Processing using Apache Kafka/EventHub/IoT, Structured Streaming and Stream analytics.

Experience with Apache Airflow for ELT Orchestration.

Experience with infrastructure management, Infrastructure as code (e.g. Terraform)

Experience with CI/CD, Version control tools like GitHub, Azure DevOps.

Experience with Version control tools, building CI/CD pipelines.

Experience with Azure cloud platform.

Good to have:

Experience / Knowledge on Containerizations - Docker, Kubernetes

Experience working in Agile Methodology

Qualifications

Qualifications - BE, MS, M.Tech or MCA

Additional Information

Certifications: Azure Big Data, Databricks Certified Associate




  • Bengaluru, Karnataka, India Encycdata Full time ₹ 20,00,000 - ₹ 50,00,000 per year

    We're seeking Azure IoT DevOps Specialist(Freelancer) to lead the architecture, development, and operational excellence of our next-generation industrial Internet of Things (IIoT) solutions. This is a senior-level role demanding deep technical expertise in both Azure IoT services and advanced DevOps practices, with a focus on scalability, security, and...


  • Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job DescriptionExperience: 9-14 yearsContract: 3-6 months + extendable Location: Bangalore / Hyderabad / Pune / Chennai (Any Brillio office) | Remote will also workADO Integrations/API Developer specialistKey ResponsibilitiesDiscover and assess the current CI/CD pipeline configurations, deployments, and integration readiness across different technology...

  • Azure Kubernetes

    21 hours ago


    Bengaluru, Karnataka, India Landmark Group Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Summary:We are seeking an experienced and knowledgeable Azure Kubernetes Expert to join our dynamicteam with 5-6 years of experience in managing and maintaining Kubernetes. The ideal candidatewill have a deep understanding of Azure services and extensive expertise in designing,implementing, and managing Kubernetes clusters within the Azure environment....

  • Azure Cloud Engineer

    22 hours ago


    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Skill Azure CloudAzure DevOpsDesigning and Implementing in Cloud AzureAzure services and featuresCloud SecurityIdentity Management PracticesData ProtectionSentinelJob Description:We are seeking a highly skilled Technical Specialist to join our team. As a Technical Specialist, you will be responsible for designing, implementing, and maintaining cloud-based...

  • Azure AD Specialist

    2 weeks ago


    Bengaluru, Karnataka, India Persistent Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About Position:We are seeking a skilled and proactive Active Directory & Entra ID Administrator to join our IT infrastructure team. This role is critical in ensuring the reliability, security, and performance of our identity and access management systems across both on-premises and cloud environments. You will be responsible for managing and optimizing...


  • Bengaluru, Karnataka, India Peoplelogic Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Responsibilities Will work as an Individual contributor on Big Data Migration Project to Lakehouse migration project.Perform tasks related to migrating & testing applications on Snowflake, Snowpark, Apache Spark, Hive , on new retail banking data Lakehouse.Good to have knowledge on DBT.Perform extensive testing of the migrated code, debugging & fixing...

  • Hybrid Azure

    3 days ago


    Bengaluru, Karnataka, India Gainwell Technologies Full time ₹ 10,00,000 - ₹ 20,00,000 per year

    Gainwell Technologies LLCSummaryThe Hybrid Azure & AWS Engineer is responsible for designing, building, and maintaining both Azure and AWS infrastructure that powers product demo environments. This engineer leverages infrastructure automation (Terraform/Bicep/CloudFormation), and GenAI services across both clouds to deliver highly reliable, reproducible, and...


  • Bengaluru, Karnataka, India Amicon Hub Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Compliance & Backup Governance SpecialistJoin our team to supportcompliance, governance, and backup operationsacrossAzureandRubrikenvironments for a high-impact project with Teck.Key ResponsibilitiesDevelop & manage compliance alignment matrix (GDPR, SOX, etc.)Create & enforce Backup & Retention PolicyEnable audit trails and compliance reporting in Azure &...


  • Bengaluru, Karnataka, India AT&T Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description:Role – Senior Specialist Cybersecurity – Azure Systems AdministrationLocation: Hyderabad / BengaluruAbout the Company:Join AT&T and reimagine the communications and technologies that connect the world. Our Chief Security Office ensures that our assets are safeguarded through truthful transparency, enforce accountability and master...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India SWITS DIGITAL Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description: Azure Data EngineerLocations:Pan indiaExperience:5–8 YearsJob OverviewWe are looking for ahands-on Azure Data Engineer / Integration Specialistwith experience inAzure Databricks, Logic Apps, Data Lake, and Data Factory. The candidate will design, develop, and managedata integration pipelines, ETL/ELT processes, and workflow automationon...