Azure Big Data Specialist

2 days ago

Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year


Job Description:

Responsibilities:

Overall 7 8 years of experience with a minimum 5+ years of relevant professional work experience

  • Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
  • Work together with data analysts to understand the needs for data and create effective data workflows.
  • Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake
  • Utilizing Azure Data Factory to create and maintain ETL (Extract, Transform, Load) operations using ADF pipelines.
  • Hands-On Experience working on Data Bricks for implementing Transformations and Delta Lake
  • Hands-On Experience working on Serverless SQL Pool, Dedicated SQL Pool
  • Use ADF pipelines to orchestrate the end to end data transformation including the execution of DataBricks notebooks.
  • Should have experience working on Medallion Architecture
  • Experience working on CI/CD pipelines using Azure DevOps
  • Attaching both ADF and ADB to DevOps
  • Creating and managing Azure infrastructure across the landscape using Bicep
  • Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
  • Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
  • Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data.
  • Good to have exposure on Power BI, Power Automate
  • Good to have knowledge on Azure fundamentals
Desirable skills
  • Good ability to anticipate issues and formulate remedial actions
  • Sound interpersonal and team working skills
  • Sound Knowledge of unit testing methodologies and frameworks
  • Should be able to work independently
  • Good communication skills

  • Big Data Engineer – Azure

    2 days ago

    Bengaluru, Karnataka, India Innova ESI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineer – AzureExperience: 10+ YearsLocation: BangaloreImmediate Joiners OnlyBig Data :Mandatory Skills:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, experience in IT industry, including 5 years in...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data EngineerExperience: 7+ YearsLocation: BangaloreNotice: Immediate Joiners OnlyJob Description:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, 12 years of experience in IT industry, including 5 years in...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.

  • Azure Data Engineer

    1 week ago

    Bengaluru, Karnataka, India SWITS DIGITAL Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description: Azure Data EngineerLocations:Pan indiaExperience:5–8 YearsJob OverviewWe are looking for ahands-on Azure Data Engineer / Integration Specialistwith experience inAzure Databricks, Logic Apps, Data Lake, and Data Factory. The candidate will design, develop, and managedata integration pipelines, ETL/ELT processes, and workflow automationon...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Xebia Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Job Title : Big Data Developer - Spark/ScalaJob location : BengaluruNotice Period : immediate - 15 daysPosition Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud ..Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, OozieBig Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Azure Data Specialist

    2 days ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Education and Work Experience Requirements:· Overall, 5 to 9 years of experience in IT Industry. Min 6 years of experience working on DataEngineering - Solution Architecture.· Design and develop Power BI solutions, ensuring data visualization best practices.· Develop Python-based automation scripts to optimize workflows and processes.· Define...

  • Azure Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Flexability Hr Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Role & responsibilitiesPreferred candidate profileBachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 5 years work experience).At least 2+ years of consulting or client service delivery experience on AzureAt least 2+ years of experience in developing data ingestion, data processing and analytical pipelines for big...

  • Azure Data Engineer

    2 days ago

    Bengaluru, Karnataka, India BSR & Co Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    DescriptionMandatory SkillsBachelor's or higher degree in Computer Science or a related discipline; or equivalent (minimum 4+ years work experience). At least 3+ years of consulting or client service delivery experience on Azure Microsoft data engineering.At least 1+ years of experience in developing data ingestion, data processing and analytical pipelines...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India 9934de03-039b-4729-b375-69ab7aba7f96 Full time ₹ 5,56,000 - ₹ 19,43,725 per year

    Job SummaryWe are seeking a skilled and experienced Data Engineer with strong expertise in Azure Databricks, Spark/PySpark, and Big Data technologies. The ideal candidate will design, develop, and optimize scalable data pipelines while ensuring performance, reliability, and data quality across large datasets. This role requires strong technical capability...

  • Big Data Specialist

    1 week ago

    Bengaluru, Karnataka, India Themesoft Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Greetings from ThemesoftWe are looking forJava Developers with Big Data Expertiseexperienced in real-time and batch data processing for exciting opportunities in a high-impact project.Notice Period: Immediate Joiners onlyExperience: Minimum 5+ yearsPosition: ContractOpen Roles:Java + Spark StreamingJava + Apache FlinkJava + Spark BatchIf anyone interested,...