Azure Data Engineer

2 weeks ago

Bengaluru Vishwavidyalaya Bengaluru Karnataka, India Hexience Systems Limited Full time ₹ 56,000 - ₹ 19,42,973 per year

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL/ELT processes using Azure Databricks and other Azure services such as Azure Data Factory and Azure Data Lake Storage.
  • Collaborate closely with user teams, data scientists, business analysts, and other stakeholders to understand data needs and translate them into effective technical solutions and use cases.
  • Implement data integration, transformation, and validation pipelines to support analytics and reporting.
  • Develop data models and data warehouses or lakes that support specific user use cases.
  • Manage and configure Databricks workspaces, clusters, jobs, and data access controls (such as Unity Catalog).
  • Automate data pipeline, deployment, scaling, and monitoring of data solutions using scripting and cloud-native tools.
  • Document technical designs, processes, and solutions for knowledge sharing.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Solid experience as a Data Engineer, particularly with Azure Databricks.
  • Proficiency in SQL, PySpark, Python, and ETL tools.
  • Knowledge of data warehousing, big data technologies, and data modeling concepts.
  • Familiarity with Azure cloud service. Experience with Databricks features such as Delta Lake, Spark SQL, cluster management, and performance tuning.
  • Experience with data governance, compliance, and security best practices.

Examples of Specific Use Case Support

  • Designing and deploying scalable analytics pipelines that handle streaming and batch data.
  • Providing onboarding and technical support for new data-driven user cases.
  • Using tools like Power BI to visualize insights derived from processed data.

Job Type: Full-time

Pay: ₹560, ₹1,942,973.83 per year

  • Azure Data Engineer

    1 week ago

    Bengaluru, Karnataka, India DigitalCube Consultancy Full time

    **Azure Data Engineer** **Job Type - Full time** **Location - Bangalore/ Mumbai, India** **Responsibilities**: - Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services. - Utilize Databricks for big data analytics and real-time data processing, ensuring optimal performance and...

  • Azure Data Architect

    2 days ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure Data Architect to join our team in Bangalore, Karntaka (IN-KA), India (IN). Azure - Architect Job...

  • Azure Vm

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 336431 We are currently seeking a Azure VM to join our team in Bengaluru, Karnātaka (IN-KA), India (IN). Azure VM, Citrix, VMware, NetScaler, App-V, AppDNA, Windows endpoint - Systems Engineer FMRJP00035387 - Systems Engineer 2 (3-5 Years) The Skills that are Key to this role Azure Virtual Machines, Azure Virtual Desktop (AVD) Hosting and...

  • Azure Architect

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 268002 We are currently seeking a Azure Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). **Total years of Exp - 10 - 15 yrs** **Relevant years of Exp. - 10 - 15 yrs** **Notice Period - Immediate - 30 Days** **Location - Whitefield, Bangalore (3 Days WFO)** **Enterprise Architect (10-15 years experience)** -...

  • Azure Data Engineer

    2 days ago

    Bengaluru, Karnataka, India KPMG Assurance and Consulting Services LLP Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title: Azure Data EngineerLocation:BangaloreJob Type: [Full-time / Contract / Remote / Hybrid]Experience: 5yrs-13yrsJob Summary:We are seeking a skilled Azure Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Azure Data Factory, Azure Data Lake, and Azure Databricks, and a strong understanding of data...

  • Azure Data Engineer

    5 hours ago

    Bengaluru, India KPMG Assurance and Consulting Services LLP Full time

    Job Title: Azure Data Engineer Location:BangaloreJob Type: (Full-time / Contract / Remote / Hybrid)Experience: 5yrs-13yrs Job Summary: We are seeking a skilled Azure Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Azure Data Factory, Azure Data Lake, and Azure Databricks, and a strong understanding of...

  • Azure Lead Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 248733NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Azure Lead Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Preferred Experience ...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India 3K SOFTECH PRIVATE LIMITED Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Technical Skills :Azure Data Services : In-depth experience with Azure Data Factory, Azure Databricks, and other Azure data solutions like Azure Synapse, Azure Blob Storage, Azure SQL Database, etc. Big Data Technologies : Strong proficiency in Apache Spark and PySpark for processing large datasets, with hands-on experience in optimizing Spark jobs. ...

  • Azure Data Engineer

    1 week ago

    Bengaluru East, Karnataka, India Elanco Full time ₹ 7,00,000 - ₹ 12,00,000 per year

    At Elanco (NYSE: ELAN) – it all starts with animalsAs a global leader in animal health, we are dedicated to innovation and delivering products and services to prevent and treat disease in farm animals and pets. We're driven by our vision of 'Food and Companionship Enriching Life' and our approach to sustainability – the Elanco Healthy Purpose – to...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Infogain Full time

    Posted on October 24 2024ROLES RESPONSIBILITIESCore Skills- Mastery of Azure data services such as Azure SQL Database Azure Cosmos DB and Azure Data Lake Storage - Deep expertise in ETL Extract Transform Load processes and data integration - Advanced SQL and database querying optimization skills - Experience in leading and managing data...