Azure Data Engineer(Databricks, Datafactory)

2 weeks ago

Bengaluru, Karnataka, India Tata Consultancy Services Full time

Azure Data Engineer

Primary Skills: SQL(Azure), Data Vault, Azure Data Factory, Blob Storage, Azure Synapse, Pipelines, Delta Lake,Databricks

Secondary Skills: Python, Apache Spark, MS Fabric (Trained Knowledge or experience), Power BI

  • Proficiency in SQL and Python. SQL being far more important.
  • Experience with Apache Spark for data processing (Python version)
  • Understanding of Delta files and Lakehouse architecture
  • Data warehouse basic knowledge or experience
  • Hands-on skills (even gotten only by training) are essential for effectively using Microsoft Fabric.
  • Practical experience in setting up end-to-end analytics, managing Lakehouse and Medallion Architecture, using Apache Spark and Delta Lake tables, handling data ingestion with Dataflows Gen2, creating pipelines with Data Factory, and setting up data warehouses is crucial.
  • Understand the capabilities of Microsoft Fabric for complete analytics solutions, including data ingestion, transformation, storage, and visualization.
  • Familiarity with features such as Direct Lake access for Power BI reports, is important.
  • Utilize Apache Spark for large-scale data processing and work with Delta Lake tables for advanced data analytics.
  • Ingest data using Dataflows Gen2 and create pipelines with Data Factory capabilities for multi-step data ingestion and transformation tasks.
  • Set up and query data warehouses in Microsoft Fabric, integrating them with other analytics components.
  • Learn how to secure a Microsoft Fabric data warehouse and administer the platform effectively.

  • Azure Databricks Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Azure Databricks Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Azure Databricks Data Engineer

    1 day ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • - Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Skan ai Full time

    Job Summary :We are seeking a skilled Data Engineer with 3 to 5 years of experience in building scalable data pipelines and solutions, with strong hands-on expertise in Databricks. The ideal candidate should be proficient in working with large-scale data processing frameworks and have a solid understanding of Delta Lake, PySpark, and cloud-based data...

  • Data Engineer – Azure Databricks

    1 day ago

    Bengaluru, Karnataka, India TuTeck Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Summary:We are seeking a skilled and motivatedData Engineerwith hands-on experience inAzure Databricks,PySpark, and cloud-based data solutions. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions that support business decision-making and digital transformation initiatives.Key...

  • Leading Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    As a seasoned Data Engineer, you will be responsible for designing and developing scalable data architectures that support our business needs.The ideal candidate will have experience working with big data technologies, including Python, PySpark, SQL, and machine learning libraries.Develop and implement data pipelines to ensure seamless integration of data...

  • Data Architect with Azure, Databricks

    2 weeks ago

    Bengaluru, Karnataka, India Tech Mahindra Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job SummaryWe are seeking a skilled Data Solution Architect to design Solution and Lead the implementation on Azure + Databricks & MS Fabric. The ideal candidate will possess extensive experience in data Architecting, Solution design and data management practices. Experience: years Responsibilities: Architect end-to-end modern data platforms on Azure,...

  • azure databricks

    3 weeks ago

    Bengaluru, Karnataka, India Response Informatics Full time

    Alteryx, Databricks and Azure Data Engineering. Secondary skill: Python

  • Azure Databricks

    1 week ago

    Bengaluru, Karnataka, India Apex One Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Power Bi and AAS expert (Strong SC or Specialist Senior)Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis ServiceShould be able to write and test Dex queries.Should be able generate Paginated Reports in Power BIShould have minimum 3 Years working experience in delivering projects in Power BiMust Have:-3 to 8...

  • AZURE DATABRICKS

    2 weeks ago

    Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    AZURE DATABRICKS (7-17 YEARS), IMMEDIATE TO 60 DAYS JOINER, BANGALORE LOCATIONHiring for 1 of BIG4,Immediate to 60 days Joiner,Data Bricks AM Level (7-10 Years)Data Bricks Manager Level Years)D esigning and developing scalable data pipelines and ETL processes using Azure Databricks and PySpark , optimizing data workflows, ensuring data quality, collaborating...