Azure Data Engineer(Databricks, Datafactory)

4 weeks ago

Pune, Maharashtra, India Tata Consultancy Services Full time

Azure Data Engineer

Primary Skills: SQL(Azure), Data Vault, Azure Data Factory, Blob Storage, Azure Synapse, Pipelines, Delta Lake,Databricks

Secondary Skills: Python, Apache Spark, MS Fabric (Trained Knowledge or experience), Power BI

  • Proficiency in SQL and Python. SQL being far more important.
  • Experience with Apache Spark for data processing (Python version)
  • Understanding of Delta files and Lakehouse architecture
  • Data warehouse basic knowledge or experience
  • Hands-on skills (even gotten only by training) are essential for effectively using Microsoft Fabric.
  • Practical experience in setting up end-to-end analytics, managing Lakehouse and Medallion Architecture, using Apache Spark and Delta Lake tables, handling data ingestion with Dataflows Gen2, creating pipelines with Data Factory, and setting up data warehouses is crucial.
  • Understand the capabilities of Microsoft Fabric for complete analytics solutions, including data ingestion, transformation, storage, and visualization.
  • Familiarity with features such as Direct Lake access for Power BI reports, is important.
  • Utilize Apache Spark for large-scale data processing and work with Delta Lake tables for advanced data analytics.
  • Ingest data using Dataflows Gen2 and create pipelines with Data Factory capabilities for multi-step data ingestion and transformation tasks.
  • Set up and query data warehouses in Microsoft Fabric, integrating them with other analytics components.
  • Learn how to secure a Microsoft Fabric data warehouse and administer the platform effectively.

  • Azure Data Engineer(Databricks, Datafactory)

    1 day ago

    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Azure Data EngineerPrimary Skills: SQL(Azure), Data Vault, Azure Data Factory, Blob Storage, Azure Synapse, Pipelines, Delta Lake,DatabricksSecondary Skills: Python, Apache Spark, MS Fabric (Trained Knowledge or experience), Power BIProficiency in SQL and Python. SQL being far more important.Experience with Apache Spark for data processing (Python...

  • Azure Databricks Engineer

    5 days ago

    Pune, Maharashtra, India Savi Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Opening: Azure Databricks EngineerLocation: Pune, Maharashtra (Onsite)Experience Range: 45 YearsApply at: -Required Skills:Azure Data Factory (ADF)PySparkAzure Databricks (ADB)SQLJob Description:We're looking for an experienced Azure Databricks Engineer with a background in financial crime analytics and hands-on expertise in:Databricks engineering &...

  • Azure DataBricks Engineer

    1 week ago

    Pune, Maharashtra, India Wipro Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role OverviewWe are looking for a seasoned Azure Data Engineer with strong experience in building and optimizing data pipelines, preferably on Azure. The candidate should be proficient in Databricks, Spark, and Python, and capable of designing scalable data solutions for big data analytics.Key ResponsibilitiesDesign, develop, and maintain ETL pipelines using...

  • Azure Databricks Engineer

    1 week ago

    Pune, Maharashtra, India Symphoni Hr Full time ₹ 6,00,000 - ₹ 24,00,000 per year

    Locations:Pune, Maharashtra, IndiaMinimum Experience:6ctc 6+ upto 24 lacSkill Set:Databricks Engineer, Azure Databricks, SQL, PythonSkill to Evaluate:Databricks Engineer, Azure Databricks, SQL,Pyspark, Python, Team HandlingExperience:8 to 14 YearsLocation:Pune, Maharashtra, IndiaJob Description:Job Title: Senior Data EngineerKey Responsibilities:- Design,...

  • Azure Databricks Engineer

    1 week ago

    Pune, Maharashtra, India Symphoni Hr Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Locations:Pune, Maharashtra, IndiaMinimum Experience:5Maximum Experience:12ctc lac lac maxSkill Set:Databricks Engineer, Azure Databricks, SQL, PysparkSkill to Evaluate:Databricks Engineer, Azure Databricks, SQLExperience:5 to 12 YearsLocation:Pune, Maharashtra, IndiaJob Description:Job Title: Senior Data EngineerKey Responsibilities:- Design, build, and...

  • Senior Azure Databricks Engineer

    13 hours ago

    Pune, Maharashtra, India T&N Business Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We seeking a talented and motivated senior Azure Data Engineer. The role will be responsible for developing solutions for risk, regulatory, and compliance projects on AzureRole :Senior Azure Databricks EngineerExp :8 to 12 yrsLocation :Pune/IndoreNotice Period:Immediate to 30 DaysMust-have skills :Azure Databricks heavyYou will play a key role in...

  • Senior Azure Databricks Engineer

    1 week ago

    Pune, Maharashtra, India TN BUSINESS SERVICES PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About the job : We seeking a talented and motivated senior Azure Data Engineer. The role will be responsible for developing solutions for risk, regulatory, and compliance projects on AzureRole : Senior Azure Databricks EngineerExp : 8 to 12 yrsLocation : Pune/IndoreNotice Period : Immediate to 30 DaysMust-have skills : Azure Databricks heavy You will...

  • Python Data Engineer with Azure Databricks

    7 days ago

    Pune, Maharashtra, India Pyramid It Consulting Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Role & responsibilitiesPython Data Engineer with Strong AZURE Databricks, and SQL

  • Azure Data Engineer

    1 week ago

    Pune, Maharashtra, India Saxon AI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role – Azure Data EngineerRelevant Experience – 6 to 8 YearsJob Description – We are seeking a highly skilled and experienced Azure Data Engineer with expertise in Azure Data Platforms to join our dynamic and innovative technology team. As a Data Engineer, you will play a pivotal role in designing, developing, and implementing robust and scalable...

  • Azure Data Engineer

    1 week ago

    Pune, Maharashtra, India Nam Info Full time US$ 1,50,000 - US$ 2,00,000 per year

    Greetings from NAM InfoPlease go through the job description. If you are interested in this opportunity, please reply with the following information to -Full Name (as in Adhar):Current Location:Expected CTC:Present CTC:Least Notice Period(Last Working Day If any):PAN Number:Job Title: Azure Data EngineerCompany: Thermax LimitedLocation: Pune Job Type:...