Azure Data Engineer

2 weeks ago

Anywhere in IndiaMultiple LocationsMumbaiBangaloreHyderabadKolkataChennaiPuneBhubaneshwarNa Talpro Full time

Azure Data Engineer Job Description

Talpro is seeking a skilled and experienced Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines and architectures on the Azure Modern Data Warehouse platform.

Responsibilities:


  • Data Curation and Transformation: Translate business requirements into technical solutions for data curation and transformation, specifically using Databricks Lakehouse from a modeling and ELT perspective.
  • Azure Data Engineering: Develop data pipelines and orchestration using Azure Data Factory and other Azure Modern Data Warehouse platform components.
  • SQL and Pyspark: Utilize SQL programming and Pyspark for data manipulation and processing tasks.
  • Azure Services: Work with Azure services such as ADLS (Azure Data Lake Storage), ADX (Azure Data Explorer), and Databricks.
  • Data Migration: Experience in SQL Server migration to the cloud and handling structured and unstructured datasets.
  • DevOps and CI/CD: Good knowledge of DevOps tools and processes, and experience in automating data pipelines through a CI/CD delivery methodology.
  • Databricks Expertise: In-depth hands-on implementation knowledge on Azure Databricks, Databricks Delta Lake, and managing Delta Tables.
  • Data Modeling: Understand and implement data modeling for the data lake.
  • Data Transfer and Oracle PL/SQL: Hands-on experience in using secure file transfer tools like Kiteworks, and Oracle PL/SQL knowledge will be a plus.
  • Effort Estimation: Provide effort estimation for new projects related to data engineering.
  • Complex Design and Agile Environment: Drive complex design and development efforts in an agile environment.

Qualifications:


  • Minimum of 5-7 years of experience working on Azure and Databricks \"Lakehouse\" implementation.
  • Strong experience in ADF (Azure Data Factory) and SQL as primary skills.
  • Familiarity with Informatica PWC and Oracle PL/SQL.
  • Experience in SQL programming and Pyspark.
  • 2 or more years of experience as a Data Engineer, specifically in the Azure Modern Data Warehouse platform.
  • Good understanding of data modeling and data lake concepts.
  • Expertise in Databricks, ADLS, ADX, and other Azure services.
  • Prior experience in SQL Server migration to the cloud.
  • Knowledge of DevOps tools and processes.

  • Azure Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations/Mumbai/Bangalore/Hyderabad/Kolkata/Chennai/Pune/Bhubaneshwar/Na Talpro Full time

    Job Title: Azure Data EngineerWe are seeking a highly skilled Azure Data Engineer to join our team at Talpro. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures on Azure.Key Responsibilities:Design and implement data pipelines using Azure Data Factory and...

  • Azure Data Engineer

    1 month ago

    Anywhere in India/Multiple Locations/Mumbai/Bangalore/Hyderabad/Kolkata/Chennai/Pune/Bhubaneshwar/Na, IN Talpro Full time

    Job Description : We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL....

  • Azure Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations Scaling Theory Technologies Pvt Ltd Full time

    Job Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at Scaling Theory Technologies Pvt Ltd. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement data pipelines using...

  • Azure Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations PureSoftware Pvt Ltd. Full time

    Azure Data Engineer RoleWe are seeking a highly skilled and experienced Azure Data Engineer to contribute to the success of PureSoftware Pvt Ltd.About the Role:The ideal candidate will have a strong background in designing, building, and maintaining large-scale data processing systems on Azure. They will be responsible for architecting and implementing data...

  • Azure Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations Scaling Theory Technologies Pvt Ltd Full time

    Job Title: Azure Data EngineerAt Scaling Theory Technologies Pvt Ltd, we are seeking an experienced Azure Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems on the Azure platform.Key Responsibilities:Design and implement data models and architectures using...

  • Azure Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations Naukari Wale Full time

    Job Title: Azure Data EngineerJob Summary:We are seeking an experienced Azure Data Engineer to join our team at Naukari Wale. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement data pipelines using Azure Data Factory, Azure Databricks,...

  • Azure Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations Racrosoft Technologies Full time

    About the JobWe are seeking a highly skilled Azure Data Engineer to join our team at Racrosoft Technologies. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines using Azure Data Factory (ADF), Databricks, and other Azure services.Key ResponsibilitiesDesign and develop data...

  • Azure Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations PureSoftware Pvt Ltd. Full time

    We are seeking a highly skilled and experienced Azure Data Engineer to drive the design, development, and implementation of our cloud-based data platforms. As a key member of our team, you will be responsible for architecting and delivering scalable, secure, and high-performance data solutions using Azure services such as Data Factory, Databricks, and...

  • Azure Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations Stratosphere IT Services PVT Ltd Full time

    Job DescriptionAzure Data EngineerWe are seeking a highly skilled Azure Data Engineer to join our team at Stratosphere IT Services PVT Ltd. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable and metadata-driven data ingestion pipelines using Azure Data Factory, PySpark, Databricks, and...

  • Azure Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations Racrosoft Technologies Full time

    About the JobWe are seeking a highly skilled Azure Data Engineer to join our team at Racrosoft Technologies. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines using Azure Data Factory (ADF), Databricks, and other Azure services.Key ResponsibilitiesDesign and develop data...

  • Azure Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations METHODHUB SOFTWARE PRIVATE LIMITED Full time

    Job Title: Azure Data EngineerJob Summary:We are seeking an experienced Azure Data Engineer to join our team at MethodHub Software Private Limited. The successful candidate will be responsible for designing, developing, and maintaining large-scale data pipelines using Azure services.Key Responsibilities:Developing data pipelines that process large volumes of...

  • Azure Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations Stratosphere IT Services PVT Ltd Full time

    Job Title : Big Data EngineerAzure Data EngineerOverview :We are seeking a highly skilled Big Data Engineer to join our team at Stratosphere IT Services PVT Ltd. As a Big Data Engineer, you will be responsible for designing, building, and maintaining scalable data ingestion pipelines, processing high-performance data, and harmonizing data from various...

  • Azure Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations METHODHUB SOFTWARE PRIVATE LIMITED Full time

    Job DescriptionWe are seeking a highly skilled Azure Data Engineer to join our team at MethodHub Software Private Limited.Key Responsibilities:Design, develop, and maintain large-scale data pipelines using Python, PySpark, and Pandas on Azure.Develop ETL, OLAP-based, and analytical applications to process and analyze complex data sets.Ingest batch and...

  • Azure Data Engineering Specialist

    3 weeks ago

    Anywhere in India/Multiple Locations estrel Full time

    Job Title: Azure Data EngineerJob Description:We are seeking a highly skilled Azure Data Engineer to join our team at Estrel. The ideal candidate will have 5-8 years of experience in the IT industry and a strong background in Azure Data Engineering Stack, including Event Hub, Data Factory, Cosmos DB, Synapse, SQL DB, Databricks, and Data Explorer.The...

  • Azure Data Engineering Lead

    7 days ago

    Anywhere in India/Multiple Locations Pyramid Consulting Full time

    Data Engineer with Azure Machine Learning ExpertiseAt Pyramid Consulting, we are seeking a highly skilled Data Engineer with expertise in Azure Machine Learning to join our team. In this role, you will design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Databricks.Key Responsibilities:Implement...

  • Azure Databricks Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations SAN Engineering Solutions Full time

    About the RoleWe are seeking a skilled Azure Databricks Engineer to join our dynamic team at SAN Engineering Solutions. The ideal candidate will have extensive experience in Azure services, particularly Databricks, and will be responsible for designing, developing, and maintaining data pipelines and ETL processes.Key ResponsibilitiesDesign and implement...

  • Azure Data Engineer Specialist

    2 weeks ago

    Anywhere in India/Multiple Locations Pyramid Consulting Full time

    Job Title: Azure Data EngineerData Engineering and Management:Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Databricks.Implement data warehousing solutions and ensure data quality and integrity across various data sources.Manage and optimize data storage solutions such as Azure Data Lake...

  • Senior Azure Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations Racrosoft Technologies Full time

    About the Opportunity:We are seeking a skilled Azure Data Engineer to join our team at Racrosoft Technologies. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines on Azure Cloud platforms.Responsibilities:Design, develop, and maintain data pipelines using Azure Data Factory...

  • Azure Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations Kudzu Infotech Full time

    Job Description:Kudzu Infotech is seeking a highly skilled Azure Data Engineer to join our team.The ideal candidate will have expertise in data warehouse/data lake development methodologies, including data modeling, ETL processes, and data integration techniques.Key Responsibilities:Design and implement data warehouse data models, including star schema,...

  • Azure Data Engineer Position

    2 weeks ago

    Anywhere in India/Multiple Locations estrel Full time

    Job Title: Cloud Data EngineerAt Estrel, we are looking for a skilled Cloud Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining large-scale data architectures on Azure.Responsibilities:Design and implement data pipelines using Azure Data Factory, Event Hub, and Cosmos DB.Develop and...