Azure Data Engineer

5 days ago

India BlitzenX Full time

About the job : Azure Data Engineer - Strong Azure engineering skills, Strong Azure knowledge ADF, ADLS, databricks, pyspark, delta tables, Synapse, python We are seeking a highly skilled Azure Data Engineer to design, build, and maintain robust data pipelines using a comprehensive suite of Azure services including ADF, ADLS, Databricks, Synapse, and more. This role requires a strong understanding of data engineering principles, proficient Python coding skills, and expertise in utilizing Azure data tools to efficiently manage large datasets. Key Responsibilities : Data Pipeline Development : - Design, develop, and implement scalable data pipelines using Azure Data Factory (ADF) to ingest, transform, and load data from diverse sources into data warehouses and data lakes. Azure Databricks Expertise : - Leverage Databricks platform to build and optimize complex data processing workflows using PySpark, including data cleaning, feature engineering, and data transformation. Delta Lake Management : - Utilize Delta Lake on Databricks to manage large-scale data sets with efficient data versioning and time travel capabilities. Data Lake Storage (ADLS) : - Design and manage data storage architecture on ADLS, ensuring optimal data organization and accessibility for downstream applications. Azure Synapse Analytics : - Utilize Synapse pipelines and Spark pools for data integration and complex data analysis tasks. Data Quality Assurance : - Implement robust data quality checks and monitoring mechanisms to ensure data accuracy and integrity throughout the pipeline. Collaboration : - Work closely with cross-functional teams including data analysts, business analysts, and application developers to understand data requirements and deliver data solutions that align with business objectives. Performance Optimization : - Continuously monitor and optimize data pipeline performance to ensure scalability and efficient data processing. Required Skills And Experience : Strong Azure Expertise : - Proven experience in designing and implementing data solutions using a wide range of Azure data services, including ADF, ADLS, Databricks, Synapse, and Azure Cosmos DB. Programming Proficiency : - Excellent proficiency in Python programming with a strong understanding of data manipulation libraries like Pandas and NumPy. Spark Development : - Extensive experience with Apache Spark (PySpark) for large-scale data processing and distributed computing. Delta Lake Knowledge : - Familiarity with Delta Lake format for data lake management and data versioning. Data Modeling : - Ability to design and implement data models for data warehouses and data lakes, considering data quality and performance considerations. Cloud Architecture : - Understanding of cloud computing concepts, distributed systems, and best practices for building scalable cloud-based data pipelines. Problem-Solving : - Strong analytical skills to troubleshoot data issues and optimize pipeline performance. Communication Skills : - Effective communication to collaborate with stakeholders and clearly articulate technical concepts. Preferred Qualifications : - Azure Data Engineer Associate certification - Experience with data visualization tools like Power BI or Tableau - Knowledge of data governance practices and data security principles - Experience with DevOps practices for data pipeline automation and deployment Mandatory Skills : Strong Azure knowledge - ADF, ADLS, databricks, pyspark, delta tables, synapse, python Nice to have skills : Azure devops, CI CD, Other hyperscalers (AWS, GCP) (ref:hirist.tech)

  • Azure Data Engineer

    5 days ago

    India Recmatrix Consulting Pvt Ltd Full time

    Job Title : Azure Data Engineer | Senior Data Engineer | Technical Lead Location : Bangalore (Whitefield) / Hyderabad (Knowledge City) / Pune Working Model : Hybrid No. of Positions : 20 Experience : 3 to 9 years in Cloud Data Engineering Primary Skills : Azure Databricks, PySpark, SQL Secondary Skills : Azure Data Factory (ADF) Notice Period : Immediate to...

  • Azure Data Engineer

    5 days ago

    India Cygnus Technologies Full time

    Job Title : Azure Data Engineer Location : Pan India (Hybrid Work Mode) Employment Type : Full-Time Experience : 6-8 years - Data Engineer to join our dynamic team and contribute to our data-driven initiatives. Job Summary : As an Azure Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and solutions. You...

  • Azure Data Engineer

    6 days ago

    India HNM Solutions Full time

    Role : Azure Data Engineer Location : Remote (work from home) Experience : 3 years NOTE : Immediate joiner Job Description : Role : Azure Data Engineer Job Summary : We're looking for a talented Azure Data Engineer to solve complex data challenges for our clients using Microsoft Fabric. You will collaborate with project teams to deliver innovative data...

  • Azure Data Engineer

    5 days ago

    India Tek Ninjas Full time

    Azure Data Engineer Palantir Job Description : We are seeking a skilled Azure Data Engineer with expertise in Palantir to join our team. The ideal candidate should have strong data engineering experience along with hands-on proficiency in Palantir Foundry. Key Responsibilities : - Develop and manage data pipelines using Python, SQL, PySpark, Azure...

  • Azure Data Engineer

    6 days ago

    India VERTISCRIPT GLOBAL IT SERVICES PRIVATE LIMITED Full time

    Job Description : We are looking for an experienced Data Engineer - Azure with 8 years of experience in designing and developing distributed data pipelines. The ideal candidate should have expertise in Azure Data Services, Python, PySpark, and CI/CD, with strong communication skills and hands-on experience in data engineering. Roles and Responsibilities : -...

  • Azure Data Engineer

    5 days ago

    India Impetus Career Consultants Private Limited Full time

    We are hiring for one of the IT product-based company. Location : Pune/Gurgaon/Noida. Work Mode : Hybrid. Exp - 1-6 Years. Required Skills and Qualifications : Technical Expertise : - Strong experience with Azure services, including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse, Azure Databricks, and Azure Functions. - Proficiency...

  • Azure Data Engineer

    5 days ago

    India Xpetize Technology Solutions Full time

    Job Overview : We are seeking an experienced Azure Data Engineer with 2-4 years of hands-on experience working with Microsoft Azure technologies to join our dynamic team. The successful candidate will help design, implement, and maintain data solutions on the Azure platform, ensuring data is easily accessible, efficient, and secure for business analysis and...

  • Azure Data Engineer

    6 days ago

    India Avani Technology Full time

    Job Title : Azure Data Engineer Location : Anywhere in India (Remote) Job Type : Contract Job Overview : We are seeking an experienced Azure Data Engineer to join our dynamic data team. The ideal candidate will have a strong background in designing and maintaining scalable data pipelines utilizing Azure services, along with expertise in ETL/ELT processes....

  • Azure Data Engineer

    4 weeks ago

    India Ampstek Full time

    Job Title: Azure Data EngineerLocation: 100% RemoteJob Type: ContractRequired Skills & Experience:• 8+ years of experience in data engineering, with a focus on schema design and data modeling.• Strong expertise in Azure Data Services (Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, Cosmos DB, Databricks, Azure Data Factory).• Hands-on...

  • Azure Data Engineer

    4 weeks ago

    India Ampstek Full time

    Job Title: Azure Data Engineer Location: 100% Remote Job Type: Contract Required Skills & Experience: • 8+ years of experience in data engineering, with a focus on schema design and data modeling. • Strong expertise in Azure Data Services (Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, Cosmos DB, Databricks, Azure Data Factory). •...

  • Azure Data Engineer

    5 days ago

    India SMARTWORK IT SERVICES Full time

    Job Title : Azure Data Engineer (Teradata ). Location : Bangalore, Hyderabad, Chennai. Experience : 5-7 Years. Required skills : Teradata , Azure, Databricks, Python , Pyspark. Job Description : We are seeking a highly skilled Azure Data Engineer with extensive experience in Teradata to join our dynamic team. The ideal candidate will be responsible for...

  • Azure Data Engineer

    1 day ago

    India BeGig Full time

    One of our clients(TechM) is looking to hire an Azure Data Engineer, please find the details below:Job Title: Azure Data Engineer with PySpark and Unity CatalogJob Type: ContractWork Mode: RemoteDuration: 6 MonthsLocation: RemoteWorking Hours: 11 AM to 9 PM IST(8 hrs per day)Job DescriptionWe are looking for an Azure Data Engineer with expertise in...

  • Azure Data Engineer

    29 minutes ago

    India BeGig Full time

    Azure Data Engineer Job Description We are seeking a skilled Azure Data Engineer to manage data pipelines, data governance, and cloud infrastructure. The ideal candidate should have expertise in Databricks, PySpark, and Unity Catalog. Key Responsibilities: ETL Pipeline Development: Develop and optimize ETL pipelines using Databricks and PySpark. Data...

  • Azure Data Engineer

    5 days ago

    India CORTEX Consultants Full time

    Experience : 7-10 Years Location : Chennai, Coimbatore, Hyderabad, Kochi, Pune, Mumbai Joining : Immediate Joiners Preferred About the Role : We are seeking a highly motivated and experienced Azure Data Engineer to join our growing data team. You will play a crucial role in designing, building, and maintaining robust and scalable data pipelines on the Azure...

  • Azure Data Engineer

    3 weeks ago

    India Avani Technology Full time

    Job Title : Azure Data EngineerLocation : Anywhere in India (Remote)Job Type : ContractJob Overview : We are seeking an experienced Azure Data Engineer to join our dynamic data team. The ideal candidate will have a strong background in designing and maintaining scalable data pipelines utilizing Azure services, along with expertise in ETL/ELT processes. This...

  • Azure Data Engineer

    6 days ago

    India Vishanz Business Services Private Limited Full time

    Job Description : - 4.5 years of experience as a Data Engineer or in a related role. - Strong expertise in Azure data services (Azure Data Factory, Azure Synapse, Azure Databricks, Azure Storage, etc.). - Proficiency in Python for data processing and automation. - Deep knowledge of SQL and experience in writing complex queries, stored procedures, and...

  • Azure Data Engineer

    5 days ago

    India ACENET CONSULTING PRIVATE LIMITED Full time

    Key Responsibilities : 1.Staging Layer Development : - Create and Manage Staging Layers : Design efficient staging tables for preliminary data storage. - Historical and Incremental Data Loads : Implement strategies for managing both historical and incremental data loads using Azure Synapse SQL pools and other relevant tools. - Performance Optimization :...

  • Azure Data Engineer

    1 day ago

    India CloudSpace LLC Full time

    We have an offshore (India) remote opportunity for a US-based client located in Massachusetts. Job Title : Sr. Azure Data Engineer Location : Remote (Offshore - India) Key Responsibilities and Skills : - Strong analytical skills in Data & SQL to resolve data issues and production tickets. - Proficient coding skills in PySpark, with the ability to debug...

  • Azure Data Engineer

    1 day ago

    India AceNet Full time

    About Us : AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare, supply chain & logistics, consumer retail,...

  • Azure Data Engineer

    3 weeks ago

    India Vertiscript Global Full time

    Exp : 8+ Years Max Budget : 28 LPA Max NP: 15 Days. Key Skills a. Data Engineering and SQL b. Python c. PySpark d. Azure Data lake and ADF e. Databricks f. CICD g. Strong communication Job Title: Data Engineer - Azure Minimum Qualifications and Job Requirements: * Bachelor's degree in CS. · 8 years of hands-on experience in...