Azure Data Engineer

6 days ago

Mumbai, Maharashtra, India Talpro Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Job Description : We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL. Additionally, you will work on Azure and Databricks "Lakehouse" implementation, translating business requirements into technical solutions for data curation and consumption.

Responsibilities :

  • Data Curation and Transformation: Translate business requirements into technical solutions for data curation and transformation, specifically using Databricks Lakehouse from a modeling and ELT perspective.
  • Azure Data Engineering: Develop data pipelines and orchestration using Azure Data Factory and other Azure Modern Data Warehouse platform components.
  • SQL and Pyspark: Utilize SQL programming and Pyspark for data manipulation and processing tasks.
  • Azure Services: Work with Azure services such as ADLS (Azure Data Lake Storage), ADX (Azure Data Explorer), and Databricks.
  • Data Migration: Experience in SQL Server migration to the cloud and handling structured and unstructured datasets.
  • DevOps and CI/CD: Good knowledge of DevOps tools and processes, and experience in automating data pipelines through a CI/CD delivery methodology.
  • Databricks Expertise: In-depth hands-on implementation knowledge on Azure Databricks, Databricks Delta Lake, and managing Delta Tables.
  • Data Modeling: Understand and implement data modeling for the data lake.
  • Data Transfer and Oracle PL/SQL: Hands-on experience in using secure file transfer tools like Kiteworks, and Oracle PL/SQL knowledge will be a plus.
  • Effort Estimation: Provide effort estimation for new projects related to data engineering.
  • Complex Design and Agile Environment: Drive complex design and development efforts in an agile environment.

Qualifications :

  • Minimum of 5-7 years of experience working on Azure and Databricks "Lakehouse" implementation.
  • Strong experience in ADF (Azure Data Factory) and SQL as primary skills.
  • Familiarity with Informatica PWC and Oracle PL/SQL.
  • Experience in SQL programming and Pyspark.
  • 2 or more years of experience as a Data Engineer, specifically in the Azure Modern Data Warehouse platform.
  • Good understanding of data modeling and data lake concepts.
  • Expertise in Databricks, ADLS, ADX, and other Azure services.
  • Prior experience in SQL Server migration to the cloud.
  • Knowledge of DevOps tools and processes.

)

  • Azure Data Engineer

    4 weeks ago

    Mumbai, Maharashtra, India LTIMindtree Full time

    Skill: Azure Data EngineerPrimary skill: ADB,ADF,SQLSecondary skill: Py spark or PythonExperience: 5-12YRSLocation: Hyderabad, Pune, Mumbai, Kolkata, Nagpur, Bangalore,ChennaiNotice period: Imm to 30 DaysJD: Proactive Q2 Azure Data Factory ADFP3 Job Description Azure Databricks DeveloperLocation India ISTOverview Data Engineer having good experience on Azure...

  • Azure Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India LTIMindtree Full time

    Skill: Azure Data Engineer Primary skill: ADB,ADF,SQL Secondary skill: Py spark or Python Experience: 5-12YRS Location: Hyderabad, Pune, Mumbai, Kolkata, Nagpur, Bangalore,Chennai Notice period: Imm to 30 Days JD: Proactive Q2 Azure Data Factory ADFP3 Job Description Azure Databricks Developer Location India IST Overview Data Engineer having good experience...

  • Data Engineer Snowflake, Azure Data Factory

    2 weeks ago

    Mumbai, Maharashtra, India Suzva Software Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    JobOpening Data Engineer (Contract | 6 Months)Location: Hyderabad | Chennai | Remote Flexibility PossibleType: Contract | Duration: 6 Months We are seeking an experienced Data Engineer to join our team for a 6-month contract assignment. The ideal candidate will work on data warehouse development, ETL pipelines, and analytics enablement using Snowflake,...

  • Pyspark" "Azure data bricks" "Azure Data Factory"

    2 days ago

    Mumbai, Maharashtra, India Tata Consultancy Services Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Please find below JD for the same as requested. Technical Skills:"Pyspark" "Azure data bricks" "Azure Data Factory"Experienced level - 5 yearsShould have hands-on experience in writing PySpark code on Databricks and expertise in Spark-Sql and Python coding as well. Should have worked on Azure Data lake Gen2 storage or good to have knowledgeHands-on exp in...

  • Azure Data Engineer

    18 hours ago

    Mumbai, Maharashtra, India Prointegrate World It Consulting Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Key Responsibilities:Design, build, and maintain robust data pipelines to curate and ingest data efficiently.Work with Azure cloud services to deploy and manage scalable data solutions.Implement and maintain CI/CD pipelines for seamless data workflows.Collaborate with cross-functional teams to ensure data integrity, security, and accessibility.Key Skills &...

  • Azure Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Deloitte Full time

    Your potential, unleashed. India's impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realise your potential amongst cutting edge leaders, and organizations shaping the future of the region, and indeed, the world beyond. At Deloitte, your whole self to work, every day. Combine that with our...

  • Azure Data Bricks Engineer

    2 days ago

    Mumbai, Maharashtra, India CARBYNETECH Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Azure Data Factory: Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka, Spark SQL,...

  • Azure Data Factory

    2 weeks ago

    Mumbai, Maharashtra, India ERGO Technology & Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role & responsibilitiesThe Azure Data Factory Engineer is responsible for designing, implementing, and maintaining scalable data integration solutions using Azure Data Factory (ADF). This includes setting up and configuring Azure infrastructure components, integrating diverse data sources including REST APIs, and implementing CI/CD pipelines to support...

  • Senior Azure Databricks Engineer

    2 days ago

    Mumbai, Maharashtra, India MLAI Digital Private Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Certified Azure Data Engineer

    2 days ago

    Navi Mumbai, Maharashtra, India Bigwig Ship Management Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    (A) should have hands-on experience in designing and implementing data solutions using Azure data services, including Azure SQL Database, Azure Data Lake Storage, and Azure Synapse Analytics. (B) Experience in setting up, managing Data Lake.