azure data engineer with fabric

6 days ago

Bengaluru Gurugram Pune, India ASV Consulting Services Full time ₹ 15,00,000 - ₹ 18,00,000 per year

Contractual

Hiring manager :- My profile :-

Payroll of :-

1. AZURE DATA ENGINEER WITH FABRIC

The Role : Lead Data Engineer

PAYROLL

Client - Brillio

About Role:

Experience 6 to 8yrs

Location- Bangalore , Hyderabad , Pune , Chennai , Gurgaon (Hyderabad is preferred)

Notice- 15 days / 30 days.

Budget -15 LPA

AZURE FABRIC EXP MANDATE

Skills: Azure Onelake, datapipeline , Apache Spark , ETL , Datafactory , Azure Fabric , SQL , Python/Scala.

Key Responsibilities:

  • Data Pipeline Development: Lead the design, development, and deployment of data pipelines using Azure OneLake, Azure Data Factory, and Apache Spark, ensuring efficient, scalable, and secure data movement across systems.
  • ETL Architecture: Architect and implement ETL (Extract, Transform, Load) workflows, optimizing the process for data ingestion, transformation, and storage in the cloud.
  • Data Integration: Build and manage data integration solutions that connect multiple data sources (structured and unstructured) into a cohesive data ecosystem. Use SQL, Python, Scala, and R to manipulate and process large datasets.
  • Azure OneLake Expertise: Leverage Azure OneLake and Azure Synapse Analytics to design and implement scalable data storage and analytics solutions that support big data processing and analysis.
  • Collaboration with Teams: Work closely with Data Scientists, Data Analysts, and BI Engineers to ensure that the data infrastructure supports analytical needs and is optimized for performance and accuracy.
  • Performance Optimization: Monitor, troubleshoot, and optimize data pipeline performance to ensure high availability, fast processing, and minimal downtime.
  • Data Governance & Security: Implement best practices for data governance, data security, and compliance within the Azure ecosystem, ensuring data privacy and protection.
  • Leadership & Mentorship: Lead and mentor a team of data engineers, promoting a collaborative and high-performance team culture. Oversee code reviews, design decisions, and the implementation of new technologies.
  • Automation & Monitoring: Automate data engineering workflows, job scheduling, and monitoring to ensure smooth operations. Use tools like Azure DevOps, Airflow, and other relevant platforms for automation and orchestration.
  • Documentation & Best Practices: Document data pipeline architecture, data models, and ETL processes, and contribute to the establishment of engineering best practices, standards, and guidelines.
  • C Innovation: Stay current with industry trends and emerging technologies in data engineering, cloud computing, and big data analytics, driving innovation within the team.C

  • Azure Data Fabric

    2 weeks ago

    Pune, Maharashtra, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Must have minimum 3 years of experience in Data Migration and Data Transformation projects on Azure cloudProven expertise in building large-scale batch and real-time data pipelines with data processing frameworks in AWS and Azure cloud platformsDesign and develop pipelines, ETL and analytical processes on Azure cloud using data services like Azure Data...

  • Microsoft Azure Fabric

    4 weeks ago

    Pune, India Exusia Full time

    Sr Data Engineers & Tech Leads – Azure / Microsoft Fabric Department:                           Sales and Delivery Team - Empower Industry:                                  Information Technology & Services, Computer Software, Management Consulting Location: ...

  • Microsoft Azure Fabric

    4 weeks ago

    Pune, India Exusia Full time

    Sr Data Engineers & Tech Leads – Azure / Microsoft Fabric Department:                           Sales and Delivery Team - Empower Industry:                                  Information Technology & Services, Computer Software, Management Consulting Location:...

  • Microsoft Azure Fabric

    4 weeks ago

    Pune, Maharashtra, India Exusia Full time

    Sr Data Engineers Tech Leads - Azure Microsoft Fabric Department Sales and Delivery Team - Empower Industry Information Technology Services Computer Software Management Consulting Location WFH India Remote Experience Range 5 - 10 years Basic Qualification Bachelor of Engineering or Equivalent Travel Requirements Not required Website ...

  • Azure Data Architect

    2 weeks ago

    Pune, India MNR Solutions Full time

    Key Responsibilities :- Architect, design, implement and maintain end-to-end data platforms using Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.- Design and lead data science and analytics projects using Azure Machine Learning, Python, and ML frameworks.- Build and optimize high-volume data pipelines with a focus on...

  • Azure Data Engineer/Lead Azure Data Engineer

    6 days ago

    Bengaluru, Hyderabad, Pune, India Epam Systems Full time

    Job Summary:We are seeking a skilled and detail-oriented Azure Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Azure Data Factory, Azure Synapse or Microsoft Fabric, and strong programming skills in Python or PySpark. Proficiency in SQL and experience in designing and maintaining modern data pipelines...

  • Microsoft Fabric + Azure + Pyspark

    5 days ago

    Bengaluru, India Whatjobs IN C2 Full time

    Job Description (JD) Azure Data Engineering role focused on Microsoft Fabric (good to have), Azure Databricks with PySpark (must have) capabilities and strong emphasis on Python, SQL, Data Lake, and Data Warehouse: Job Title: Data Engineer – Microsoft Fabric, Azure (Databricks & ADF), PySpark Experience: 4–8 Years Location: Kolkata / Bangalore Employment...

  • Azure Data Engineer

    4 days ago

    Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Azure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data FabricAzure Data Factory (Must Have)Azure Data Bricks (Must Have)Azure fabric (Good to have)Knowledge of Data Processing Flow with Gen AI applicationExperience working with Unstructured data (Must Have)Worked on production with more than 10000 file injection (Must...

  • Fabric Lead Data Engineer

    4 weeks ago

    Bengaluru, India The Techgalore Full time

    We are looking for a Lead Data Engineer to drive the migration of our existing Azure data and Power BI artifacts to the new Microsoft Fabric environment. This role will involve designing and implementing a scalable data architecture, optimizing data pipelines, and ensuring seamless integration with Microsoft Fabrics ecosystem. Key Responsibilities: Lead...

  • Fabric Lead Data Engineer

    4 weeks ago

    Bengaluru, India The Techgalore Full time

    We are looking for a Lead Data Engineer to drive the migration of our existing Azure data and Power BI artifacts to the new Microsoft Fabric environment. This role will involve designing and implementing a scalable data architecture, optimizing data pipelines, and ensuring seamless integration with Microsoft Fabrics ecosystem. Key Responsibilities: Lead the...