MS Azure with ADF/Databricks

1 month ago

Hyderabad, India Alignity Solutions Full time
Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.
  • Jobseeker Video Testimonials 
  • Employee Glassdoor Reviews
If you are a MS Azure with ADF/Databricks Position looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Role:MS Azure with ADF/Databricks
Location: Bengaluru 
Exp: 5 - 8 Years

Requirements

We are seeking a skilled Azure Data Engineer to design, develop, and optimize our data solutions on Microsoft Azure, focusing on Azure Data Factory (ADF) and Azure Databricks. This role requires an in-depth understanding of Azure cloud services, data transformation, and pipeline development, enabling the organization to leverage data for insights and decision-making.

Key Responsibilities

  1. Data Pipeline Development and Management

    • Design and implement scalable, reliable, and high-performance data pipelines using Azure Data Factory (ADF) to ingest, transform, and load data from various data sources.
    • Develop end-to-end ETL/ELT processes within ADF, ensuring data quality, accuracy, and consistency.

  2. Data Transformation and Processing with Databricks

    • Utilize Azure Databricks for data wrangling, cleaning, and transformations to prepare data for analytics and machine learning.
    • Implement Spark-based data engineering workflows within Databricks, optimizing performance and cost efficiency.
    • Collaborate with data scientists to prepare data for advanced analytics and machine learning models.

  3. Database and Data Storage Optimization

    • Work with Azure Data Lake Storage (ADLS), SQL Databases, and other Azure storage solutions to manage data and ensure efficient access.
    • Design and implement optimized data storage solutions that support the scalability and agility of data processing workflows.

  4. Data Governance and Security

    • Implement robust data governance practices, ensuring compliance with data security, privacy policies, and data retention requirements.
    • Apply access control mechanisms, data masking, and encryption strategies to protect sensitive data in ADF and Databricks.

  5. Performance Tuning and Optimization

    • Monitor and improve the performance of ETL/ELT processes within ADF and Databricks.
    • Troubleshoot and resolve issues related to data pipelines, storage, and processing, ensuring high availability and reliability.

  6. Collaboration and Documentation

    • Collaborate with data architects, analysts, and business stakeholders to define data requirements and develop solutions that align with business goals.
    • Document processes, configurations, and best practices to facilitate knowledge sharing within the team.
Required Qualifications
  • Bachelor’s degree in Computer Science, Information Systems, or related field.
  • 3+ years of experience in data engineering or similar role, with a focus on Microsoft Azure.
  • Proficiency in Azure Data Factory for ETL/ELT processes, including activities like data ingestion, transformation, scheduling, and monitoring.
  • Hands-on experience with Azure Databricks for data processing, transformation, and pipeline development using Spark.
  • Strong knowledge of SQL and Python/Scala for data manipulation, scripting, and automation within Databricks.
  • Familiarity with Azure Data Lake Storage (ADLS) and other Azure storage solutions.
  • Experience in performance tuning and cost optimization of data workflows on cloud infrastructure.
  • Knowledge of Azure DevOps for CI/CD pipeline management, version control, and workflow automation.
Preferred Qualifications
  • Azure Certifications (e.g., Microsoft Certified: Azure Data Engineer, Azure Fundamentals).
  • Experience in real-time data processing using Azure Stream Analytics or Event Hub.
  • Familiarity with Power BI or other visualization tools for reporting and dashboarding.
  • Understanding of data governance and compliance standards (GDPR, HIPAA, etc.).


BenefitsVisit us at . Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.

CEO Message: Click Here
Clients Testimonial: Click Here

  • MS Azure with ADF/Databricks

    1 month ago

    hyderabad, India Quess Corp Limited Full time

    Hiring MS Azure with ADF/Databricks [3 -8 years] Company Name:- Quess Corp Ltd. Location: Hyderabad/Bangalore Notice: Immediate - 15 days is considerable. Experience Range: 3 - 8 Years Interview rounds : 2 rounds - Virtual Role 1: PowerBI and AAS expert (Strong SC or Specialist Senior) - Should have hands-on experience of Data Modelling in Azure SQL...

  • MS Azure with ADF/Databricks

    1 month ago

    Hyderabad, India Quess Corp Limited Full time

    Hiring MS Azure with ADF/Databricks (3 -8 years)Company Name:- Quess Corp Ltd.Location: Hyderabad/BangaloreNotice: Immediate - 15 days is considerable.Experience Range: 3 - 8 YearsInterview rounds : 2 rounds - VirtualRole 1:PowerBI and AAS expert (Strong SC or Specialist Senior)- Should have hands-on experience of Data Modelling in Azure SQL Data Ware House...

  • MS Azure with ADF/Databricks

    1 month ago

    hyderabad, India Quess Corp Limited Full time

    Hiring MS Azure with ADF/Databricks (3 -8 years)Company Name:- Quess Corp Ltd.Location: Hyderabad/BangaloreNotice: Immediate - 15 days is considerable.Experience Range: 3 - 8 YearsInterview rounds : 2 rounds - VirtualRole 1:PowerBI and AAS expert (Strong SC or Specialist Senior)- Should have hands-on experience of Data Modelling in Azure SQL Data Ware House...

  • MS Azure with ADF/Databricks

    1 month ago

    Hyderabad, India Quess Corp Limited Full time

    Hiring MS Azure with ADF/Databricks (3 -8 years) Company Name:- Quess Corp Ltd. Location: Hyderabad/Bangalore Notice: Immediate - 15 days is considerable. Experience Range: 3 - 8 Years Interview rounds : 2 rounds - Virtual Role 1: PowerBI and AAS expert (Strong SC or Specialist Senior) - Should have hands-on experience of Data Modelling in Azure SQL Data...

  • MS Azure with ADF/Databricks

    1 month ago

    Hyderabad, India Quess Corp Limited Full time

    Hiring MS Azure with ADF/Databricks (3 -8 years) Company Name:- Quess Corp Ltd. Location: Hyderabad/Bangalore Notice: Immediate - 15 days is considerable. Experience Range: 3 - 8 Years Interview rounds : 2 rounds - Virtual Role 1: PowerBI and AAS expert (Strong SC or Specialist Senior) - Should have hands-on experience of Data Modelling in...

  • MS Azure with ADF/Databricks

    1 month ago

    Hyderabad, India Quess Corp Limited Full time

    Hiring MS Azure with ADF/Databricks [3 -8 years]Company Name:- Quess Corp Ltd.Location: Hyderabad/BangaloreNotice: Immediate - 15 days is considerable.Experience Range: 3 - 8 YearsInterview rounds : 2 rounds - VirtualRole 1:PowerBI and AAS expert (Strong SC or Specialist Senior) - Should have hands-on experience of Data Modelling in Azure SQL Data Ware House...

  • MS Azure with ADF/Databricks

    1 month ago

    Hyderabad, India Quess Corp Limited Full time

    Hiring MS Azure with ADF/Databricks [3 -8 years]Company Name:- Quess Corp Ltd.Location: Hyderabad/BangaloreNotice: Immediate - 15 days is considerable.Experience Range: 3 - 8 YearsInterview rounds : 2 rounds - VirtualRole 1:PowerBI and AAS expert (Strong SC or Specialist Senior) - Should have hands-on experience of Data Modelling in Azure SQL Data Ware House...

  • Ms azure with adf/databricks

    4 weeks ago

    Hyderabad, India Quess Corp Limited Full time

    Hiring MS Azure with ADF/Databricks (3 -8 years) Company Name:- Quess Corp Ltd. Location: Hyderabad/Bangalore Notice: Immediate - 15 days is considerable. Experience Range: 3 - 8 Years Interview rounds : 2 rounds - Virtual Role 1: Power BI and AAS expert (Strong SC or Specialist Senior) - Should have hands-on experience of Data Modelling in...

  • Ms azure with adf/databricks

    1 month ago

    Hyderabad, India Quess Corp Limited Full time

    Hiring MS Azure with ADF/Databricks (3 -8 years)Company Name:- Quess Corp Ltd.Location: Hyderabad/BangaloreNotice: Immediate - 15 days is considerable.Experience Range: 3 - 8 YearsInterview rounds : 2 rounds - VirtualRole 1:Power BI and AAS expert (Strong SC or Specialist Senior)- Should have hands-on experience of Data Modelling in Azure SQL Data Ware House...

  • Quess Corp Limited | MS Azure with ADF/Databricks

    1 month ago

    hyderabad, India Quess Corp Limited Full time

    Hiring MS Azure with ADF/Databricks (3 -8 years) Company Name:- Quess Corp Ltd. Location: Hyderabad/Bangalore Notice: Immediate - 15 days is considerable. Experience Range: 3 - 8 Years Interview rounds : 2 rounds - Virtual Role 1: PowerBI and AAS expert (Strong SC or Specialist Senior) - Should have hands-on experience of Data Modelling in Azure SQL Data...

  • MS Azure ADF Developer

    2 months ago

    Hyderabad, India JTek Software Solutions Pvt Ltd Full time

    Job Title: MS Azure ADF DeveloperExperience: 10+ YearsLocation: HyderabadNotice Period: Immediate joiners preferred.Job Summary:We are seeking an experienced MS Azure ADF Developer with a strong background in API design, data mapping, and ETL processes. The ideal candidate will have expertise in handling large data sets and optimizing data syncs. The role...

  • Quess Corp Limited | MS Azure with ADF/Databricks

    1 month ago

    hyderabad, India Quess Corp Limited Full time

    Hiring MS Azure with ADF/Databricks [3 -8 years]Company Name:- Quess Corp Ltd.Location: Hyderabad/BangaloreNotice: Immediate - 15 days is considerable.Experience Range: 3 - 8 YearsInterview rounds : 2 rounds - VirtualRole 1:PowerBI and AAS expert (Strong SC or Specialist Senior) - Should have hands-on experience of Data Modelling in Azure SQL Data Ware House...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, India Alignity Full time

    Do you love a career where you Experience, Grow & Contribute at- the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.Learn how we are redefining the- meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.If you are a- MS Azure with ADF/Databricks- Position- looking for...

  • Sr Azure Databricks Developer

    2 months ago

    Hyderabad, India Innover Global Inc Full time

    Job Description And ResponsibilitiesHands-on experience working at a high level in Architecture or Data Science or combination.Azure skills highly preferred, including provisioning, Configuring, and Developing solutions in ADL, ADF, ADW etc.In-depth understanding of database and DWH structure principlesHands-on experience using MS SQL Server, Oracle or...

  • Azure Databricks

    1 month ago

    hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market. As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • Azure Databricks

    1 month ago

    hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market. As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • Azure Databricks

    1 month ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market.As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • Azure databricks

    1 month ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market.As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • Azure Databricks

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market.As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • Tcs opportunity azure data engineer

    1 day ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!!Job Title: Azure Data Engineer (ADF, ADB)/ Pyspark+Azure databricksLocation- Hyderabad/ BangaloreExperience required: 5+ yearsRequired Technical Skill SetAzure Data Engineer, ADF, Azure Databricks Spark (Py Spark or Scala), Python, PL/SQLMust-Have ·Strong experience in Azure Data Factory , ADB(Azure Databricks) Synapse; establishing the...