Senior Azure Databricks Specialist

1 week ago


Delhi, Delhi, India Amossys Consulting Services Full time

Job Description :

Key Responsibilities :

- Design, develop, and implement data solutions using Azure Data Bricks and Azure Data Factory.

- Build and optimize data pipelines for data ingestion, processing, and storage.

- Develop data transformation logic using Python, PySpark, Scala, or Hive.

- Work extensively with Azure SQL Database, Azure SQL Warehouse, and Synapse Analytics for data integration and processing.

- Design and implement data models and schemas optimized for performance and scalability.

- Build and maintain CI/CD pipelines in Azure DevOps for automated deployment and testing of data solutions.

- Implement best practices for code management, testing, and release processes.

- Collaborate with cross-functional teams (data engineers, data scientists, business analysts) to understand data requirements and design optimal data workflows.

- Identify and resolve performance bottlenecks and optimize data pipelines for efficiency and cost-effectiveness.

- Adhere to best practices for data engineering, data governance, and security.

- Mentor and guide junior team members on Azure data technologies and best practices.

Qualifications :

Experience : 5+ years of hands-on experience with Azure Data Bricks and Azure Data Factory, including designing, developing, and deploying production-ready data solutions.

Technical Skills :

- Deep expertise in Azure Data Bricks and its functionalities.

- Strong experience with Azure Data Factory for building and managing data pipelines.

- Proficiency in at least one of the following languages: Python, PySpark, Scala, or Hive.

- Hands-on experience with Azure SQL Database, Azure SQL Warehouse, and Synapse Analytics.

- Expertise in building and managing CI/CD pipelines in Azure DevOps.

Other Skills :

- Excellent problem-solving and analytical skills.

- Strong communication and collaboration abilities.

- Experience working in Agile development methodologies is a plus.

Preferred Skills :

- Experience with other Azure data services (Azure Cosmos DB, Azure Blob Storage).

- Knowledge of data warehousing concepts and best practices.

- Experience with data visualization tools (Power BI, Tableau).

- Experience with real-time data streaming technologies (Azure Event Hubs, Apache Kafka)

(ref:hirist.tech)

  • Delhi, Delhi, India SYSTEM SOFT TECHNOLOGIES INDIA PRIVATE LIMITED Full time

    Responsibilities :- Design, develop, and deploy data solutions on Azure Databricks, leveraging its capabilities for data engineering, machine learning, and business intelligence.- Architect and implement data pipelines using Spark, Delta Lake, and other relevant technologies within the Databricks ecosystem.- Optimize Databricks clusters and jobs for...


  • Delhi, Delhi, India SYSTEM SOFT TECHNOLOGIES INDIA PRIVATE LIMITED Full time

    Key Responsibilities : - Design and implement robust and scalable data architectures on Azure Databricks.- Develop and optimize data pipelines using Apache Spark, including data ingestion, transformation, and loading.- Integrate Azure Databricks with other Azure services, such as Azure Data Lake, Azure Synapse, and Azure SQL.- Develop data models and...


  • Delhi, Delhi, India Hexaware Technologies Full time

    We are Hexaware Technologies, a global IT service company that's dedicated to delivering innovative solutions. We're currently hiring for an Azure Databrics Engineer position.About the Job:This role requires an expert in data engineering with experience in Pyspark and SQL. The successful candidate will design, develop, and deploy scalable big data pipelines...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    Azure Databricks Developer (Python + Pyspark)Azure Databricks Developer (Python + Pyspark)Experience: 4 years to 12 yearsLocation: Delhi, Kolkata, Chennai, Hyderabad, Bangalore, PuneInterview Mode: OnlineInterview Date: 8th March 2025Interview Time: 10: 00 AM to 5: 00 PMMust Have:4 or more years of experience working on Azure Databricks using Scala, PySpark...


  • Delhi, Delhi, India Marx Enterprise Transformation Architecture Full time

    About the RoleWe are looking for an experienced Azure DevOps Specialist to join our team at Marx Enterprise Transformation Architecture. As a senior member of our cloud architecture team, you will be responsible for designing and implementing complex CI/CD pipelines, automating infrastructure deployment, and ensuring efficient Azure cloud...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    TCS is hiring for Azure Data Bricks engineer.Location: Bangalore, Kolkata, BBSR, Pan IndiaExperience: 6+ Yrs.Job Description:1. Build and maintain the technology platform for both on premise and cloud-based solutions.2. Responsible for engineering a new cloud data platform analyzing different emerging technology solutions that range from Microsoft Synapse,...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    We are seeking an experienced Azure Databricks Engineer to join our team at Tata Consultancy Services.About the Role:Develop and maintain cloud-based data platforms using Azure DatabricksResponsibilities:Design and implement data pipelines using Azure Data Factory and Azure Data LakeWork with cross-functional teams to develop and deploy data engineering...


  • Delhi, Delhi, India BeGig Full time

    One of our clients(TechM) is looking to hire a Senior Azure Data Architec t, please find the details below: Job Role:-Senior Azure Data Architect Job Type:- Contract Work Mode:- WFH No of hours:- 8 hours per day Timings:- 12:00 PM- 10:00 PM **Job Title: Senior Data Architect* * **Job Summary:** We are seeking a highly skilled Senior Data Architect with...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    Note-This will be a Walk-In drive @ Delhi Location, on 1 -02-2025Required InformationDetailsRole**Databricks DeveloperRequired Technical Skill Set**Azure DatabricksDesired Experience Range**6 to 8 yrsLocation of RequirementDelhiDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5)Azure Databricks – E2Pyspark...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    Job Overview:Azure Databricks Developer (Python + Pyspark)Job Description:This role involves working as a full stack engineer in a scrum team. Assist in defining product technical architecture. Maintain and document deliverables in Rally as needed. Participate in peer reviews for designs, code, and other work products and scrum ceremonies. Perform software...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    Note-This will be a Walk-In drive @ Delhi Location, on 1 -02-2025Required InformationDetailsRole**Databricks DeveloperRequired Technical Skill Set**Azure DatabricksDesired Experience Range**6 to 8 yrsLocation of RequirementDelhiDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5)1. Azure Databricks – E22....


  • Delhi, Delhi, India Nucleocoders Technologies Full time

    Nucleocoders Technologies Job DescriptionAt Nucleocoders Technologies, we are committed to delivering high-quality data solutions that meet the evolving needs of our clients. We are seeking an experienced Sr. Databricks Developer to join our team. In this role, you will design and develop data processing pipelines and analytics solutions using Databricks,...


  • Delhi, Delhi, India Coders Brain Technology Private Limited Full time

    Job Description :We are seeking a highly skilled Senior Azure Data Engineer with expertise in Azure Data Factory (ADF), Azure Databricks, PySpark, SQL, ADO, Power BI (Basics), and Unity Catalog. The ideal candidate will have strong experience in building scalable data pipelines, optimizing data lakes, and implementing data governance solutions using Azure...


  • Delhi, Delhi, India Coders Brain Technology Private Limited Full time

    Job Description :We are seeking a highly skilled Senior Azure Data Engineer with expertise in Azure Data Factory (ADF), Azure Databricks, PySpark, SQL, ADO, Power BI (Basics), and Unity Catalog. The ideal candidate will have strong experience in building scalable data pipelines, optimizing data lakes, and implementing data governance solutions using Azure...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    Required Skills and QualificationsTo be successful in this role, you should possess the following skills and qualifications:Bachelor's degree in Computer Science, Information Technology, or related fieldMinimum 5 years of experience in big data engineering, preferably with Azure DatabricksHands-on experience with Python, PySpark, and SQL programming...

  • Databricks Engineer

    1 week ago


    Delhi, Delhi, India BOHIYAANAM TECHNOLOGY LLP Full time

    Role : Databricks Engineer Experience Preferred : 8+ YearsLocation : RemoteJob Description : - Design, build, and optimize scalable ETL/ELT pipelines on Databricks using PySpark, Scala, or SQL.- Collaborate with data architects to implement data lakehouses and other modern data infrastructure on Databricks.- Ensure optimal performance of Databricks jobs by...


  • Delhi, Delhi, India Marx Enterprise Transformation Architecture Full time

    We seek a highly skilledAzure DevOps and GitLab Enginee r with cloud automation, CI/CD, and Infrastructure as Code (IaC) expertise. The ideal candidate will be responsible for designing and managing CI/CD pipelines, automating infrastructure deployment, and ensuring efficient Azure cloud operations. Candidates with AZ-400: Microsoft Certified Azure DevOps...


  • Delhi, Delhi, India Marx Enterprise Transformation Architecture Full time

    We seek a highly skilled Azure DevOps and GitLab Engineer with cloud automation, CI/CD, and Infrastructure as Code (IaC) expertise. The ideal candidate will be responsible for designing and managing CI/CD pipelines, automating infrastructure deployment, and ensuring efficient Azure cloud operations. Candidates with AZ-400 : Microsoft Certified Azure DevOps...


  • Delhi, Delhi, India Marx Enterprise Transformation Architecture Full time

    **Azure DevOps and GitLab Engineer Job Description**We are seeking a highly skilled professional with expertise in cloud automation, CI/CD, and Infrastructure as Code (IaC) to design and manage efficient Azure cloud operations.The ideal candidate will be responsible for:Key Responsibilities:Designing, implementing, and optimizing CI/CD pipelines using Azure...


  • Delhi, Delhi, India Luxoft Full time

    Project descriptionRelated to the Financial Investments Area, this role's main accountability is providing support and advice on the development of applications by understanding the requirements of customers and recommending application performance improvements to ensure alignment with business requirements and implementing them in the scope of the SAP BW...