Senior Developer – Azure Databricks

3 weeks ago

bangalore, India Arthya Tech Solutions Full time
Position Summary:
At Arthya Tech we are building Global Competency center - GCC for our client - an US based producer of dairy products.
As a Senior Developer, you will be responsible for technical leadership of Agile Team(s) with our Business Analytics & Insights (BAI) team. You will work closely with cross-functional teams to deliver high-quality solutions in domains such as Supply Chain, Finance, Operations, Customer Experience, HR, Risk Management, and Global IT.
Responsibilities:
• Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lake.
• Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks
• Developing scalable and re-usable frameworks for ingesting of data sets
• Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanisms.
• Working with event based / streaming technologies to ingest and process data.
• Provide technical guidance and support to the team, resolving any technical challenges or issues that may arise during the migration and post-migration phases.
• Stay up to date with the latest advancements in cloud computing, data engineering, and analytics technologies, and recommend best practices and industry standards for implementing the data lake solution.
Requirements:
• 8 to 10 years of IT experience
• Min. 4 years of Experience working with Azure Databricks
• Experience in Data Modelling & Source System Analysis
• Familiarity with PySpark
• Mastery of SQL
• Knowledge of components: Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL • Experience with Python programming language used for data Engineering purpose.
• Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
• Experience in data visualization/exploration tools
Will be considered as an advantage but are not required:
• Microsoft Certified: Azure Data Engineer Associate
• Experience preparing data for Data Science and Machine Learning
• Knowledge of Jupyter Notebooks or Databricks Notebooks for Python development
Personal Attributes
• Providing Technical leadership and guidance to Teams
• Strong problem-solving skills and the ability to translate business requirements into actionable data science solutions.
• Excellent communication skills, with the ability to effectively convey complex ideas to technical and non-technical stakeholders.
• Strong team player with excellent interpersonal and collaboration skills.
• Ability to manage multiple projects simultaneously and deliver high-quality results within specified timelines.

  • Senior Developer – Azure Databricks

    3 weeks ago

    bangalore, India Arthya Tech Solutions Full time

    Position Summary: At Arthya Tech we are building Global Competency center - GCC for our client - an US based producer of dairy products. As a Senior Developer, you will be responsible for technical leadership of Agile Team(s) with our Business Analytics & Insights (BAI) team. You will work closely with cross-functional teams to deliver high-quality...

  • Azure Databricks

    6 days ago

    Bangalore, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 5-12 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The...

  • Arthya Tech Solutions

    6 days ago

    Bangalore, India Arthya Tech Solutions Full time

    Job Title : Senior Developer - Azure DatabricksCompany : Arthya SolutionsPosition Summary :- At Arthya Solutions, we are building a Global Competency Center (GCC) for our client, a US-based producer of dairy products.- As a Senior Developer, you will provide technical leadership to Agile teams within our Business Analytics & Insights (BAI) team.- You will...

  • Azure Databricks Lead/Architect

    4 weeks ago

    bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures. Position: Lead /Architect - Azure...

  • Azure databricks lead/architect

    2 months ago

    Bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures. Position: Lead /Architect - Azure...

  • Azure Databricks Lead/Architect

    2 months ago

    Bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures. Position: Lead /Architect - Azure Databricks ...

  • Azure databricks developer

    4 weeks ago

    Bangalore, India JRD Systems Full time

    Looking for an offshore Senior Developer who has experience in Databricks/Py Spark, is willing to learn new technologies if needed and is able to work with team. Essential Job Functions: * Responsible for design of application considering the cost and best practices * Must be willing to self learn new technologies, become SMEs and develop high quality...

  • Azure Databricks Developer

    4 weeks ago

    bangalore, India JRD Systems Full time

    Looking for an offshore Senior Developer who has experience in Databricks/PySpark, is willing to learn new technologies if needed and is able to work with team. Essential Job Functions: * Responsible for design of application considering the cost and best practices * Must be willing to self learn new technologies, become SMEs and develop high quality code...

  • Azure Databricks Lead/Architect

    4 weeks ago

    bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...

  • Azure Databricks Lead/Architect

    1 month ago

    bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure...

  • Azure Databricks Pyspark Developer

    6 months ago

    bangalore, India Tredence Inc. Full time

    MUST HAVE• Minimum of 4 to 8 years of Azure DE experience.• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...

  • Azure Databricks Developer

    4 weeks ago

    bangalore, India JRD Systems Full time

    Looking for an offshore Senior Developer who has experience in Databricks/PySpark, is willing to learn new technologies if needed and is able to work with team.Essential Job Functions:* Responsible for design of application considering the cost and best practices* Must be willing to self learn new technologies, become SMEs and develop high quality code in a...

  • Azure Databricks Developer

    4 weeks ago

    bangalore, India JRD Systems Full time

    Looking for an offshore Senior Developer who has experience in Databricks/PySpark, is willing to learn new technologies if needed and is able to work with team. Essential Job Functions: * Responsible for design of application considering the cost and best practices * Must be willing to self learn new technologies, become SMEs and develop high quality code...

  • Azure Databricks Developer

    1 month ago

    bangalore, India JRD Systems Full time

    Looking for an offshore Senior Developer who has experience in Databricks/PySpark, is willing to learn new technologies if needed and is able to work with team.Essential Job Functions:* Responsible for design of application considering the cost and best practices* Must be willing to self learn new technologies, become SMEs and develop high quality code in a...

  • Azure Architect

    1 month ago

    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    Job Title : Azure ArchitectLocation : Bangalore/Bengaluru (Hybrid Mode)Experience : 8 to 12 YearsJob Summary : We are looking for a skilled Azure Architect with extensive experience in data engineering and a strong focus on Azure Databricks. The ideal candidate will have a deep understanding of Azure services, ETL processes, and data warehousing concepts,...

  • Azure Databricks Lead/Architect

    2 months ago

    bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...

  • Azure Databricks Lead/Architect

    4 weeks ago

    bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures. Position: Lead /Architect - Azure Databricks...

  • Azure Databricks

    2 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market. As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • Azure Databricks-7to10Yrs-Bangalore

    2 months ago

    bangalore, India Tata Consultancy Services Full time

    Azure Databricks-7to10Yrs-BangaloreJD-Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure Data Factory and understanding of Microsoft Azure PaaS features.Azure Cloud ,Azure Databricks, Data Factory knowledge are good to have, otherwise any cloud exposureAbility to gather requirements...

  • Azure Databricks Engineer

    2 weeks ago

    Bangalore, India krtrimaIQ Cognitive Solutions Full time

    Job Title: Azure Databricks Engineer Location: Bangalore Experience Level: 5+ years of relevant experience Employment Type: Full-Time About Us: Join our team to help shape the future of data solutions! We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights...