Azure Data Architect

4 weeks ago

Bengaluru, Karnataka, India S T M TECHNOLOGIES Full time

Job Overview :

We are seeking a highly experienced and visionary Azure Data Architect to design and lead the implementation of scalable, secure, and high-performance data solutions on the Microsoft Azure platform. The ideal candidate will possess deep expertise in Azure data services, particularly Azure Data Factory, Azure Synapse, and Apache Spark, coupled with a strong background in ETL processes and SQL. You will be instrumental in shaping our data strategy and driving complex data initiatives.

Responsibilities :

- Lead the design and architecture of end-to-end data pipelines and data solutions on Microsoft Azure, aligning with business requirements and best practices.

- Utilize Azure Data Factory extensively for orchestrating and automating data movement and transformation.

- Architect and implement robust data processing solutions using Apache Spark, with strong proficiency in Spark SQL, within environments like Azure Databricks or Azure Synapse Spark pools.

- Design and manage data warehousing solutions primarily on Azure Synapse Analytics, including dedicated SQL pools and serverless SQL pools.

- Oversee and optimize ETL (Extract, Transform, Load) processes, ensuring data quality, efficiency, and scalability.

- Develop and deploy serverless functions using Azure Functions for specific data processing or integration tasks.

- Engage deeply with SQL for data modeling, querying, optimization, and validation across various Azure data stores.

- Collaborate with data engineers, data scientists, and business stakeholders to translate complex business requirements into technical architectures and implementation plans.

- Define data governance, security, and compliance strategies for data assets on Azure.

- Provide technical leadership and mentorship to data engineering teams.

- Evaluate new Azure data services and technologies to recommend their adoption where beneficial.

- Create and maintain comprehensive documentation for data architectures, designs, and standards.

Primary Skills (Must Have) :

- Azure Data Pipeline / Azure Data Factory : Expert-level experience in designing, developing, and managing complex data pipelines.

- Apache Spark : Strong hands-on experience with Spark, including performance tuning and optimization.

- ETL (Extract, Transform, Load) : Deep understanding and practical experience in ETL methodologies and tools.

- Azure Synapse Analytics : Proven experience in designing and implementing data warehousing solutions.

- Azure Functions : Experience in developing and deploying serverless functions.

- Spark SQL : Proficiency in writing and optimizing Spark SQL queries.

- SQL : Expert-level SQL skills for data manipulation, DDL, DML, and performance tuning.

Secondary Skills (Good to Have) :

- Other Azure Services : Experience with Azure Data Lake Storage, Azure Cosmos DB, Azure Event Hubs, Azure Stream Analytics, Azure Databricks.

- Python/Scala : Strong programming skills in Python or Scala for data engineering tasks.

- Datastage : Experience with IBM DataStage or similar traditional ETL tools.

- Microsoft Fabric : Familiarity or early experience with Microsoft Fabric is a plus.

(ref:hirist.tech)

  • Azure Data Architect

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Tata Consultancy Service Hiring for Azure Data ArchitectExperience: 10 to 11 YearsLocation: Pune / Indore / Bengaluru / ChennaiSkill: AWS Data (Pyspark / Redshift / Glue)Job Description:- Strong hands-on experience in Python programming and PySpark, Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda)- Experience working with Apache Spark and...

  • Azure Data Architect

    2 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Tata Consultancy Service Hiring for Azure Data ArchitectExperience: 10 to 11 YearsLocation: Pune / Indore / Bengaluru / ChennaiSkill: AWS Data (Pyspark / Redshift / Glue)Job Description:Strong hands-on experience in Python programming and PySpark, Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) Experience working with Apache Spark and Hadoop...

  • Azure Data Architect

    1 week ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Tata Consultancy Service Hiring for Azure Data Architect Experience: 10 to 11 Years Location: Pune / Indore / Bengaluru / Chennai Skill: AWS Data (Pyspark / Redshift / Glue) Job Description: Strong hands-on experience in Python programming and PySpark, Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) Experience working with Apache...

  • Azure Databricks Architect

    3 weeks ago

    Bengaluru, Karnataka, India Aiprus Software Private Limited Full time

    Job Title : Azure Databricks ArchitectExperience : 10 to 15 YearsLocation : Bangalore, IndiaEmployment Type : Full-TimeKey Responsibilities : - Architect and design comprehensive data solutions on Microsoft Azure, with a strong emphasis on Azure Databricks.- Lead data architecture initiatives, ensuring alignment with industry best practices and...

  • Azure Cloud Data Platform Architect

    4 days ago

    Bengaluru, Karnataka, India beBeeCloud Full time

    Cloud Data Platform SpecialistAs a Cloud Data Platform Specialist, you will be responsible for designing, implementing, and managing cloud data platforms on Azure, ensuring their stability, security, and performance.You will work closely with development, operations, and security teams to architect, deploy, and manage cloud-based solutions that meet business...

  • Azure Data Warehouse Expert

    1 day ago

    Bengaluru, Karnataka, India beBeeDataWarehouse Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Warehouse Solutions ArchitectA highly available and scalable data warehouse solution is necessary to handle large volumes of data and concurrent user queries. The role requires the design and implementation of a data warehouse using Azure Synapse Analytics, ensuring high availability and scalability across the enterprise.Key Responsibilities:Develop...

  • Data Architect

    4 weeks ago

    Bengaluru, Karnataka, India Tarento Technologies Private Limited Full time

    Job DescriptionRole Summary:The selected candidate will be responsible for designing, developing, and maintaining data pipelines and infrastructure using Microsoft Azure Data, with a strong focus on Azure Synapse Analytics and Spark Data Pools.Key Responsibilities:- Data Pipeline Development: Build and manage end-to-end data pipelines using Azure Data...

  • Data Architect

    2 days ago

    Bengaluru, Karnataka, India Tech Mahindra Full time

    Data ArchitectJob Summary:** We are seeking a highly skilled Senior Data Architect with extensive experience in data modeling, Azure Databricks, Azure OpenAI, and associated services. The ideal candidate will be responsible for designing and implementing a scalable, secure, and reliable global data store that supports both batch and near-real-time processing...

  • Senior Azure Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Landmark Group Full time

    Designation Azure Data EngineerLocation Bengaluru IndiaTop SkillsCloud Azure Technologies Azure Data Factory Azure Data Lake Storage Azure Synapse Analytics and Azure Databricks Synapse for complex stored proceduresProgramming Scripting Proficiency in Python SQL compulsory and Scala hands-on experience with PLSQLData Expertise Data modelling ...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Hashone Careers Private Limited Full time

    Job Description1. Design, develop, and maintain data pipelines using Azure Data Factory2. Create and manage data models in PostgreSQL, ensuring efficient data storage and retrieval.3. Optimize query performance and database performance in PostgreSQL, including indexing, query tuning, and performance monitoring.4. Strong knowledge on data modeling and mapping...