EY - Data Architect - Azure/Data Ingestion

4 weeks ago

Hyderabad, India Ernst and Young LLP Full time

Job Description :

We are seeking a highly skilled and experienced Enterprise Data Architect with expertise in Azure Cloud and Data Ingestion Systems to join our team. As an Enterprise Data Architect, you will play a crucial role in designing and implementing scalable and efficient data ingestion systems and strategies, leveraging Azure Cloud technologies. Your expertise in Azure and data ingestion will be essential in ensuring seamless, reliable, and accurate data processing and integration across our enterprise.

Responsibilities :

- Knowledge and experience in Lake house architecture .

- Strong knowledge & Experience in Snowflake.

- Experience in Azure storages(Data lake store gen2) & databases(Synapse , SqlDB & Cosmos)

- Experience in structure & semi structure(XML & Json) data ingestion.

- Design and develop end-to-end data ingestion frameworks and solutions using Azure Cloud services, ensuring efficient and reliable data integration from various sources into our enterprise data ecosystem.

- Collaborate with business stakeholders, data scientists, data engineers, and software developers to understand data requirements and design the most suitable data ingestion strategies and architectures.

- Evaluate and select appropriate Azure Cloud services for data ingestion, including Azure Data Factory, Kafka , PySpark and others, based on project requirements.

- Define and implement data ingestion patterns and best practices, considering data governance, security, privacy, scalability, and performance requirements.

- Develop and maintain data pipeline orchestration and monitoring frameworks to ensure the smooth and reliable operation of data ingestion processes.

- Optimize data ingestion workflows and architectures to support real-time and batch processing of large volumes of data from diverse sources.

- Implement data quality checks, error handling, and data validation mechanisms within data ingestion systems to ensure data accuracy and integrity.

- Stay up-to-date with the latest Azure Cloud technologies and industry trends related to data ingestion and recommend improvements and enhancements to existing processes.

- Collaborate with other data architects, database administrators, and infrastructure teams to ensure the integration of data ingestion systems with data storage, data processing, and data analytics solutions.

- Provide technical guidance and mentorship to data engineers and data integration teams, fostering knowledge sharing and promoting best practices.

Requirements :

- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.

- 8+ years of experience as a Data Architect or similar role, with expertise in data ingestion systems and Azure Cloud.

- Strong proficiency in Azure Cloud services and tools for data ingestion, such as Azure Data Factory, Azure Event Hubs, Azure Stream Analytics, Azure Logic Apps, and others.

- Proven experience in designing and implementing complex data ingestion frameworks and architectures for large-scale enterprise environments.

- In-depth understanding of data ingestion patterns, data integration techniques, and best practices.

- Solid understanding of data governance, data security, and privacy requirements.

- Proficiency in programming languages such as Python, SQL, or Scala for data manipulation and transformation.

- Strong problem-solving and analytical skills, with the ability to architect and troubleshoot complex data ingestion systems.

- Excellent communication and collaboration skills to work effectively with cross-functional teams and stakeholders.

- Relevant certifications in Azure Cloud and/or Data Engineering is a plus.

If you are an experienced Enterprise Data Architect with expertise in Azure Cloud and Data Ingestion Systems, and have a passion for designing robust and scalable data integration solutions, we invite you to join our team. We offer a challenging and dynamic work environment where you will have the opportunity to make a significant impact on our enterprise data ecosystem and contribute to the success of our data-driven initiatives.

(ref:hirist.tech)

  • EY - Data Architect - Azure/Data Ingestion

    4 weeks ago

    Hyderabad, India Ernst and Young LLP Full time

    Job Description :We are seeking a highly skilled and experienced Enterprise Data Architect with expertise in Azure Cloud and Data Ingestion Systems to join our team. As an Enterprise Data Architect, you will play a crucial role in designing and implementing scalable and efficient data ingestion systems and strategies, leveraging Azure Cloud technologies....

  • EY - Data Architect - Azure/Data Ingestion

    1 month ago

    hyderabad, India Ernst and Young LLP Full time

    Job Description :We are seeking a highly skilled and experienced Enterprise Data Architect with expertise in Azure Cloud and Data Ingestion Systems to join our team. As an Enterprise Data Architect, you will play a crucial role in designing and implementing scalable and efficient data ingestion systems and strategies, leveraging Azure Cloud technologies....

  • Azure Architect

    4 weeks ago

    Delhi NCR/Bangalore/Pune/Chennai/Mumbai/Hyderabad, India ACZ Global Private Limited Full time

    Experience Needed: - 9 -14 years of industry experience and at least 3 years of experience in architect role is required along with at least 3 to 4 years' experience designing and building analytics solutions in Azure. - Experience in architecting data ingestion/integration frameworks capable of processing structured, semi-structured & unstructured data...

  • Data Engineer

    2 weeks ago

    Hyderabad, India Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • Data Engineer

    2 weeks ago

    Hyderabad/Chennai/Pune, India Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • Senior Data Architect

    5 days ago

    hyderabad, India Insight Global Full time

    Required Skills and Experience *- 7+ years of experience of data architecture and engineering experience with a focus in the Azure tech stack- Proficient with SQL, PySpark, Azure cloud, Azure data lake, Azure data warehouse, Azure data catalogues, and Azure Power View- In depth knowledge of ServiceNow and ServiceNow's ITSM and ITOM modules- Experience with...

  • Azure Data Factory

    2 weeks ago

    Hyderabad, India Tekwissen India Full time

    Overview:TekWissen Group is a workforce management provider throughout the India and many other countries inthe world. The below job opportunity is one of Our clients which is a leading Digital solution company for Business IT solutions.Position:Senior Solutions ArchitectLocation: BangaloreJob Type: Full TimeWork Type: OnsiteJob Description:Azure Data...

  • Azure Data engineer

    1 month ago

    Hyderabad, India Trigyn Technologies Full time

    Job Description:Trigyn has an opportunity Azure Data Engineer. This resource will work at our client sites in Mumbai/Pune/Chennai/Bangalore/Hyderabad.Job Responsibilities:Azure Data engineer to deliver the new Data Strategy and Data Governance projects. The resource must have experience in Incorta and Oracle Cloud and be highly skilled in SQL and ETL data...

  • Senior Data Architect

    6 days ago

    Hyderabad, India Insight Global Full time

    Required Skills and Experience *- 7+ years of experience of data architecture and engineering experience with a focus in the Azure tech stack- Proficient with SQL, PySpark, Azure cloud, Azure data lake, Azure data warehouse, Azure data catalogues, and Azure Power View- In depth knowledge of ServiceNow and ServiceNow's ITSM and ITOM modules- Experience with...

  • Senior Data Architect

    5 days ago

    Hyderabad, India Insight Global Full time

    Required Skills and Experience *- 7+ years of experience of data architecture and engineering experience with a focus in the Azure tech stack- Proficient with SQL, PySpark, Azure cloud, Azure data lake, Azure data warehouse, Azure data catalogues, and Azure Power View- In depth knowledge of ServiceNow and ServiceNow's ITSM and ITOM modules- Experience with...

  • Senior Data Architect

    5 days ago

    hyderabad, India Insight Global Full time

    Required Skills and Experience * - 7+ years of experience of data architecture and engineering experience with a focus in the Azure tech stack - Proficient with SQL, PySpark, Azure cloud, Azure data lake, Azure data warehouse, Azure data catalogues, and Azure Power View - In depth knowledge of ServiceNow and ServiceNow's ITSM and ITOM modules - Experience...

  • Azure Architect

    1 month ago

    hyderabad, India Anicalls (Pty) Ltd Full time

    • 10-15 years of industry experience and at least 5 years of experience in an architect role is required, along with at least 3-5 years experience designing and building analytics solutions in Azure.• Demonstrated in-depth skills with Azure Data Factory, Azure Synapse, ADLS with the ability to configure and administrate all aspects of SQL Server.•...

  • Azure Data engineer

    1 month ago

    Hyderabad, India Trigyn Technologies Full time

    Job Description: Trigyn has an opportunity Azure Data Engineer. This resource will work at our client sites in Mumbai/Pune/Chennai/Bangalore/Hyderabad. Job Responsibilities: Azure Data engineer to deliver the new Data Strategy and Data Governance projects. The resource must have experience in Incorta and Oracle Cloud and be highly skilled in SQL and...

  • Azure Data Factory

    2 weeks ago

    hyderabad, India Tekwissen India Full time

    Overview: TekWissen Group is a workforce management provider throughout the India and many other countries inthe world. The below job opportunity is one of Our clients which is a leading Digital solution company for Business IT solutions. Position: Senior Solutions Architect Loca tion: Bangalore Job Type: Full Time Work...

  • Azure Data Engineer

    1 month ago

    hyderabad, India Encora Inc. Full time

    Proficiency in data manipulation and processing techniques, with experience using Azure data services (e.g., Azure Data Lake, Azure SQL Database, Azure Cosmos DB).Skilled in implementing data ingestion and transformation pipelines tailored for AI/ML workloads, with a focus on real-time data processing where necessary.Understanding of data schema design and...

  • Architect-Data Modeling

    17 hours ago

    Hyderabad, India Hashtag global solution Full time

    Architect-Data Modeling Chennai, Hyderabad, Bangalore JOB DESCRIPTION Job Title: Architect - Data Modeling Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, our 2800+ tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and...

  • Aptus Data Labs

    2 days ago

    Mumbai/Bangalore/Hyderabad, India Aptus Data Labs Full time

    Job Description Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services Role : Azure Sr ConsultantExperience : 10 - 16 YearsLocation : Mumbai/Hyderabad/Bangalore (Onsite)Skill : Azure Cloud, Databricks, Data Quality, Data Governance & Modelling, ETL (Azure data...

  • Azure Data Architect

    1 month ago

    Hyderabad, India ProArch Full time

    This role is key a hire for ProArch. The successful applicant will join our CTO Office and be on the forefront of innovation and customer success in the Azure data space. Working with the ProArch CTO you will build and contribute to our intellectual property (methods, accelerators, demos, etc), define solutions for customers and be a subject matter expert...

  • Azure Data Architect

    1 month ago

    hyderabad, India ProArch Full time

    This role is key a hire for ProArch. The successful applicant will join our CTO Office and be on the forefront of innovation and customer success in the Azure data space. Working with the ProArch CTO you will build and contribute to our intellectual property (methods, accelerators, demos, etc), define solutions for customers and be a subject matter expert...

  • Azure Data Architect

    1 month ago

    Hyderabad, India Virtusa Full time

    Azure Data Architect - CREQ184582 DescriptionSkill – Azure Data Lead / ArchLocation – HyderabadWork mode – 5 days officeWork timings – 12 PM to 9 PMJD:· Must have work experience in Azure Synapse, Python,Pyspark and ADF.· Strong in writing SQL query, stored procedure and functions with hands-on in Power BI. Relevant Experience in Power BI, SSIS and...