EY - Data Architect - Azure/Data Ingestion

3 weeks ago

Hyderabad, India Ernst and Young LLP Full time

Job Description :

We are seeking a highly skilled and experienced Enterprise Data Architect with expertise in Azure Cloud and Data Ingestion Systems to join our team. As an Enterprise Data Architect, you will play a crucial role in designing and implementing scalable and efficient data ingestion systems and strategies, leveraging Azure Cloud technologies. Your expertise in Azure and data ingestion will be essential in ensuring seamless, reliable, and accurate data processing and integration across our enterprise.

Responsibilities :

- Knowledge and experience in Lake house architecture .

- Strong knowledge & Experience in Snowflake.

- Experience in Azure storages(Data lake store gen2) & databases(Synapse , SqlDB & Cosmos)

- Experience in structure & semi structure(XML & Json) data ingestion.

- Design and develop end-to-end data ingestion frameworks and solutions using Azure Cloud services, ensuring efficient and reliable data integration from various sources into our enterprise data ecosystem.

- Collaborate with business stakeholders, data scientists, data engineers, and software developers to understand data requirements and design the most suitable data ingestion strategies and architectures.

- Evaluate and select appropriate Azure Cloud services for data ingestion, including Azure Data Factory, Kafka , PySpark and others, based on project requirements.

- Define and implement data ingestion patterns and best practices, considering data governance, security, privacy, scalability, and performance requirements.

- Develop and maintain data pipeline orchestration and monitoring frameworks to ensure the smooth and reliable operation of data ingestion processes.

- Optimize data ingestion workflows and architectures to support real-time and batch processing of large volumes of data from diverse sources.

- Implement data quality checks, error handling, and data validation mechanisms within data ingestion systems to ensure data accuracy and integrity.

- Stay up-to-date with the latest Azure Cloud technologies and industry trends related to data ingestion and recommend improvements and enhancements to existing processes.

- Collaborate with other data architects, database administrators, and infrastructure teams to ensure the integration of data ingestion systems with data storage, data processing, and data analytics solutions.

- Provide technical guidance and mentorship to data engineers and data integration teams, fostering knowledge sharing and promoting best practices.

Requirements :

- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.

- 8+ years of experience as a Data Architect or similar role, with expertise in data ingestion systems and Azure Cloud.

- Strong proficiency in Azure Cloud services and tools for data ingestion, such as Azure Data Factory, Azure Event Hubs, Azure Stream Analytics, Azure Logic Apps, and others.

- Proven experience in designing and implementing complex data ingestion frameworks and architectures for large-scale enterprise environments.

- In-depth understanding of data ingestion patterns, data integration techniques, and best practices.

- Solid understanding of data governance, data security, and privacy requirements.

- Proficiency in programming languages such as Python, SQL, or Scala for data manipulation and transformation.

- Strong problem-solving and analytical skills, with the ability to architect and troubleshoot complex data ingestion systems.

- Excellent communication and collaboration skills to work effectively with cross-functional teams and stakeholders.

- Relevant certifications in Azure Cloud and/or Data Engineering is a plus.

If you are an experienced Enterprise Data Architect with expertise in Azure Cloud and Data Ingestion Systems, and have a passion for designing robust and scalable data integration solutions, we invite you to join our team. We offer a challenging and dynamic work environment where you will have the opportunity to make a significant impact on our enterprise data ecosystem and contribute to the success of our data-driven initiatives.

(ref:hirist.tech)

  • EY - Data Architect - Azure/Data Ingestion

    3 weeks ago

    Hyderabad, India Ernst and Young LLP Full time

    Job Description :We are seeking a highly skilled and experienced Enterprise Data Architect with expertise in Azure Cloud and Data Ingestion Systems to join our team. As an Enterprise Data Architect, you will play a crucial role in designing and implementing scalable and efficient data ingestion systems and strategies, leveraging Azure Cloud technologies....

  • EY - Data Architect - Azure/Data Ingestion

    2 months ago

    Hyderabad, India Ernst and Young LLP Full time

    Job Description :We are seeking a highly skilled and experienced Enterprise Data Architect with expertise in Azure Cloud and Data Ingestion Systems to join our team. As an Enterprise Data Architect, you will play a crucial role in designing and implementing scalable and efficient data ingestion systems and strategies, leveraging Azure Cloud technologies....

  • EY - Data Architect - Azure/Data Ingestion

    7 days ago

    Hyderabad, Telangana, India Ernst and Young LLP Full time

    Job Description :We are seeking a highly skilled and experienced Enterprise Data Architect with expertise in Azure Cloud and Data Ingestion Systems to join our team. As an Enterprise Data Architect, you will play a crucial role in designing and implementing scalable and efficient data ingestion systems and strategies, leveraging Azure Cloud technologies....

  • EY - Data Architect - Azure/Data Ingestion

    2 months ago

    hyderabad, India Ernst and Young LLP Full time

    Job Description :We are seeking a highly skilled and experienced Enterprise Data Architect with expertise in Azure Cloud and Data Ingestion Systems to join our team. As an Enterprise Data Architect, you will play a crucial role in designing and implementing scalable and efficient data ingestion systems and strategies, leveraging Azure Cloud technologies....

  • EY - Data Architect - Azure/Data Ingestion

    3 weeks ago

    Hyderabad, Telangana, India Ernst and Young LLP Full time

    Job Description :We are seeking a highly skilled and experienced Enterprise Data Architect with expertise in Azure Cloud and Data Ingestion Systems to join our team. As an Enterprise Data Architect, you will play a crucial role in designing and implementing scalable and efficient data ingestion systems and strategies, leveraging Azure Cloud technologies....

  • EY - Data Architect - Azure/Data Ingestion

    2 months ago

    Hyderabad, Telangana, India Ernst and Young LLP Full time

    Job Description :We are seeking a highly skilled and experienced Enterprise Data Architect with expertise in Azure Cloud and Data Ingestion Systems to join our team. As an Enterprise Data Architect, you will play a crucial role in designing and implementing scalable and efficient data ingestion systems and strategies, leveraging Azure Cloud technologies....

  • Azure Architect

    3 weeks ago

    Delhi NCR/Bangalore/Pune/Chennai/Mumbai/Hyderabad, India ACZ Global Private Limited Full time

    Experience Needed: - 9 -14 years of industry experience and at least 3 years of experience in architect role is required along with at least 3 to 4 years' experience designing and building analytics solutions in Azure. - Experience in architecting data ingestion/integration frameworks capable of processing structured, semi-structured & unstructured data...

  • Azure Architect

    2 months ago

    Delhi NCR/Bangalore/Pune/Chennai/Mumbai/Hyderabad, IN ACZ Global Private Limited Full time

    Experience Needed: - 9 -14 years of industry experience and at least 3 years of experience in architect role is required along with at least 3 to 4 years' experience designing and building analytics solutions in Azure. - Experience in architecting data ingestion/integration frameworks capable of processing structured, semi-structured & unstructured data...

  • Azure Architect

    2 months ago

    Delhi NCR/Bangalore/Pune/Chennai/Mumbai/Hyderabad, India ACZ Global Private Limited Full time

    Experience Needed: - 9 -14 years of industry experience and at least 3 years of experience in architect role is required along with at least 3 to 4 years' experience designing and building analytics solutions in Azure. - Experience in architecting data ingestion/integration frameworks capable of processing structured, semi-structured & unstructured data...

  • Azure Data Engineer

    7 days ago

    Hyderabad, Telangana, India Ztek Consulting Full time

    Hi,I would like to share an excellent opening for a full-time "Azure Data Engineer (Production Support)" do go through the details and kindly send me your updated resumeLocation :Hyderabad Telangana (Onsite)Job Description :Must have : Azure, ADF, Pyspark, SQL At least three years of professional experience in designing and engineering/architecting Data...

  • Azure Data Engineer

    7 days ago

    Hyderabad, Telangana, India Ztek Consulting Full time

    Hi, I would like to share an excellent opening for a full-time "Azure Data Engineer (Production Support)" do go through the details and kindly send me your updated resume.Location : Hyderabad Telangana (Onsite)Job Description : Must have : Azure, ADF, Pyspark, SQL At least three years of professional experience in designing and engineering/architecting Data...

  • Azure Data Engineer

    7 days ago

    Hyderabad, Telangana, India Ztek Consulting Full time

    Hi,I would like to share an excellent opening for a full-time "Azure Data Engineer (Production Support)" do go through the details and kindly send me your updated resume.Location: Hyderabad Telangana (Onsite)Job Description :Must have : Azure, ADF, Pyspark, SQL• At least three years of professional experience in designing and engineering/architecting Data...

  • Azure Data Engineer

    7 days ago

    Hyderabad, Telangana, India Ztek Consulting Full time

    Hi,I would like to share an excellent opening Full time"Azure Data Engineer"do go through the details and kindly send me your updated resume.Location : Hyderabad Telangana (Onsite)Job Description :Must have : Azure, ADF, Pyspark, SQL At least three years of professional experience in designing and engineering/architecting Data platform (Entity based)....

  • Azure Data Engineer

    7 days ago

    Hyderabad, Telangana, India Ztek Consulting Full time

    Hi, I would like to share an excellent opening Full time "Azure Data Engineer" do go through the details and kindly send me your updated resumeLocation :Hyderabad Telangana (Onsite)Job Description : Must have : Azure, ADF, Pyspark, SQL At least three years of professional experience in designing and engineering/architecting Data platform (Entity based). ...

  • Data Engineer

    1 month ago

    Hyderabad, India Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • Data Engineer

    3 weeks ago

    Hyderabad, India Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • Azure Data Engineer

    1 week ago

    hyderabad, India Ztek Consulting Full time

    Hi,I would like to share an excellent opening for a full-time “Azure Data Engineer (Production Support)” do go through the details and kindly send me your updated resume.Location : Hyderabad Telangana (Onsite)Job Description :Must have : Azure, ADF, Pyspark, SQL• At least three years of professional experience in designing and...

  • Data Engineer

    1 month ago

    Hyderabad/Chennai/Pune, IN Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • Data Engineer

    1 month ago

    Hyderabad/Chennai/Pune, India Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • Data Engineer

    3 weeks ago

    Hyderabad/Chennai/Pune, IN Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...