Big Data Architect

3 months ago

Chennai, India Selsoftinc Full time

Job Description :

- Design and implement scalable big data architectures on Microsoft Azure and Azure Fabric to handle large volumes of data efficiently and securely.

- Develop and manage data pipelines for ingesting, processing, and analyzing large datasets, ensuring data quality and integrity.

- Collaborate with data scientists, data engineers, and business stakeholders to understand data requirements and design solutions that meet business needs.

- Integrate data from multiple sources and platforms into a unified data architecture, ensuring seamless data flow and accessibility across the organization.

- Develop and maintain data storage solutions, including data lakes and data warehouses, using Azure services such as Azure Data Lake, Azure Synapse Analytics, and Azure Cosmos DB.

- Implement data security and compliance measures to protect sensitive information and ensure adherence to industry standards and regulations.

- Optimize data processing and storage for performance, scalability, and cost-effectiveness, leveraging Azure services like Azure Databricks and HDInsight.

- Lead the design and implementation of real-time data streaming solutions using Azure Stream Analytics and Event Hubs.

- Develop and implement data governance frameworks to manage data quality, data lineage, and data cataloging.

- Design and implement machine learning and AI solutions on big data platforms to support advanced analytics and predictive modeling.

- Ensure high availability and disaster recovery for big data systems, implementing strategies such as data replication and failover mechanisms.

- Provide technical leadership and guidance to data engineering teams, ensuring best practices in data architecture and engineering.

- Collaborate with IT and security teams to integrate big data solutions with enterprise systems and ensure compliance with security policies.

- Stay updated on the latest advancements in big data technologies and Microsoft Azure services and incorporate new features and tools into the organization's data architecture.

- Lead and participate in data architecture reviews and technical discussions, providing insights and recommendations for continuous improvement.

- Develop and maintain documentation for data architectures, data pipelines, and best practices, ensuring clarity and accessibility for team members.

- Conduct training and workshops for internal teams to promote knowledge sharing and best practices in big data and cloud computing.

Requirements :

- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.

- Extensive experience in big data architecture, with a focus on Microsoft Azure and Azure Fabric.

- Strong proficiency in data processing technologies such as Hadoop, Spark, and Kafka, particularly within the Azure ecosystem.

- In-depth knowledge of Azure data services, including Azure Data Lake, Azure Synapse Analytics, Azure Cosmos DB, and Azure Databricks.

- Proficiency in data modeling, data integration, and data management best practices.

- Experience with data security and compliance, including knowledge of GDPR, HIPAA, and other industry regulations.

- Strong analytical and problem-solving skills, with the ability to design and implement effective data solutions.

- Excellent communication and stakeholder management skills, with the ability to present technical concepts to non-technical audiences.

- Azure certifications such as Microsoft Certified: Azure Solutions Architect Expert or Microsoft Certified Azure

- Data Engineer Associate are preferred.

(ref:hirist.tech)

  • Senior Big Data Architect

    2 weeks ago

    Chennai, India 1HResource Solutions Full time

        **Role Overview**We are seeking a highly skilled Senior Big Data Architect to lead the design and implementation of our big data platforms. As a key member of our team, you will be responsible for architecting and building large-scale big data platforms to support our data integration projects.**Key Responsibilities**• Design and develop...

  • Big Data Architect

    5 months ago

    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    **Responsibilities**: - Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Big Data Architect

    2 weeks ago

    Bangalore/Pune/Mumbai/Chennai, India a client of change leaders Full time

    Job SummaryWe are seeking a highly skilled Big Data Architect to join our team at a client of change leaders. As a key member of our data engineering team, you will be responsible for designing and implementing scalable Big Data applications and solutions on distributed platforms.Key ResponsibilitiesDesign and implement data pipelines using Snowflake,...

  • Senior Big Data Architect

    5 days ago

    Chennai, Tamil Nadu, India NR Consulting - India Full time

    Job Title: Senior Big Data ArchitectAbout the Role:NR Consulting - India is seeking a highly skilled Senior Big Data Architect to lead our Hadoop to BigQuery migration projects. As a key team member, you will be responsible for designing and implementing scalable solutions that leverage Google Cloud Platform (GCP) technologies, specifically focusing on...

  • Senior Big Data Platform Architect

    2 weeks ago

    Chennai, India 1HResource Solutions Full time

    Job Title: Senior Big Data Platform ArchitectJob Summary:We are seeking a highly skilled Senior Big Data Platform Architect to join our team at 1HResource Solutions. As a Technical Lead for Big Data Engineering, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects.Key Responsibilities:-...

  • Big Data Solutions Architect

    2 weeks ago

    Chennai, Tamil Nadu, India TapTalent Full time

    About Company:TapTalent is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Our extensive domain and technology expertise helps drive superior competitive differentiation customer experiences and business outcomes.Job Description:We are...

  • Big Data Solutions Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    Job Summary:As a Solutions Architect (Big Data) at Databricks, you will work with customers on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other technical tasks to...

  • Solutions Architect

    2 months ago

    Chennai, India Databricks Full time

    FEQ225R141As a Solution Architect (Big data) in our Professional Services team, you will work with customers on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other...

  • Migrations Architect

    2 months ago

    Chennai, India Databricks Full time

    FEQ225R141As a Migrations Architect (Big data) in our Professional Services team, you will work with customers on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and...

  • Big Data Solutions Architect

    3 weeks ago

    Chennai, Tamil Nadu, India a client of change leaders Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at a client of change leaders. The ideal candidate will have a strong background in developing scalable Big Data applications and solutions on distributed platforms.Key Responsibilities:Design and implement data pipelines using Snowflake, PostgreSQL,...

  • Senior Big Data Architect

    6 days ago

    Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

    About the RoleCynosure Corporate Solutions is seeking a highly skilled Senior Big Data Architect to lead the design and development of our big data technologies, leveraging expertise in Azure, AWS, or GCP. The ideal candidate will have a strong background in PySpark, with a minimum of 6 years of experience and a preference for Azure and Databricks....

  • Solution Architect

    1 month ago

    Chennai, India Recro Full time

    Responsibilities :- Work collaboratively with product managers, engineers, and data scientists to understand business requirements and translate them into scalable, secure, and cost-effective big data solutions leveraging AWS services.- Design and document big data architectures that incorporate data ingestion, processing, storage, analytics, and...

  • Data Architect with Big Data Expertise

    2 weeks ago

    Chennai, Tamil Nadu, India TapTalent Full time

    About TapTalent:We are a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.Our extensive domain and technology expertise helps drive superior competitive differentiation, customer experiences, and business outcomes.Job description:We are...

  • Data Architect with Big Data Expertise

    2 weeks ago

    Chennai, Tamil Nadu, India TapTalent Full time

    About TapTalent:We are a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.Our extensive domain and technology expertise helps drive superior competitive differentiation, customer experiences, and business outcomes.Job Requirements:We are...

  • Big Data Solutions Architect

    3 weeks ago

    Bangalore/Pune/Mumbai/Chennai, India a client of change leaders Full time

    Job Title: Big Data EngineerJob Summary: We are seeking a highly skilled Big Data Engineer to join our team. The successful candidate will be responsible for designing and implementing scalable Big Data applications and solutions on distributed platforms.Key Responsibilities:Design and implement data pipelines using Snowflake, PostgreSQL, and...

  • Big Data Solution Architect

    2 days ago

    Chennai, Tamil Nadu, India Epam Full time

    Epic Career OpportunitiesEPAM is a leading global provider of digital platform engineering and development services. We're committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here, you'll collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Data Architect

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Job Title: Data Architect - Big Data and AI SolutionsJob Summary: We are seeking an experienced Data Architect to design and implement scalable data and AI solutions. The ideal candidate will have a deep understanding of data architecture principles, database technologies, and data integration.Responsibilities:Evaluate technologies, tools, and platforms to...

  • Aws Big Data Architect

    5 months ago

    Chennai, Tamil Nadu, India Tiger Analytics Full time

    As an AWS Data Architect), you will analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in AWS. - Analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in AWS. - AWS experts with strong experience in working with modern data...

  • Gcp Big Data Architect

    5 months ago

    Chennai, Tamil Nadu, India Tiger Analytics Full time

    -As an Architect, you will analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in GCP. - Analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in GCP. - GCP experts with strong experience in working with modern data...

  • Big Data Architect

    1 month ago

    Chennai, Tamil Nadu, India Selsoftinc Full time

    Job Description :- Design and implement scalable big data architectures on Microsoft Azure and Azure Fabric to handle large volumes of data efficiently and securely.- Develop and manage data pipelines for ingesting, processing, and analyzing large datasets, ensuring data quality and integrity.- Collaborate with data scientists, data engineers, and business...