Big data architect

4 weeks ago


Bengaluru, India Virtusa Full time
Big data architect - CREQ185795 Description

Position: Big data architectLocation: BLRPrimary skills: Big data hadoop spark & awsExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.Performed database health checks and tuned the databases using Teradata Manager.Develop and maintain data platforms using PythonWork with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrityCollaborate with crossfunctional teams to understand data requirements and design solutions that meet business needsImplement and manage agents for monitoring, logging, and automation within AWS environmentsHandling migration from PySpark to AWSPrimary Location Bangalore, Karnataka, India Job Type Experienced Primary Skills Ab Initio, Java, PySpark, Python Years of Experience 12 Qualification

Education qualification: Any degree or equivalentExperience: 10+ yearsTravel No
  • Big Data Architect

    4 weeks ago


    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Big data architect

    1 month ago


    Bengaluru, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive...

  • Big Data Architect

    1 month ago


    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...

  • Big Data Architect

    1 month ago


    Bengaluru, Karnataka, India Unison Consulting Full time

    **Responsibilities**: Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Big Data Architect

    4 weeks ago


    Bengaluru, India I Square Soft Full time

    Big Data ArchitectJob DescriptionCandidate is responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design,Infra design and build, testing, and deploymentThis position requires building the Bigdata/Hadoop/NoSQL DB capability in Infrastructure services under Technology...

  • Big Data Architect

    1 month ago


    Bengaluru, India I Square Soft Full time

    Big Data Architect Job Description Candidate is responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design, Infra design and build, testing, and deployment This position requires building the Bigdata/Hadoop/NoSQL DB capability in Infrastructure services under...

  • Big Data Architect

    4 weeks ago


    Bengaluru, India ARR Recruitment Solutions Full time

    About the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...

  • Solutions Architect

    4 weeks ago


    Bengaluru, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...


  • Bengaluru, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Solutions Architect

    1 month ago


    Bengaluru, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Unison Consulting

    3 weeks ago


    Bengaluru, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....

  • Big Data Architect

    56 minutes ago


    Bengaluru, India Adobe Full time

    Our CompanyChanging the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Databricks Architect

    2 weeks ago


    Bengaluru, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...

  • Data Architect

    3 weeks ago


    Bengaluru, India Augmentedresourcing Pvt. Ltd. Full time

    Data Architect for our MNC Client Based in Bangalore.Job Description :This is a hands-on technology position for a data technology leader with specialized business knowledge in the middle/front office areas. The candidate is someone with a proven record of technology project execution for data on the cloud, able to get hands-on when it comes to analysis...

  • Big Data Architect

    15 hours ago


    Bengaluru, India Adobe Full time

    Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...


  • Bengaluru, India resourcetree Full time

    We are looking for a Data Architect with good experience in MS Azure and Hadoop. - 10+ years of technical experience with at-least 2 years on MS Azure and 2 years on Hadoop (CDH/HDP). - With hands-on experience/exposure to NoSQL Database and Data Modelling This role involves a combination of hands-on contribution, customer engagement, and technical team...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, India Hexaware Technologies Full time

    DescriptionData Engineer:Primary : ADF, SQLSeconday : Databricks, Pyspark / Scala, CICD, Data Security, encryptionResponsibilities:•Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned.•Provide support in defining the scope and sizing of the work.•Working closely with various enterprise architects,...

  • Big Data Engineer

    1 month ago


    Bengaluru, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with various...

  • Data Architect

    2 days ago


    Bengaluru, India Programmers.io Full time

    Data Solutions Architect Ability to Conduct Client Workshops and participation in Due Diligence exercises to define a Data Strategy & roadmap that is aligned to their Business & IT Strategy • Heavy pre-sales involvement, right from qualifying the pursuit, to Lead the Pursuit, Collate Questionnaire, collaborate team for responses, conduct review sessions...

  • Big Data Engineer

    2 days ago


    Bengaluru, India Tiger Analytics Full time

    Location- Chennai, Bangalore & Hyderabad As an Azure BDE Senior Data Engineer, you will the design and implementation of data management (Data Lake / Lakehouse/ Data Mesh) solution on the Azure cloud using PaaS services, with Architects in brainstorming, design patterns, doing POCs, implementation of the solution adhering to the defined architecture and...