Big data architect

4 weeks ago

bangalore, India Virtusa Full time
Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.
Performed database health checks and tuned the databases using Teradata Manager.
Develop and maintain data platforms using Python
Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity
Collaborate with crossfunctional teams to understand data requirements and design solutions that meet business needs
Implement and manage agents for monitoring, logging, and automation within AWS environments
Handling migration from PySpark to AWS Primary Location Bangalore, Karnataka, India Job Type Experienced Primary Skills Ab Initio, Java, PySpark, Python Years of Experience 12 Qualification

Education qualification: Any degree or equivalent

Experience: 10+ years

Travel No

  • Big Data Architect

    4 weeks ago

    bangalore, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. ...

  • Big Data Architect

    4 weeks ago

    bangalore, India I Square Soft Full time

    Big Data Architect Job Description Candidate is responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design, Infra design and build, testing, and deployment This position requires building the Bigdata/Hadoop/NoSQL DB capability in Infrastructure services under...

  • DigiHelic - Senior Data Architect - Big Data Technologies

    3 weeks ago

    Any Location/Bangalore/Chennai, IN Digihelic Solutions Pvt. Ltd. Full time

    Job Summary :We are seeking a highly skilled and motivated Product Solution Architect with extensive expertise in designing and implementing cutting-edge big-data solutions on the Amazon Web Services (AWS) platform.As a key member of our dynamic team, you will play a pivotal role in driving the success of our data-driven initiatives, leveraging AWS services...

  • DigiHelic - Senior Data Architect - Big Data Technologies

    2 weeks ago

    Any Location/Bangalore/Chennai, India Digihelic Solutions Pvt. Ltd. Full time

    Job Summary :We are seeking a highly skilled and motivated Product Solution Architect with extensive expertise in designing and implementing cutting-edge big-data solutions on the Amazon Web Services (AWS) platform.As a key member of our dynamic team, you will play a pivotal role in driving the success of our data-driven initiatives, leveraging AWS services...

  • Solution Architect

    3 weeks ago

    Bangalore/Gurgaon/Gurugram/Chandigarh, IN USEReady Technology Pvt. Ltd. Full time

    Job Title : Solutions Architect (Data & BI)Job Description : Solutions Architect (Data & BI) with around 10 - 15 years of experience in the following areas,Mandatory Skills :- Tableau, Big Data, Hadoop, Data Warehousing, Legacy BI Migrations, Cloud technologies.- Experienced in BI Implementation, BI migration involving Tableau.Preferred Skills : Starburst,...

  • Solution Architect

    4 weeks ago

    Bangalore,Gurgaon,Gurugram,Chandigarh, India USEReady Technology Pvt. Ltd. Full time

    Job Title : Solutions Architect (Data & BI)Job Description : Solutions Architect (Data & BI) with around 10 - 15 years of experience in the following areas,Mandatory Skills :- Tableau, Big Data, Hadoop, Data Warehousing, Legacy BI Migrations, Cloud technologies.- Experienced in BI Implementation, BI migration involving Tableau.Preferred Skills : Starburst,...

  • Unison Consulting

    3 weeks ago

    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....

  • Unison Consulting

    1 week ago

    bangalore, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....

  • Unison Consulting

    2 weeks ago

    Bangalore, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....

  • Databricks Architect

    1 week ago

    Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...

  • Databricks Architect

    7 days ago

    bangalore, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...

  • Databricks Architect

    7 days ago

    Bangalore, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...

  • Data Architect

    3 weeks ago

    Bangalore, Karnataka, India Augmentedresourcing Pvt. Ltd. Full time

    Data Architect for our MNC Client Based in Bangalore.Job Description :This is a hands-on technology position for a data technology leader with specialized business knowledge in the middle/front office areas. The candidate is someone with a proven record of technology project execution for data on the cloud, able to get hands-on when it comes to analysis...

  • Data Architect

    2 weeks ago

    Bangalore, India Augmentedresourcing Pvt. Ltd. Full time

    Data Architect for our MNC Client Based in Bangalore.Job Description :This is a hands-on technology position for a data technology leader with specialized business knowledge in the middle/front office areas. The candidate is someone with a proven record of technology project execution for data on the cloud, able to get hands-on when it comes to analysis...

  • Data Architect

    1 week ago

    bangalore, India Augmentedresourcing Pvt. Ltd. Full time

    Data Architect for our MNC Client Based in Bangalore.Job Description :This is a hands-on technology position for a data technology leader with specialized business knowledge in the middle/front office areas. The candidate is someone with a proven record of technology project execution for data on the cloud, able to get hands-on when it comes to analysis...

  • Big Data Architect

    3 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full time

    About the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...

  • Big Data Architect

    3 weeks ago

    Bangalore,Anywhere in India,Multiple Locations ARR Recruitment Solutions Full time

    About the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...

  • Senior Big Data Architect/Technical Lead

    2 weeks ago

    Bangalore, India Sumeru Global Technologies Full time

    Job Title : Senior Big Data Architect and Technical Lead. Location : Bangalore. Job Description : We are seeking a highly skilled and experienced Senior Big Data Architect and Technical Lead to join our dynamic team. As a key member of our Big Data division, you will be responsible for providing technical leadership, guiding teams, and driving innovation in...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Muoro Full time

    Job Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, India Muoro Full time

    Job Description : About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions...