Big Data Architect

1 week ago

Bengaluru Karnataka, India Virtusa Full time

Position: Big data architect
- Location: BLR
- Primary skills: Big data hadoop spark & aws
- Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.
Performed database health checks and tuned the databases using Teradata Manager.
Develop and maintain data platforms using Python
Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity
Collaborate with crossfunctional teams to understand data requirements and design solutions that meet business needs
Implement and manage agents for monitoring, logging, and automation within AWS environments
Handling migration from PySpark to AWS

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Big Data Architect

    1 week ago

    Bengaluru, Karnataka, India Unison Consulting Full time

    **Responsibilities**: Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Big Data Architect

    2 weeks ago

    Bengaluru, India Cognizant Full time

    Hadoop Solution Architect: Big Data Solution Architect | Hadoop Solution Architect: Big Data Solution Architect Hadoop Solution Architect: Big Data Solution Architect Job Information Required skills and experience Minimum of 15 years; experience in diverse data environments. Extensive Database and Data Analysis technology skills and experience. Requires...

  • Big Data Architect

    2 months ago

    Bengaluru, Karnataka, India Databricks Full time

    CSQ125R30 As a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their **big data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and...

  • Big Data Architect

    2 months ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Big Data Architect

    4 days ago

    Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Big data architect

    2 months ago

    Bengaluru, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive...

  • Big data architect

    3 weeks ago

    Bengaluru, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive...

  • Big data architect

    3 days ago

    Bengaluru, Karnataka, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive...

  • Big Data Solution Architect

    4 weeks ago

    Bengaluru, Karnataka, India EPAM Systems Full time

    RESPONSIBILITIES - Design data analytics solutions by utilising the big data technology stack - Create and present solution architecture documents with deep technical details - Work closely with business in identifying solution requirements and key case-studies/scenarios for future solutions - Conduct solution architecture review/audit, calculate and present...

  • Big Data Architect

    2 months ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...

  • Big Data Architect

    4 days ago

    Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. ...

  • Big Data Architect

    3 weeks ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...

  • Application Architect: Big Data

    2 weeks ago

    Bengaluru, Karnataka, India IBM Full time

    Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centres (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centres offer our clients locally based skills and technical expertise to drive innovation and adoption of...

  • Big Data Architect

    2 months ago

    Bengaluru, India Bizessence Full time

    **Job Description**: - Overall experience of over 8+ years in big data space in leading projects or unit of work. - Experience in architecting, designing, and delivering data pipelining solutions in cloud technologies such as Azure Synapse, AWS EMR, Databricks or Snowflake. Certifications are a plus. - Project experience in Data Warehousing, Business...

  • Big Data Architect

    2 months ago

    Bengaluru, India RARR Technologies Full time

    **Job Details - Big Data Architect**: **Job ID**: - RARR Job 2839**Job Title**: - Big Data Architect**Job Type**: - Permanent**Job Location**: - BENGALURU / BANGALORE, NAGPUR, PUNE**Total Experience**: - 10 - 15 Years**Skills**: - JAVA, SPARK**Posted - **05/01/2023 **Job Description**: - Roles and Responsibilities of role - Development of customer...

  • Big Data Architect

    2 months ago

    Bengaluru, India Bizessence Pty Ltd Full time

    Centelon is a modern, young technology company that carries an unflinching passion to help clients innovate, adapt and succeed. We are a business-technology products, solutions and services company. At Centelon, we harness the power of AI, digital and other emerging technologies to help our clients adapt to the evolving world. Centelon is a trusted partner...

  • Azure Big Data Architect

    2 months ago

    Bengaluru, India Tiger Analytics Full time

    Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. - Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work with teams that push the...

  • Big data architect

    2 weeks ago

    Bengaluru, India Virtusa Full time

    Big data architect - CREQ185795 DescriptionPosition: Big data architectLocation: BLRPrimary skills: Big data hadoop spark & awsExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala....

  • Big data architect

    2 months ago

    Bengaluru, India Virtusa Full time

    Big data architect - CREQ185795 DescriptionPosition: Big data architectLocation: BLRPrimary skills: Big data hadoop spark & awsExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala....

  • Azure Big Data Architect

    2 weeks ago

    Bengaluru, India Tiger Analytics Full time

    Job DescriptionTiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset.Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work with teams...