Big Data Architect

6 months ago


Bengaluru Karnataka, India Virtusa Full time

Position: Big data architect
- Location: BLR
- Primary skills: Big data hadoop spark & aws
- Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.
Performed database health checks and tuned the databases using Teradata Manager.
Develop and maintain data platforms using Python
Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity
Collaborate with crossfunctional teams to understand data requirements and design solutions that meet business needs
Implement and manage agents for monitoring, logging, and automation within AWS environments
Handling migration from PySpark to AWS

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.


  • Big Data Architect

    6 months ago


    Bengaluru, Karnataka, India Unison Consulting Full time

    **Responsibilities**: Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Big Data Architect

    1 week ago


    Bengaluru, Karnataka, India Telescopp Full time

    Job OverviewWe are seeking a seasoned Big Data Architect to lead the development of scalable big data solutions in Bengaluru. This is a mid-level, full-time position requiring 4-6 years of relevant experience. As a Big Data Architect at Telescopp, you will design and build robust big data infrastructure, develop ETL processes, collaborate with data...

  • Big Data Architect

    2 months ago


    Bengaluru, Karnataka, India AiDash Full time

    **About AiDash** We are a Series C climate tech startup backed by leading investors (including National Grid Partners, G2 Venture Partners, Lightrock, BGV, Marubeni, among others), and by our customers-turned-advocates (Duke Energy & National Grid Partners, among others)! We have been recognized by Forbes two years in a row as one of “America’s Best...


  • Bengaluru, Karnataka, India EPAM Systems Full time

    RESPONSIBILITIES - Design data analytics solutions by utilising the big data technology stack - Create and present solution architecture documents with deep technical details - Work closely with business in identifying solution requirements and key case-studies/scenarios for future solutions - Conduct solution architecture review/audit, calculate and present...


  • Bengaluru, Karnataka, India IBM Full time

    Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centres (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centres offer our clients locally based skills and technical expertise to drive innovation and adoption of...


  • Bengaluru, Karnataka, India NETSACH GLOBAL Full time

    Job Title: Big Data Engineer/ArchitectNetsach Global is seeking a highly skilled Big Data Engineer/Architect to design, develop, and maintain large-scale data processing systems and architecture. The ideal candidate will work closely with data scientists, analysts, and other stakeholders to ensure data systems are scalable, secure, and efficient, enabling...

  • Big Data Architect

    4 weeks ago


    Bengaluru, Karnataka, India Adobe Full time

    Job OverviewAt Adobe, we're seeking an experienced Big Data Architect to join our team. As a key member of our data platform team, you'll be responsible for designing, building, and maintaining our big data platform.Key ResponsibilitiesDesign and implement data processing pipelines using best-in-class technologies.Collaborate with data scientists and product...


  • Bengaluru, India NETSACH GLOBAL Full time

    Greetings from Netsach - A Cyber Security Company.Netsach is currently hiring Big Data Engineer/Architect is responsible for designing, developing, and maintaining large-scale data processing systems and architecture. This role involves working closely with data scientists, analysts, and other stakeholders to ensure data systems are scalable, secure, and...

  • Data Architect

    3 weeks ago


    Bengaluru, Karnataka, India Unison Consulting Pte Ltd Full time

    About the RoleWe are seeking an experienced Data Architect to lead our big data solutions. As a key member of our team, you will design, develop, and maintain large-scale big data architectures to enable data-driven decision making and analytics capabilities for our clients.


  • Bengaluru, India Tiger Analytics Full time

    Job Description Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work with...


  • Bengaluru, Karnataka, India Synechron Full time

    Job Title: Data Architect for Big Data ManagementAbout the Role:We are seeking a highly skilled Data Architect to join our team at Synechron. The ideal candidate will have extensive experience in Informatica Big Data Management and be well-versed in design patterns, Agile, DevOps, and CI/CD principles.Key Responsibilities:The successful candidate will be...

  • Big Data Architect

    3 weeks ago


    Bengaluru, Karnataka, India Expertia AI Full time

    Job Description:We are seeking a highly skilled Big Data Architect to join our team at Expertia AI. This is a unique opportunity for a talented professional to take their career to the next level.About the Role:The successful candidate will design and implement scalable big data transformations and pipelines, leveraging cloud platforms like Azure...


  • Bengaluru, Karnataka, India Covenant Consultants Full time

    Covenant Consultants is a renowned company seeking an experienced Big Data Solutions Architect to spearhead the design and development of cutting-edge data pipelines. The ideal candidate will possess in-depth knowledge of Databricks, Python, Big Data, Apache Spark, and SQL, with experience in building data governance solutions like Unity Catalog and...

  • Big Data Architect

    6 months ago


    Bengaluru, India Databricks Full time

    As a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...


  • Bengaluru, Karnataka, India Bristlecone Full time

    About Bristlecone:We are a company that requires highly skilled professionals to design and develop our data processing pipelines and analytics solutions.As a Senior Big Data Architect at Bristlecone, you will be responsible for architecting scalable and efficient data models and storage solutions on the Databricks platform.You will collaborate with...


  • Bengaluru, Karnataka, India Talpro Full time

    Job OverviewTalpro is seeking an experienced Big Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining scalable data pipelines using Python, PySpark, and Scala.Main Responsibilities- Develop and maintain data pipelines for processing large data sets using...

  • Big Data Architect

    6 months ago


    Bengaluru, India I Square Soft Full time

    Big Data Architect Job Description Candidate is responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design, Infra design and build, testing, and deployment This position requires building the Bigdata/Hadoop/NoSQL DB capability in Infrastructure services under...

  • Big Data Developer

    2 months ago


    Karnataka, India Amossys Consulting Services Full time

    Position Title: Data Engineer Experience Required: 5+ years Employment Type: Full-time Employment Mode: Hybrid Location: Bangalore, Pune, Trivandrum. Industry: Banking & Insurance sector Job Summary: We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate...

  • Big data developer

    2 months ago


    Karnataka, India Amossys Consulting Services Full time

    Position Title: Data Engineer Experience Required: 5+ years Employment Type: Full-time Employment Mode: Hybrid Location: Bangalore, Pune, Trivandrum. Industry: Banking & Insurance sector Job Summary: We are looking for a skilled Data Engineer with hands-on experience in Py Spark and Big Data platforms to join our growing team. The ideal...

  • Data Architect

    2 weeks ago


    Bengaluru, Karnataka, India Kognivera It Solutions Private Limited Full time

    Seeking an experienced Data Architect with a proven track record in designing and implementing scalable big data solutions on distributed platforms. As a key member of our team, you will be responsible for architecting data products using AWS services, data warehousing tools, and designing data platforms.About UsKognivera It Solutions Private Limited is a...