Senior Big Data Architect

18 hours ago

Ahmedabad, Gujarat, India beBeeDataStrategist Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

The most impactful opportunity awaits

Job Description

We are seeking an exceptional Big Data Strategist to spearhead the development of our Enterprise TruRisk Platform. This pioneering project aims to empower customers with unparalleled Cyber Risk Management capabilities.

This role offers a chance to work closely with a talented team of engineers and architects, collaborating on cutting-edge solutions that drive innovation and excellence in the field of big data.

As a key member of our organization, you will be responsible for designing, developing, and supporting a highly scalable and distributed SaaS-based Security Risk Prioritization product.

With access to vast amounts of transactional data, you will have the unique opportunity to leverage open-source technologies and contribute to challenging initiatives that shape the future of our platform.

Main Responsibilities:

  • Pioneer data platform and pipeline strategies along with Risk Evaluation.
  • Provide technical leadership on data platform design, roll out, and evolution.
  • Serve as a liaison to product teams, professional services, and sales engineers on solution reviews and represent engineering in such conversations.
  • Drive technology explorations and roadmaps.
  • Lead complex system architecture and design efforts to ensure quality and performance.
  • Demonstrate expertise in performance, scalability, enterprise system architecture, and engineering best practices.
  • Conduct thorough research and benchmarking of cloud technology against industry standards.
  • Effectively communicate requirements to developers and assist in their career growth.
Required Skills and Qualifications

To excel in this role, you should possess the following skills and qualifications:

  • Bachelor's degree in computer science or equivalent.
  • 8+ years of total experience, with at least 4+ years in design and architecture of Big Data solutions using Spark.
  • 3+ years of experience working with engineering resources for innovation.
  • In-depth understanding of Big Data events flow pipelines.
  • Experience in performance testing for large infrastructure.
  • Familiarity with search solutions like Solr/Elastic.
  • Hands-on experience with Kafka and related ecosystems.
  • Knowledge of Presto technology and Airflow.
  • Strong scripting and automation skills.
  • Expertise in RDBMS/NoSQL, Oracle, Cassandra, Kafka, Redis, Hadoop, lambda architectures, and rule engines.
  • Experience in working with ML models engineering and deployment.
  • Design and implementation of secure Big Data clusters to meet regulatory requirements.
  • Leadership experience in delivering large-scale systems focused on managing infrastructure layers.
  • Strong troubleshooting skills.
  • Experience leading development life cycles and Agile methodologies.
  • Project management experience.

  • Senior Big Data Architect

    4 days ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,01,00,000

    Effective Data Engineering is crucial for any organisation's success. This role requires a Senior Data Engineer to lead the development and implementation of large-scale data architectures.We are looking for an experienced professional who can design and develop complex big data systems, ensuring scalability and performance.Data Architecture: Proven...

  • Big Data Professional

    1 week ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Big Data AnalystA senior big data analyst position is available for a highly skilled professional to leverage their knowledge of big data analytics and drive business outcomes. The ideal candidate will have experience working with large datasets, developing and implementing data-driven solutions, and collaborating with cross-functional teams.Key...

  • Big Data Architect Role

    3 days ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled Data Architect to lead the design and development of large-scale data processing systems. The ideal candidate will have expertise in data processing, architecture, and engineering.Possess strong programming skills in Python and SQL.Familiarity with Terraform or CloudFormation for infrastructure-as-code...

  • Senior Big Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Job Title: Senior Big Data Engineer">We are seeking a highly skilled Senior Big Data Engineer to join our team.">About the Role:">This is an exciting opportunity for an experienced engineer to lead the development of large-scale data processing systems using Apache Spark, Python and AWS services.">Key Responsibilities:">- Design and implement scalable data...

  • Big Data Developer

    4 days ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Unlock the Power of Big Data with Us!Job DescriptionWe are seeking a skilled Big Data Hadoop Scala developer to join our team. As a key member, you will be responsible for architecting, developing, and maintaining our big data ecosystem.Key Responsibilities:Hands-on experience in Scala, Spark, Hive, and Hadoop Big Data Eco System Tools is essential.Strong...

  • Senior Data Architect

    2 days ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We're looking for a skilled data professional to drive our Data/AI Practice forward. This is an exciting opportunity to leverage your expertise in SQL, big data processing, and modern data platforms to make a meaningful impact.Key Responsibilities:Develop and continuously improve data pipelines for large-scale structured and unstructured datasets using SQL...

  • Big Data

    1 week ago

    Ahmedabad, Gujarat, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiNotice Period: 0 - 45 daysJob Description:-Must-HavePySparkHiveGood-to-HaveSparkHBaseDQ toolAgile Scrum experienceExposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Architect

    1 week ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 1,25,00,000 - ₹ 2,25,00,000

    Job OverviewWe are seeking a seasoned Data Architect to design, develop, and maintain large-scale data systems. The ideal candidate will have 5+ years of experience in the field, with a strong foundation in SQL performance tuning and query optimization.Key Responsibilities:Data Warehousing SpecialistDesign and implement high-performance data warehouses using...

  • Senior Data Systems Architect

    4 hours ago

    Ahmedabad, Gujarat, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a highly skilled Senior Data Systems Architect to lead the design, development, and maintenance of our data systems.Develop and implement scalable data pipelines for efficient data ingestion, processing, and storage.Design and optimize data architectures and data models for seamless data storage and retrieval.Create ETL processes...

  • Big Data Specialist

    5 days ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a skilled Big Data Specialist to join our team.Responsibilities:Analyze and process large data sets using Big Data technologiesDevelop and implement scalable data pipelinesWork with cross-functional teams to deliver high-quality solutionsRequirements:2+ years of experience in Big Data engineeringStrong skills in Scala, AWS, and...