Big Data Technology Architect

18 hours ago

Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Description

We are seeking a seasoned technologist to spearhead the development of our Enterprise TruRisk Platform. This is an exciting opportunity to be part of a dynamic team that leverages Big Data & Micro-Services technology to process massive transaction data and drive business-impacting initiatives.

The ideal candidate will have expertise in designing and implementing scalable architectures for Big Data environments, leveraging technologies such as Spark, Kafka, and Presto. Strong leadership skills and the ability to mentor and train others are also essential for this role.

This position requires strong technical knowledge, including experience with performance benchmarking testing for Big Data technologies and troubleshooting skills. Additionally, experience with Agile Management methodologies, OO Modeling, and working on internet, UNIX, Middleware, and database-related projects is highly desirable.

This is a fantastic chance to make a significant impact on the company's technological landscape and shape the future of big data engineering.

Key Responsibilities
  • Lead the design and implementation of Big Data solutions using Spark
  • Develop and maintain scalable architectures for Big Data environments
  • Liaise with product teams, professional services, and sales engineers to ensure solution delivery and trade-off reviews
  • Drive technology explorations and roadmaps
  • Serve as a technical lead on cross-functional departments
  • Ensure the quality of architecture and design of systems
  • Fully understand system interdependencies and limitations
  • Possess expert knowledge in performance, scalability, enterprise system architecture, and engineering best practices
Requirements
  • Bachelor's degree in computer science or equivalent
  • 8+ years of total experience
  • 4+ years of relevant experience in design and architecture Big Data solutions using Spark
  • 3+ years experience in working with engineering resources for innovation
  • 4+ years experience in understanding Big Data events flow pipeline
  • 3+ years experience in performance testing for large infrastructure
  • 3+ In-depth experience in understanding various search solutions (Solr/Elastic)
  • 3+ years experience in Kafka
  • In-depth experience in Data lakes and related ecosystems
  • In-depth experience of messaging queues
  • In-depth experience in giving requirements to build a scalable architecture for Big Data and Micro-services environments
  • In-depth experience in understanding caching components or services
  • Knowledge in Presto technology
  • Knowledge in Airflow
  • Hands-on experience in scripting and automation
  • In-depth understanding of RDBMS/NoSQL, Oracle, Cassandra, Kafka, Redis, Hadoop, Lambda Architecture, Kappa, Kappa++ architectures with Flink data streaming and rule engines
  • Experience in working with ML models engineering and related deployment
  • Design and implement secure big data clusters to meet many compliance and regulatory requirements
  • Experience in leading the delivery of large-scale systems focused on managing the infrastructure layer of the technology stack
  • Strong experience in doing performance benchmarking testing for Big Data technologies
  • Strong troubleshooting skills
  • Experience leading development life cycle process and best practices
  • Experience in Big Data services administration would be added value
  • Experience with Agile Management (SCRUM, RUP, XP), OO Modeling, working on internet, UNIX, Middleware, and database-related projects
  • Experience mentoring/training the engineering community on complex technical issues
  • Project management experience

  • Big Data Solutions Architect

    2 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Big Data Engineer to join our team and drive innovation within our organization.Key Responsibilities-Design, develop, and optimize scalable data engineering solutions leveraging AWS services for large-scale, complex data processing.Build and maintain data pipelines using Spark (Scala) for both structured and unstructured...

  • Senior Big Data Architect

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 30,00,000 - ₹ 40,00,000

    We're looking for a seasoned leader to spearhead our big data initiatives.The ideal candidate will have a proven track record of building scalable and extensible big data platforms, providing the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This role requires strong technical expertise, excellent...

  • Senior Data Architect

    4 days ago

    Rajahmundry, Andhra Pradesh, India Sunfinity Technology Solutions Pvt Ltd Full time

    Location: MumbaiExperience: 8-12 yrsThe Senior Solutions Architect is a leading member of our Professional Services team. Cloudera Senior Solutions Architects function as technical leads and trusted advisors, you will work on some of the most exciting distributed data business problems at private and public sector organizations. Engage from early stage...

  • Expert Big Data Systems Architect

    3 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    At the heart of our data infrastructure lies a critical need for talented professionals skilled in harnessing the power of big data technologies.Job DescriptionWe are seeking an experienced Data Engineer to design, develop, and maintain large-scale data processing systems using cutting-edge technologies such as Azure/AWS Databricks,...

  • Senior Big Data Professional

    2 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    **Data Architect Role**Are you passionate about designing data architectures that power business decision-making?We're seeking a skilled Data Architect to join our team, where you'll work on cutting-edge technologies like PySpark, AWS Glue, and Lambda to create scalable data solutions.Key Responsibilities:Design and implement robust ETL pipelines using...

  • Data Architect

    2 days ago

    Rajahmundry, Andhra Pradesh, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a skilled Data Architect to lead the development of our data pipeline architecture.This role involves designing and implementing scalable data infrastructure using SQL and cloud technologies for seamless data extraction, transformation, and loading from various sources.Key Responsibilities:Design optimal data pipeline architectures...

  • Big Data Expert

    2 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 3,50,00,000

    Job Title: Data Platform ArchitectThe role of a Data Engineer Manager is to provide technical direction for a highly scalable data platform in clinical oncology or the healthcare domain.This includes a tech stack spanning AWS, Python, Terraform, and all the new buzz around AI.A blend of strong technical skills in areas like data architecture, ETL, cloud...

  • Senior Big Data Engineer

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data EngineerAbout the RoleWe are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have a strong background in big data technologies and experience working with large-scale data processing systems.The successful candidate will be responsible for designing, implementing, and maintaining scalable...

  • Big Data Analyst

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data AnalystWe are seeking a skilled professional to join our team as a Big Data Analyst. As a key member of our organization, you will be responsible for analyzing and interpreting complex data sets to inform business decisions.Gathering and analyzing large datasets to identify trends and patternsDeveloping and maintaining databases and data...

  • Cloud Data Architect

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Title: Cloud Data ArchitectWe are seeking an experienced cloud data architect to join our team. As a key member of our organization, you will design and build efficient data pipelines using AWS services like Pyspark, Glue, EMR, lambda, Redshift, Athena, and Iceberg.Data Pipeline Development: Utilize your expertise in AWS services to develop and maintain...