Senior Data Intelligence Architect

1 week ago

Rajahmundry, Andhra Pradesh, India beBeeDataIntelligence Full time US$ 12,00,000 - US$ 15,00,000
About the Role

We're developing a cutting-edge data intelligence platform using microservices architecture. We need a senior expert to lead the development of our Entity Resolution and Network Generation services.

This is a hands-on technical leadership role where you'll architect and implement distributed graph computing solutions processing billions of entities and relationships.

  • Design and implement distributed entity resolution algorithms capable of processing large datasets
  • Build blocking strategies (e.g. LSH, canopy clustering) optimized for Spark at scale
  • Develop fuzzy matching algorithms leveraging Elasticsearch's capabilities
  • Create ML-enhanced matching with explainable AI for match decisions
  • Implement incremental resolution supporting real-time and batch modes
  • Design APIs for entity lookup with sub-100ms latency requirements
The Platform

We utilize:

  • Microservices architecture with Kubernetes orchestration
  • Apache Spark for distributed processing
  • Elasticsearch for real-time search and fuzzy matching
  • Scala as the primary development language
  • Data mesh principles with API-first design
Core Responsibilities
  • Entity Resolution Service
  • Network Generation Service
  • AI Model Development
  • Explainable AI (XAI)
Cross-Service Responsibilities
  • Ensure seamless integration between entity resolution and network generation
  • Design data lineage tracking across both services
  • Implement comprehensive monitoring and observability
  • Contribute to API design and service contracts
Requirements
  • 7+ years of experience in distributed computing and big data systems
  • 5+ years specifically in entity resolution and graph analytics at scale
  • Expert-level Scala programming skills
  • Deep experience with Apache Spark, including custom optimizations
  • Production experience with Elasticsearch for search and matching
We're Looking For
  • A technical leader who can make architectural decisions and implement them
  • Strong communicator who can explain complex graph concepts to stakeholders
  • Self-directed engineer who can own large technical initiatives end-to-end
  • Performance-obsessed developer who benchmarks everything
Impact You'll Make
  • Define the architecture for entity resolution serving multiple business domains
  • Build the graph intelligence layer powering advanced analytics and ML
  • Create systems that will process billions of entities with millisecond latencies

  • Experienced Data Architect

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Experienced Data ArchitectWe are seeking a senior data expert to join our team. As a key member of the organization, you will be responsible for designing and implementing high-quality data pipelines and systems that power business intelligence, analytics, and operational use cases.This role offers a remote-first opportunity with occasional...

  • Data Solutions Architect

    5 days ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    **Job Title:** Data ArchitectWe are seeking an experienced Data Architect to design and build data solutions that drive business value.The successful candidate will play a key role in designing and building data warehouse models in columnar databases to support business intelligence and analytics.Data Modelling: Design and build data warehouse models in...

  • Senior Data Architect

    2 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description We seek a seasoned data engineer to drive the development and implementation of advanced data solutions. Design, build, and maintain robust ETL pipelines using industry-leading tools like DBT, SSIS, Informatica, and Talend. Develop and deploy business intelligence dashboards and reports using Power BI, SSRS, and Tableau. Architect and...

  • Cloud-Native Artificial Intelligence Architect

    3 days ago

    Rajahmundry, Andhra Pradesh, India beBeeMachineLearning Full time US$ 1,25,000 - US$ 1,75,000

    Senior AI/ML Engineer\Our company is a leading provider of AI data solutions, at the forefront of innovation. We develop cutting-edge cloud-native data solutions that tackle complex challenges and drive intelligent technology.\Our Hyderabad office is a core innovation hub, and we're looking for brilliant minds to join our mission. This role involves building...

  • Senior Business Intelligence Architect

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionInfilon Technologies is seeking a Senior Data Scientist to lead advanced analytics initiatives.Implement solutions using modern AI/ML frameworks to build, train, and deploy machine learning models at scale.Develop and implement data similarity algorithms (e.g., Jaccard similarity, cosine similarity).Design and optimize data models across SQL...

  • Data Solutions Architect

    5 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Senior Data Solutions ArchitectWe are seeking an experienced Data Engineer to lead our data solutions team in designing, implementing, and maintaining large-scale data pipelines using Azure Data Factory, Apache Kafka, and other relevant technologies.

  • Senior Data Architect

    6 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About This RoleThis position is for a senior data architect with expertise in Databricks.We are looking for an experienced professional who can design, implement, and optimize scalable Databricks solutions that meet client requirements. The ideal candidate will have a strong background in data engineering, including data warehousing, ETL, and data...

  • Data Solutions Architect with Azure

    2 days ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    The role of Senior Business Intelligence (BI) & Data Engineer entails crafting and implementing data solutions that enable informed decision-making across the organization.Key Responsibilities:Designing, developing, and delivering business intelligence and data platformsEnsuring robust data architecture, seamless integration, and scalable data...

  • AI Innovation Leader

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeArtificial Intelligence Full time ₹ 50,000 - ₹ 70,000

    Senior AI Developer Job DescriptionOur organization is seeking an experienced Senior AI Developer to join our team.The successful candidate will be responsible for designing and building intelligent web automation systems that can interact with websites, perform smart actions, and extract data automatically.The ideal candidate will have a strong...

  • Power BI and Data Engineering Specialist

    3 days ago

    Rajahmundry, Andhra Pradesh, India beBeeBusinessIntelligence Full time ₹ 18,36,000 - ₹ 24,24,000

    Senior Business Intelligence Developer PositionA prominent company seeks a highly skilled Senior Business Intelligence Developer to spearhead the implementation of enterprise data initiatives.This role combines hands-on data engineering, ETL development, and business intelligence reporting delivery.Key ResponsibilitiesData Engineering: Design, develop, and...