Navigation

    Gpushare.com

    • Register
    • Login
    • Search
    • Popular
    • Categories
    • Recent
    • Tags

    多模态检索【4】

    语音识别与语义处理领域
    1
    1
    37
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • 188****7632
      188****7632 last edited by

      Similarity Reasoning and Filtration for Image-Text Matching AAAI2021
      这一篇的质量还可以,动机把相似度从标量转化为向量,从而继续建图

      模型分为两个模型,一个是 Similarity Graph Reasoning (SGR) ,另一个是The Similarity Attention Filtration (SAF)

      模型结构如下:

      总的来说,一个是对图的边进行更新,一个是对节点进行更新(这个比较新颖)

      后者这个公式比较少见

      最后联合训练,推断时取两个模块的平均值

      参考文献:
      https://arxiv.org/abs/2101.01368

      1 Reply Last reply Reply Quote 0
      • First post
        Last post