Skip to main content
  1. PaperReading/
  2. AAAI/

When Radiology Report Generation Meets Knowledge Graph

AAAI KG 2020

将图像特征建模成不同解剖结构的Graph,用于下游的多标签分类和报告生成。

12f2032d-56c8-41bc-90cd-8209e5c66461

  • Knowledge Graph
    • Nodes from the same organ are connected
      • d4c6c9a1-de45-4c1c-b29c-c6a89f4f56ad
    • Node embedding
      • DenseNet-121 pretrained on CheXpert
      • Attention:
        • 1*1 conv+softmax
        • each class node uses the corresponding channel as spatial attention
  • Training Loss
    • Node Level: binary classification of each node
    • Graph Level: multi-label classification of 14 diseases