JZTXT
  • 首页
  • Ai
  • Java
  • Python
  • Android
  • Mysql
  • JavaScript
  • Html
  • CSS

logits 与 pre-logits

发布时间 2023-07-19 15:56:18作者: 一点飞鸿

logits为fc的输出,应用softmax之前的向量,(b,len)

pre-logits这个东西我是从论文《Tied-Augment: Controlling Representation Similarity Improves Data Augmentation 》中看到的,根据源码的解释,pre-logits为特征图flatten之后(应用fc之前)的向量:

 特此记录

    本栏目推荐文章
  • 《Span-Based Joint Entity and Relation Extraction with Transformer Pre-Training》阅读笔记
  • GPT-1论文《Improving Language Understanding by Generative Pre-Training》解读
  • sql server pre-login troubleshooting
  • Open-World Object Manipulation using Pre-trained Vision-Language Models
  • Postman/apifox pre-request script
  • 【论文阅读笔记】【多模态-Vision-Language Pretraining】 BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
  • 解决pre -commit hook failed (add --no-verify)的问题
  • 【论文阅读笔记】【多模态-Referring & Grounding】 Grounded Language-Image Pre-training
  • GLIP:Grounded Language-Image Pre-training
  • Leveraging Pre-trained Large Language Models to Construct and UtilizeWorld Models for Model-based Task Planning
版权声明:本网站为非赢利性站点,本网站所有内容均来源于互联网相关站点自动搜索采集信息,相关链接已经注明来源。
联系我们