JZTXT
  • 首页
  • Ai
  • Java
  • Python
  • Android
  • Mysql
  • JavaScript
  • Html
  • CSS

Deep Learning —— 异步优化器 —— RMSpropAsync —— 异步RMSprop

发布时间 2023-10-14 11:11:30作者: Angry_Panda

 

 

 

============================================

 

 

代码地址:

https://github.com/chainer/chainerrl/blob/master/chainerrl/optimizers/rmsprop_async.py

 

    def update_core_cpu(self, param):
        grad = param.grad
        if grad is None:
            return
        hp = self.hyperparam
        ms = self.state['ms']

        ms *= hp.alpha
        ms += (1 - hp.alpha) * grad * grad
        param.array -= hp.lr * grad / numpy.sqrt(ms + hp.eps)

 

    本栏目推荐文章
  • 《RAPL: A Relation-Aware Prototype Learning Approach for Few-Shot Document-Level Relation Extraction》阅读笔记
  • 【五期李伟平】CCF-A(AAAI'21)Game of Gradients: Mitigating Irrelevant Clients in Federated Learning
  • Learning Dynamic Query Combinations for Transformer-based Object** Detection and Segmentation论文阅读笔记
  • 【略读论文|大模型相关】Zero-Shot Relational Learning on Temporal Knowledge Graphs with Large Language Models
  • 《An End-to-end Model for Entity-level Relation Extraction using Multi-instance Learning》阅读笔记
  • CF940F Machine Learning题解
  • CF940FMachine Learning题解
  • 神经网络优化篇:详解神经网络的权重初始化(Weight Initialization for Deep NetworksVanishing / Exploding gradients)
  • 《Ensemble deep learning: A review》阅读笔记
  • scss样式穿透>>>或/deep/或::v-deep
版权声明:本网站为非赢利性站点,本网站所有内容均来源于互联网相关站点自动搜索采集信息,相关链接已经注明来源。
联系我们