µ¡³£³Ø½¬ÆþÌç
¡Ê2020ǯÅÙÀ¸Êª»ñ¸»³ØÎà2ǯ¼¡ÂоݡּÂÍѲòÀÏI¡×¡Ê½ÕA¡¦B³Ø´ü¡Ë¤Î¥Ú¡¼¥¸¤Ç¤¹¡£¡Ë
2020/05/09
ÌÜɸ: µ¡³£³Ø½¬¤Î¥µ¥ó¥×¥ë¥×¥í¥°¥é¥à¤òÁö¤é¤»¤Æ¤ß¤Æ, µ¡³£³Ø½¬¤Ã¤Æ¤É¤¦¤¤¤¦¤â¤Î¤«, ¤¶¤Ã¤¯¤ê¤·¤¿¥¤¥á¡¼¥¸¤ò¤Ä¤«¤à¡£
- 2-1 ¥¦¥©¡¼¥à¥¢¥Ã¥×
- 2-2 µ¡³£³Ø½¬½éÂθ³
- 2-3 ¥ì¥Ý¡¼¥È²ÝÂê
2020/05/11
ÌÜɸ: µ¡³£³Ø½¬¤Î¥µ¥ó¥×¥ë¥×¥í¥°¥é¥à¤ò²òÆɤ·, ¼«Ê¬¤Ê¤ê¤Ë²þÊѤ·¤Æ¤¤¤¸¤ë¤³¤È¤¬¤Ç¤¤ë¤è¤¦¤Ë¤Ê¤ë¡£¤¦¤Þ¤¯Æ°¤«¤Ê¤¤¤È¤¤ÎÂнèË¡¤ò½¬ÆÀ¤¹¤ë¡£
2020/06/01
- 6-1 ¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¥ï¡¼¥¯¤Î³Ø½¬¡ÊÂè4¾Ï¡Ë
- 6-2 ¥ì¥Ý¡¼¥È²ÝÂê
2020/06/08
- 7-1 ¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¥ï¡¼¥¯¤Î³Ø½¬¡ÊÂè5¾Ï¡Ë
- 7-2 ¥ì¥Ý¡¼¥È²ÝÂê
- Affine¥ì¥¤¥ä¤È¤Ï²¿¤«?
- common/layers.py¤ÎÃæ¤Î, class Affine¤ÎÃæ¤Ç, dout, self.dW, self.db¤Ï¤½¤ì¤¾¤ì¥Æ¥¥¹¥ÈP148¤¢¤¿¤ê¤Ç¤Ï²¿¤ËÂбþ¤¹¤ë¤«?
- ¥Æ¥¥¹¥ÈP148¤Î5.13¼°¤Ï, common/layers.py¤ÎÃæ¤Ç¤É¤³¤Ë¤É¤Î¤è¤¦¤Ë¼ÂÁõ¤µ¤ì¤Æ¤¤¤ë¤«?
- ¼¡¤Î¥×¥ê¥ó¥È¤Î, Ìä1(1-1)¤«¤é(1-18)¤ò²ò¤±¡£
- ¡Ê¥ª¥×¥·¥ç¥ó; ½ÐÍè¤ë¿Í¤Ï¤ä¤Ã¤Æ¤ß¤è¤¦! À®ÀӤˤϹÍθ¤·¤Þ¤»¤ó¡Ë¼¡¤Î¥×¥ê¥ó¥È¤Î, Ìä2, Ìä3, Ìä4¤ò²ò¤±¡£
- ¡Ê¥ª¥×¥·¥ç¥ó; ½ÐÍè¤ë¿Í¤Ï¤ä¤Ã¤Æ¤ß¤è¤¦! À®ÀӤˤϹÍθ¤·¤Þ¤»¤ó¡Ëcommon/layers.py¤ÎÃæ¤Î, class Relu¤ÎÃæ¤Ç, ¸íº¹µÕÅÁÇŤϤɤ¦¼ÂÁõ¤µ¤ì¤Æ¤¤¤ë¤«?
2020/06/15
- 8-1 ¥ì¥Ý¡¼¥È²ÝÂê¡Ê¥°¥ë¡¼¥×¤Ç½õ¤±¤¢¤Ã¤Æºî¶È¤¹¤ë¤³¤È¡£¡Ë
- ²ÝÂê1: ¥°¥ë¡¼¥×¤ÇÏä·¹ç¤Ã¤Æ, ¥°¥ë¡¼¥×¤Î¥Ë¥Ã¥¯¥Í¡¼¥à¤ò·è¤á¤è¡£
- ²ÝÂê2: ´Ø¿ôf(x)=x^2+x+1¤ÎºÇ¾®Ãͤò¸ûÇÛË¡¤Ë¤è¤Ã¤Æ, ɽ·×»»¥½¥Õ¥È¤Çµá¤á¤è¡£½é´üÃͤÏx=10, ³Ø½¬Î¨¤Ï0.01¤È¤»¤è¡£
- ²ÝÂê3: ²ÝÂê2¤òɽ·×»»¥½¥Õ¥È¤Ç¤Ê¤¯python¥×¥í¥°¥é¥à¤òºî¤Ã¤Æ¼Â»Ü¤»¤è¡£¤Ç¤¤ë¤À¤±¥¯¥é¥¹¤ò»È¤¤, common/layers.py¤Ë»÷¤¿¥¹¥¿¥¤¥ë¤Ç¥×¥í¥°¥é¥à¤òºî¤ì¡£
- ²ÝÂê4: °Ê²¼¤Î7¤Ä¤Î¥Ç¡¼¥¿¥Ú¥¢(x, t)¤Ë¤Ä¤¤¤Æ, y=ax+b¤È¤¤¤¦¥â¥Ç¥ë¤Çt¤ò¶á»÷¤·¤¿¤¤(y¤¬t¤Î¿äÄêÃÍ)¡£Â»¼º´Ø¿ô¤Ï¸íº¹2¾èÏÂL=ô¡Êyi-ti)^2¤È¤·, ³ÎΨŪ¸ûÇ۹߲¼Ë¡(SGD)¤Ça, b¤òµá¤á¤ëpython¥×¥í¥°¥é¥à¤òºî¤ì¡£½é´üÃͤÏa=0, b=0¤È¤¹¤ë¡£³Ø½¬Î¨¤ÏŬÅö¤ËÄê¤á¤è¡Ê¤¤¤í¤¤¤í»î¤½¤¦¡ª¡Ë¡£¤Ç¤¤ë¤À¤±¥¯¥é¥¹¤ò»È¤¤, common/layers.py¤Ë»÷¤¿¥¹¥¿¥¤¥ë¤Ç¥×¥í¥°¥é¥à¤òºî¤ì¡£¤¹¤Ê¤ï¤Á, ¿äÄê¥â¥Ç¥ë¡Êy=ax+b¡Ë¤Î¥¯¥é¥¹¤È, »¼º´Ø¿ô(L)¤Î¥¯¥é¥¹¤òÊÌ¡¹¤Ë¤½¤ì¤¾¤ì¼ÂÁõ¤»¤è¡£Èùʬ·¸¿ô¤òµá¤á¤ëºÝ¤Ï°ìµ¤¤Ëµá¤á¤ë¤Î¤Ç¤Ê¤¯, ¿äÄê¥â¥Ç¥ë¤Î¥¯¥é¥¹¤Ç¢ßy/¢ßa¤È¢ßy/¢ßb¤ò¼ÂÁõ¤·, »¼º´Ø¿ô¤Î¥¯¥é¥¹¤Ç¢ßL/¢ßy¤È¤ò¼ÂÁõ¤·, ¤½¤ì¤é¤òÏ¢º¿Î§¡Ê¹çÀ®´Ø¿ô¤ÎÈùʬ¡Ë¤Ç·ë¹ç¤¹¤ë·Á¤Ç¢ßL/¢ßa¤È¢ßL/¢ßb¤òµá¤á¤è¡£¥ß¥Ë¥Ð¥Ã¥Á¤Ïºî¤é¤º, ¤«¤ï¤ê¤Ë¥Ç¡¼¥¿¤ò1²ó¤º¤Ä¥é¥ó¥À¥à¤Ë¥µ¥ó¥×¥ê¥ó¥°¤·, ¥Ç¡¼¥¿1¤Ä¤Ë¤Ä¤1²ó¤ÎSGD¥¹¥Æ¥Ã¥×¤ò¹Ô¤¨¤Ð¤è¤¤¡£
x t 1 2 2 1 3 3 4 5 5 4 6 8 7 5
·ë²Ì¤ò¥°¥é¥Õ¤Ëɽ¼¨¤»¤è¡£¥°¥é¥Õ¤Ë¤ÏºÇ¾®Æó¾èË¡¤Çµá¤á¤¿²óµ¢Ä¾Àþ¤â¤¤¤Ã¤·¤ç¤Ëɽ¼¨¤»¤è¡£
Ãí: ºÇ¾®Æó¾èË¡¤ÇÍýÏÀŪ¤Ë¤¹¤°¤Ëµá¤Þ¤ë¤³¤È¤ò, ¤Ê¤¼¤ï¤¶¤ï¤¶³ÎΨŪ¸ûÇÛË¡¤Ç¤ä¤ë¤Î¤«? ºÇ¾®Æó¾ðÊó¤ÇÍýÏÀŪ¡¦²òÀÏŪ¤Ë²ò¤¬·è¤Þ¤ë¤Î¤Ï¥·¥ó¥×¥ë¤Ê´Ø¿ô¤Î¤ß¤Ç¤¢¤ë¡£SGD¤Ï, Ê£»¨¤Ê´Ø¿ô¤Ë¤â»È¤¨¤ë¡£¤À¤«¤é¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¥ï¡¼¥¯¤Ç»È¤ï¤ì¤ë¤Î¤À¡£
2020/06/22
- 9-1 ´üËö²ÝÂê
°Ê²¼¤Î6¼ïÎà¤Î¼ù¼ï¤ÎÍÕ¤òʬÎह¤ëʬÎà´ï¤òºî¤í¤¦¡Ê¹ÔƬ¤Î¿ô»ú¤Ï³Æ¼ù¼ï¤Î¼±ÊÌ¥é¥Ù¥ë¡Ë¡§
- ¥Ò¥Î¥
- ¥¯¥¹¥Î¥
- ¥ä¥Þ¥Ü¥¦¥·
- ¥ä¥Þ¥â¥â
- ¥¤¥Á¥ç¥¦
- ¥¤¥í¥Ï¥«¥¨¥Ç
(1) ¡Ö¥¼¥í¤«¤é³Ø¤ÖDeep Learning¡×¤Î¥³¡¼¥É¤òήÍѤ·¤Æ, CNN¤Ç¤Ï¤Ê¤¤¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¤Çºî¤ì¡£
(2) ¡Ö¥¼¥í¤«¤é³Ø¤ÖDeep Learning¡×¤Î¥³¡¼¥É¤òήÍѤ·¤Æ, CNN¤Çºî¤ì¡£
(3) sklearn, keras¤Ê¤É¤Îµ¡³£³Ø½¬¥é¥¤¥Ö¥é¥ê¤òÍѤ¤¤Æºî¤ì¡£
¤³¤ì¤é¤Î·ë²Ì¤òÁê¸ß¤ËÈæ³Ó¤»¤è¡£
Ãí°Õ:
- ÆþÎϲèÁü¤Ï100¥Ô¥¯¥»¥ë x 100¥Ô¥¯¥»¥ë¤Îjpeg·Á¼°¤Î¥«¥é¡¼²èÁü¡£
- ¥Á¡¼¥àÆâ¤Ç¶¨ÎϤ·¤Æ¤ä¤ë¤³¤È¡£¥°¥ë¡¼¥×Æâ¤Ç(1)〜(3)¤Î¼ÂÁõ¤òʬô¤·¤Æ¤â¤è¤¤¡£
- ·±Îý¥Ç¡¼¥¿¤Ï, ÉáÄ̤Îǯ¤Ï³ØÀ¸¤Ç½¸¤á¤ë¤Î¤À¤¬, º£Ç¯¤ÏÆິ¸¶¤¬Ä󶡤¹¤ë¡£
- ¥ì¥Ý¡¼¥È¤Ë¤Ï, °Ê²¼¤Ïɬ¤º½ñ¤¯¤³¤È¡£
- ¥°¥ë¡¼¥×¤Î°¦¾Î, ¥á¥ó¥Ð¡¼¡ÊÁêËÀ¡Ë¤Î»á̾
- ¼êË¡: Á°½èÍý¤Î³µÍס£(1)(2)(3)¤Î¥½¡¼¥¹¥³¡¼¥É¡Ê¤¿¤¯¤µ¤ó¥³¥á¥ó¥È¤Ä¤±¤ë¤³¤È¡Ë¡£¤É¤¦¹Í¤¨¤Æºî¤Ã¤¿¤«¡£
- ·ë²Ì: (1)(2)(3)¤ÎÀºÅ٤Ȥ½¤ÎÈæ³Ó
- ¹Í»¡: ·ë²Ì¤«¤é¤ï¤«¤Ã¤¿¤³¤È¡£Á°½èÍý¤ä¥Ï¥¤¥Ñ¡¼¥Ñ¥é¥á¡¼¥¿¤ä¹½Â¤¤Ê¤É¤Î±Æ¶Á¡¦¸ú²Ì¤Ê¤É¡£
- ´¶ÁÛ
Keyword(s):
References:[µ¡³£³Ø½¬ÆþÌç: ¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¥ï¡¼¥¯¤ÎÂθ³] [µ¡³£³Ø½¬ÆþÌç: µ¡³£³Ø½¬½éÂθ³] [SideMenu] [µ¡³£³Ø½¬ÆþÌç: ¥Ë¥å¡¼¥é¥ë¥Í¥Ã¥È¥ï¡¼¥¯¤Î¼ÂÁõ¤Î½àÈ÷] [µ¡³£³Ø½¬ÆþÌç: ¥¦¥©¡¼¥à¥¢¥Ã¥×] [µ¡³£³Ø½¬ÆþÌç: ¥µ¥ó¥×¥ë¥×¥í¥°¥é¥à¤Î²òÆɤȲþ¤]