Information Theory SG Seminar
22 events
-
Journal Club of Information Theory SG II
December 8 (Tue) at 13:00 - 14:00, 2020
Dr. Akinori Tanaka (Senior Research Scientist, iTHEMS)
The practical updating process of deep neural networks based on stochastic gradient descent is quite similar to stochastic dynamics described by Langevin equation. Under the Langevin system, we can "derive" 2nd law of thermodynamics, i.e. increasing the total entropy of the system. This fact suggests "2nd law of thermodynamics in deep learning." In this talk, I would like to explain this idea roughly, and there will be no concrete new result, but it may provide us new perspectives to study neural networks, I hope.
Venue: via Zoom
Event Official Language: English
-
Journal Club of Information Theory SG
December 1 (Tue) at 13:00 - 14:00, 2020
Dr. Akinori Tanaka (Senior Research Scientist, iTHEMS)
The practical updating process of deep neural networks based on stochastic gradient descent is quite similar to stochastic dynamics described by Langevin equation. Under the Langevin system, we can "derive" 2nd law of thermodynamics, i.e. increasing the total entropy of the system. This fact suggests "2nd law of thermodynamics in deep learning." In this talk, I would like to explain this idea roughly, and there will be no concrete new result, but it may provide us new perspectives to study neural networks, I hope. *Detailed information about the seminar refer to the email.
Venue: via Zoom
Event Official Language: English
22 events
Events
Categories
series
- iTHEMS Colloquium
- MACS Colloquium
- Academic-Industrial Innovation Lecture
- iTHEMS Math Seminar
- DMWG Seminar
- iTHEMS Biology Seminar
- iTHEMS Theoretical Physics Seminar
- Information Theory SG Seminar
- Quantum Matter Seminar
- Math-Phys Seminar
- NEW WG Seminar
- ABBL-iTHEMS Joint Astro Seminar
- QFT-core Seminar
- STAMP Seminar
- QuCoIn Seminar
- Number Theory Seminar
- Berkeley-iTHEMS Seminar
- iTHEMS Seminar
- iTHEMS-RNC Meson Science Lab. Joint Seminar
- iTHEMS Intensive Course-Evolution of Cooperation
- Theory of Operator Algebras
- Introduction to Public-Key Cryptography
- iTHES Theoretical Science Colloquium
- Knot Theory
- SUURI-COOL Seminar
- iTHES Seminar