ohai.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A cozy, fast and secure Mastodon server where everyone is welcome. Run by the folks at ohai.is.

Administered by:

Server stats:

1.8K
active users

#nn

0 posts0 participants0 posts today
Continued thread

Grokking at Edge of Numerical Stability
arxiv.org/abs/2501.04697
old.reddit.com/r/MachineLearni
en.wikipedia.org/wiki/Grokking

* sudden generalization after prolonged overfitting
* massively overtrained NN can acq. "emergent"/supra performance/unexpected abilities
* unexp./accid. finding
* mechanisms starting to unravel

Grokked Transformers are Implicit Reasoners: Mechanistic Journey to Edge of Generalization
arxiv.org/abs/2405.15071
news.ycombinator.com/item?id=4

#LLM#ML#grokking

Mathematics opens black box of AI decision-making
phys.org/news/2025-01-mathemat

* understanding how neural networks (NN) make decisions
* poorly understood process in machine learning

Image segmentation w. traveling waves in exactly solvable recurrent NN
pnas.org/doi/10.1073/pnas.2321

* RNN performing simple image segmentation, also exactly mathematically solvable
* math understanding precisely how int. connections w/i NN create visual computations

#ML#NN#RNN

Попросил нейронку изобразить, как выглядит «душный чёрт», которым меня обозвали в чате.
Получилась то ли обложка для альбома, то ли эмблема для байк-клуба. Но, по-моему, довольно неплохо!