RT @adamnemecek1: @karpathy I have recently written a paper on this https://t.co/PoUnrXBLEI. Hopf algebras are besties with Markov chains h…
RT @adamnemecek1: @karpathy I have recently written a paper on this https://t.co/PoUnrXBLEI. Hopf algebras are besties with Markov chains h…
@karpathy I have recently written a paper on this https://t.co/PoUnrXBLEI. Hopf algebras are besties with Markov chains https://t.co/4PvjwBWV3N.
Oh this looks cool. Luv Persi Diaconis!
This Persi Diaconis/Amy Pang paper provides a solid intuition for Hopf learning theory. https://t.co/4PvjwBWV3N Both diffusion models and transformer models are Markov chains and the connections between Hopf algebras and Markov chains is well known.
RT @adamnemecek1: @MatiosTV There's also this cool paper https://t.co/4PvjwBWV3N Hopf algebras have potentially many many applications, I t…
@MatiosTV There's also this cool paper https://t.co/4PvjwBWV3N Hopf algebras have potentially many many applications, I think that all optimization is better (faster, easier to reason about etc etc) in Hopf algebras.
@VictorTaelin A lot of this clicked for me after reading this paper https://t.co/4PvjwBWV3N. Recurrences allow you to select a subset of things to pay attention to (it's a coalgebra). You should look at the paper "Thinking Like Transformers" by @gail_w and
@jxmnop I'm working on an implementation. It will be a while since you can't do this in PyTorch. This paper might be of your interest in the mean time. https://t.co/4PvjwBWnef It's very closely related. 2/n
Hopf algebras and Markov chains: Two examples and a theory. http://t.co/lMztRU3S