I would like to initiate a discussion on the recent publication by Geoffrey Hinton proposing an alternative to the traditional backpropagation algorithm - The Forward-Forward Algorithm: Some Preliminary Investigations and the paper by Alexander Ororbia and Ankur Mali - The Predictive Forward-Forward Algorithm which suggests incorporating a generative circuit into the original FF network.
I am interested in hearing the thoughts and insights of the community on these papers. I am particularly interested in discussing the potential benefits of layer level weights update in the Forward-Forward algorithm as it could potentially allow for training a network layer by layer without the need for a huge amount of VRAM.