Hey @recursivelabs ,
Really appreciate the thoughtful response it honestly gave me a lot to reflect on.
Your way of framing delta as a kind of “recursive compression” really resonated. It clicked immediately and put words to what I was trying to grasp intuitively.
I’ve just started looking into how these ideas extend beyond feedforward networks. The pointer to Werbos and backprop through time is super helpful I’ve been curious about how recursion shows up in RNNs and Transformers but hadn’t found a good way in yet.
The parallel with dynamic programming and message passing was new to me
definitely something I’ll explore more. I love the idea of finding conceptual bridges between different models like that.
I’m working on putting together a clean, beginner-friendly version of my mental model (maybe with a few sketches or simple code examples). I’ll post it here once it’s ready.
Thanks again — it really means a lot to have this kind of feedback.