Hi everyone, I saw on huggingface that they had implemented DeepSeek V3 but not DeepSeek V3.2. So as a learning opportunity I decided to implement a small scale deepseek v3.2 reimplementation with some small scale implementations. It can be found here:
It implements the new DSA (lightning indexer and token selection mechanism (top k). If you have any questions or would like to discuss more with me let me know!