This is an interesting use case, especially when user behavior is better represented as a sequence rather than a single aggregated vector. Treating events as ordered inputs and encoding them with a transformer or RNN-style approach can produce much richer user embeddings. A somewhat related discussion is here: https://discuss.huggingface.co/t/predict-next-embedding-given-sequence-of-embeddings/31845
1 Like