This is an interesting use case, especially when user behavior is better represented as a sequence rather than a single aggregated vector. Treating events as ordered inputs and encoding them with a transformer or RNN-style approach can produce much richer user embeddings. A somewhat related discussion is here: /static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpredict-next-embedding-given-sequence-of-embeddings%2F31845%3C%2Fa%3E%3C%2Fp%3E
1 Like