User Embedding Conditioned Generative Models