Hey, thanks for the post! Have you tried something like BERT / GPT-2 / XLNet for the text generation? I am playing with this package https://github.com/huggingface/pytorch-transformers now and it shows promising results in some fields :)