Using transformers to generate text

[iam-abbas]

GPT2-Simple doesn't work for finetuning 1.5B. Let's use https://github.com/huggingface/transformers

[iam-abbas]

referencing #5

[cshubhamrao]

@iam-abbas added support for marking EOT while preprocessing (9c1fcdb)

[iam-abbas]

It's here!!

One of the samples:
Now, there are some people out there who think trump's a bad person. For instance, this weekend, I watched the presidential candidate's first candidate round-up, and he was named "The man who can't get anything he wants to get right." ( cheers and applause ) that's a good quality. That's a good quality, because the only person who can't get anything right is Donald Trump. ( laughter ) and I'm not sure he's read the new book, "The man who can't get anything wrong."

[iam-abbas]

Completed in #10

[cshubhamrao]

Wait for #12 and #11 results too!