Experimenting with Transformer models?

[jd-coderepos]

Greetings,

was wondering if there are plans to support Transformer models such as BERT, SciBERT, XLNet ... with this tool? This is not so much an issue, just a question.

Thank you :)

[jiesutd]

Hi @jd-coderepos I implemented a dev version that integrated the initial BERT model, but I didn't get enough time to finetune it. But the good news it that my student will continue my work. We plan to release the code and experiments reports with in near months (hopefully).