about the pretraining datasets

[tszslovewanpu]

Hello, thanks for your work, you mentioned that the corpus of this training contains 2 million papers collected by the text-mining efforts at CEDER group, does it mean that you get the 2 million papers directly or you take the text-mining method to get the papers(collect, and then parsing) ? hope to get your instruction~