pre-training model

[lcx0329]

Excuse me, is the downloaded pre-training model already trained? Why is the test result shown in the figure below?

[j-min]

I don't have enough information to guide this just from the screenshot, but maybe you can first check the generated outputs? Try colab demo and see if your generation results are similar to the generation results at colab. The colab is based on the pretrained checkpoint.

[lcx0329]

Due to a mismatch between the PL library and Pytorch, I upgraded the PL library, which resulted in some code changes that needed to be made. After the changes were made, the results are shown in the figure. Here are the modifications I made, and I would like to ask if I have made any mistakes

The above is the modification I made. Could you please check if it was due to the above modifications? Thank you

[j-min]

I don't see any obvious error from the screenshot, but I don't have information about all the changes you might have made to give useful comments on your case.
I suggest starting from the current pytorch / lightning version in this repo so that you have a clean starting point, and gradually changing one thing at a time to spot what makes the performance drop.

[lcx0329]

The above evaluation results, I don't know why every sentence is incomplete