question about task split and pretrain model

Hello! Your work is very effective. I wonder if tasks must be separated from the benchmark model before they can be used as pre training language models for other tasks? Does the provided. PT file split the task?