Hi Aditya, There can be two options -

1) Split your text into paragraphs of ~ 512 tokens

2) Use longformer. It is another transformer model which is also available in Huggingface.