Skip to content

Instantly share code, notes, and snippets.

@saprativa
Last active February 5, 2024 07:25
Show Gist options
  • Star 12 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save saprativa/b5cb639e0c035876e0dd3c46e5a380fd to your computer and use it in GitHub Desktop.
Save saprativa/b5cb639e0c035876e0dd3c46e5a380fd to your computer and use it in GitHub Desktop.
Summarization of Long Documents using Transformers
Display the source blob
Display the rendered blob
Raw
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@itayalm
Copy link

itayalm commented Apr 23, 2022

Thank you very nice :)

@NamraRehman
Copy link

NamraRehman commented Aug 17, 2022

its gives Extractive summarization. and not Abstarctive.
For extractive there are many easy algos which give good accuracy like gensim, luhn etc

@SumanthSrungavarapu
Copy link

its gives Extractive summarization. and not Abstarctive. FOr extractive there are many easy algos which give good accuracy like gensim, luhn etc

yeah I also observed that have you found out why and any other alternatives for abstractive summarization?

@NamraRehman
Copy link

Yes, Google's pegasus model is the state-of-the-art pre-trained model for abstractive text summarization.

@SumanthSrungavarapu
Copy link

Yes, Google's pegasus model is the state-of-the-art pre-trained model for abstractive text summarization.

I tried that too, I tried the pegasus model pretrained on cnn dataset available in huggingface. but its is also giving extractive results. If you have seen abstractive results could you please share that notebook or code.

@NamraRehman
Copy link

NamraRehman commented Feb 22, 2023

Yes, Google's pegasus model is the state-of-the-art pre-trained model for abstractive text summarization.

I tried that too, I tried the pegasus model pretrained on cnn dataset available in huggingface. but its is also giving extractive results. If you have seen abstractive results could you please share that notebook or code.

Yes, i used the pretrained model from the below link , and it output the abstractive summaries.

https://towardsdatascience.com/how-to-perform-abstractive-summarization-with-pegasus-3dd74e48bafb

This link also has the fine tuning code , i fine tuned pegasus on my legal text dataset, but im unable to predict the summaries and evaluate the model. if you find or write the code share it with me as well.

@VincentOracle
Copy link

Yes, the Google's pegasus model is the state-of-the-art pre-trained model for abstractive text summarization.

I tried that too, I tried the pegasus model pretrained on cnn dataset available in huggingface. but its is also giving extractive results. If you have seen abstractive results could you please share that notebook or code.

@VincentOracle
Copy link

Yes, the Google's pegasus model is the state-of-the-art pre-trained model for abstractive text summarization.

I tried that too, I tried the pegasus model pretrained on cnn dataset available in huggingface. but its is also giving extractive results. If you have seen abstractive results could you please share that notebook or code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment