Created
September 7, 2020 15:24
-
-
Save priya-dwivedi/beb7324d3eada8836b1a81d56fab5c6c to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
from transformers import AutoTokenizer, AutoModelWithLMHead | |
tokenizer = AutoTokenizer.from_pretrained("deep-learning-analytics/wikihow-t5-small") | |
model = AutoModelWithLMHead.from_pretrained("deep-learning-analytics/wikihow-t5-small") | |
device = torch.device("cuda:0" if torch.cuda.is_available() else "cpu") | |
model = model.to(device) | |
text = """" | |
Lack of fluids can lead to dry mouth, which is a leading cause of bad breath. Water | |
can also dilute any chemicals in your mouth or gut that are causing bad breath., Studies show that | |
eating 6 ounces of yogurt a day reduces the level of odor-causing compounds in the mouth. In | |
particular, look for yogurt containing the active bacteria Streptococcus thermophilus or | |
Lactobacillus bulgaricus., The abrasive nature of fibrous fruits and vegetables helps to clean | |
teeth, while the vitamins, antioxidants, and acids they contain improve dental health.Foods that can | |
be particularly helpful include:Apples — Apples contain vitamin C, which is necessary for health | |
gums, as well as malic acid, which helps to whiten teeth.Carrots — Carrots are rich in vitamin A, | |
which strengthens tooth enamel.Celery — Chewing celery produces a lot of saliva, which helps to | |
neutralize bacteria that cause bad breath.Pineapples — Pineapples contain bromelain, an enzyme that | |
cleans the mouth., These teas have been shown to kill the bacteria that cause bad breath and | |
plaque., An upset stomach can lead to burping, which contributes to bad breath. Don’t eat foods that | |
upset your stomach, or if you do, use antacids. If you are lactose intolerant, try lactase tablets., | |
They can all cause bad breath. If you do eat them, bring sugar-free gum or a toothbrush and | |
toothpaste to freshen your mouth afterwards., Diets low in carbohydrates lead to ketosis — a state | |
in which the body burns primarily fat instead of carbohydrates for energy. This may be good for your | |
waistline, but it also produces chemicals called ketones, which contribute to bad breath.To stop the | |
problem, you must change your diet. Or, you can combat the smell in one of these ways:Drink lots of | |
water to dilute the ketones.Chew sugarless gum or suck on sugarless mints.Chew mint leaves. | |
""" | |
preprocess_text = text.strip().replace("\n","") | |
tokenized_text = tokenizer.encode(preprocess_text, return_tensors="pt").to(device) | |
summary_ids = model.generate( | |
tokenized_text, | |
max_length=150, | |
num_beams=2, | |
repetition_penalty=2.5, | |
length_penalty=1.0, | |
early_stopping=True | |
) | |
output = tokenizer.decode(summary_ids[0], skip_special_tokens=True) | |
print ("\n\nSummarized text: \n",output) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment