Skip to content

Instantly share code, notes, and snippets.

View tezansahu's full-sized avatar
🎯
Focusing

Tezan Sahu tezansahu

🎯
Focusing
109 followers · 6 following
View GitHub Profile
@tezansahu
tezansahu / Dockerfile
Last active April 24, 2022 20:01
Dockerfile for Janus AI API server
# Specify the Base image
FROM python:3.8-slim
# Update and install the basic OS-related packages
RUN apt-get update -y && \
apt-get dist-upgrade -y && \
apt-get install -y && \
apt-get install build-essential -y \
supervisor wget unzip
@tezansahu
tezansahu / janus_popup_getParaphrasedText.js
Created April 23, 2022 22:50
// URL at which the API server is running
base_url = "http://127.0.0.1:8000";
// Issue a POST request with a request body
function doPost(url, body, callback){
var xmlHttp = new XMLHttpRequest();
xmlHttp.onreadystatechange = function() {
if (xmlHttp.readyState == 4 && xmlHttp.status == 200)
callback(xmlHttp.responseText);
}
@tezansahu
tezansahu / janus_popup_getSelectedText.js
Last active May 5, 2023 03:41
// Inject _getSelectedTextFromTab into current page and
// populate the textarea for user input in the popup with the selected text
function getSelectedText() {
// Get information about the currently active tab
chrome.tabs.query({ active: true, currentWindow: true }, function (tabs) {
let tab = tabs[0];
// Inject JavaScript into the active tab to get the text selected by the user
chrome.scripting.executeScript(
{
@tezansahu
tezansahu / janus_popup.html
Created April 23, 2022 22:29
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<!-- Use Bootstrap 5 by loading it as a stylesheet from jsDelivr, a free open source CDN -->
<link href="https://cdn.jsdelivr.net/npm/bootstrap@5.1.3/dist/css/bootstrap.min.css" rel="stylesheet" integrity="sha384-1BmE4kWBq78iYhFldvKuhfTAU6auU8tT94WrHftjDbrCEXSU1oBoqyl2QvZ6jIW3" crossorigin="anonymous">
<title>Janus AI: Paraphrasing Tool</title>
</head>
@tezansahu
tezansahu / janus_manifest.json
Created April 23, 2022 22:22
{
"name": "Janus AI",
"description": "AI-based Smart Paraphrasing Solution",
"version": "1.0",
"manifest_version": 3,
"permissions": [
"tabs",
"scripting"
],
"host_permissions": ["https://*/"],
@tezansahu
tezansahu / janus_main.py
Created April 23, 2022 21:58
from fastapi import FastAPI
from starlette.middleware.cors import CORSMiddleware
from pydantic import BaseModel
import paraphrasingModule
# Load the paraphrasing, keyword extraction and synonym finding modules
paraphraser = paraphrasingModule.PegasusParaphraser()
kw_syn = paraphrasingModule.KeywordSynonyms()
# User's input text is sent as a request body. The structure of this body can be defined by extending Pydantic's BaseModel
@tezansahu
tezansahu / janus_paraphrasingModule_keywordSynonyms.py
Last active April 23, 2022 21:32
from keybert import KeyBERT
import nltk
# Use NLTK's data downloader to download the required data packages (WordNet and Open Multilingual Wordnet) if not present already
for resource in ["wordnet", "omw-1.4"]:
try:
nltk_path = nltk.find("corpora/{0}".format(resource))
except Exception:
nltk.download(resource)
@tezansahu
tezansahu / janus_paraphrasingModule_pegasus.py
Last active April 23, 2022 21:13
import torch
from transformers import PegasusForConditionalGeneration, PegasusTokenizer
from sentence_splitter import SentenceSplitter
class PegasusParaphraser:
def __init__(self, num_beams=10):
if(torch.cuda.is_available()):
self.device = torch.device("cuda:0")
else:
self.device = torch.device("cpu:0")
@tezansahu
tezansahu / mlf1_full_notebook.ipynb
Created March 7, 2022 21:28
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@tezansahu
tezansahu / mlf1_registerWebapp.py
Created March 7, 2022 19:59
mlf_run_3.log_webapp_file('streamlit_roberta.py')