Skip to content

Instantly share code, notes, and snippets.

@Barqawiz
Created August 1, 2023 13:12
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Save Barqawiz/e41e3ae071bc023ce3636a8708d3746f to your computer and use it in GitHub Desktop.
// When copying the code to the same file, ensure removing the repeated imports
const { Chatbot, LLamaSageInput, SupportedChatModels } = require('intellinode');
app.get('/llama/aws', async (req, res) => {
const chatbot = new Chatbot(null, SupportedChatModels.SAGEMAKER, {url: process.env.AWS_API_URL});
const system = 'You are a helpful assistant.';
const input = new LLamaSageInput(system);
input.addUserMessage(req.query.message);
const response = await chatbot.chat(input);
res.json({ response });
});
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment