Skip to content

Instantly share code, notes, and snippets.

@kinoc
kinoc / llama4openai-api.py
Created March 24, 2023 22:35
Flask based endpoint to emulate OpenAI API enpoints using llama/alpaca and HF models
# a simple Flask API to emulate OpenAI's using llama models and/or transformers
# runs on 3080
import sys
import time
import torch
import json
from peft import PeftModel
from flask import Flask, make_response, request, abort
@reedobrien
reedobrien / create_dynamo_indexes.py
Created June 15, 2015 15:13
Create indexes on DynamoDB table with boto3
import boto3
from boto3.dynamodb.types import STRING
table = boto3.resource("dynamodb", region_name="us-east-1").Table("availdev-JobStateDB-1UIJ881212TPX")
## Attrs for GSI
attrdef = [
{"AttributeName": "state", "AttributeType": STRING},
{"AttributeName": "userId", "AttributeType": STRING},
{"AttributeName": "assetId", "AttributeType": STRING}
@jeremypruitt
jeremypruitt / sns-publish
Last active August 19, 2022 18:09
AWS Lambda function to publish to SNS topic
console.log('Loading function');
var AWS = require('aws-sdk');
AWS.config.region = 'us-west-2';
exports.handler = function(event, context) {
console.log("\n\nLoading handler\n\n");
var sns = new AWS.SNS();
sns.publish({
@mbmccormick
mbmccormick / gist:c593f7b98730af35662b
Created May 31, 2014 18:28
logmein-hamachi-2.1.0.119-armhf - README
LogMeIn Hamachi for Linux User Guide
=====================================
About LogMeIn Hamachi
LogMeIn Hamachi is a virtual networking service that can be set up in
minutes and enables secure remote access to your business network
anywhere there is an Internet connection.
Unlike traditional hardware and software based VPN systems, LogMeIn