Skip to content

Instantly share code, notes, and snippets.

View nkpz's full-sized avatar

Nick Perez nkpz

  • Woodside, Queens, NY
View GitHub Profile
import time
import os
import logging
import random
from datasets import load_dataset
class QuantAutoGPTQ:
def __init__(self, model_name_or_path, output_dir, dataset,
num_samples=128, trust_remote_code=False, cache_examples=True,
use_fast=True, use_triton=False, bits=[4], group_size=[128], damp=[0.01],
@reoring
reoring / gist:3ff898c90a81073ea37b96e0fef8746b
Last active October 25, 2022 02:50
docker-compose.yml for php and postgresql

html/index.php

<?php

phpinfo();

docker/Dockerfile