Skip to content

Instantly share code, notes, and snippets.

View loleg's full-sized avatar

Oleg Lavrovsky loleg

View GitHub Profile
@loleg
loleg / docker-compose.yml
Last active September 25, 2025 06:56
Docker Compose and NGINX configuration for running a vLLM model with Open WebUI on a small server - based on https://github.com/marib00/vllm-openwebui-nginx-compose - see also my blog post https://log.alets.ch/110/
networks: # Define a custom network
internal_network:
driver: bridge
services:
nginx-proxy:
image: nginx:latest
container_name: nginx-proxy
ports:
- "80:80"
@loleg
loleg / docker-compose.yml
Created September 13, 2025 15:29
Sample Docker Compose for Popspace
services:
popspace:
image: ghcr.io/with-labs/popspace
restart: on-failure
ports:
- 8888:8888
- 8889:8889
- 8890:8890
- 8891:8891
environment:
@loleg
loleg / Qwen_suggests.md
Created September 3, 2025 18:32
Troubleshooting memory issues with AutoModelForCausalLM

Running out of system memory (RAM) when loading a large language model like AutoModelForCausalLM is common, especially with large models such as LLaMA, Falcon, or GPT-NeoX. Here's why it happens and how to fix or mitigate it.


🔍 Why You're Running Out of Memory

  1. Model Size in RAM:
    • Large models (e.g., 7B, 13B, 70B parameters) can take tens of gigabytes of RAM just to load in full precision (FP32).
    • Even a 7B model can use ~14–28 GB of RAM depending on precision and overhead.
  • If your system has limited RAM (e.g., 16 GB), this can cause crashes.
@loleg
loleg / Announcement.md
Last active July 17, 2025 10:47
Announcing the Swiss {ai} Weeks Hackathon in Bern on September 18-19, 2025
@loleg
loleg / docker-compose.yml
Created July 14, 2025 08:58
Docker Compose configuration for a DEV release of dribdat
services:
dribdat:
image: dribdat/dribdat:dev
ports:
- 5000:5000
environment:
- DATABASE_URL=sqlite:////opt/dribdat.db
- SERVER_URL=localhost:5000
- DRIBDAT_ENV=prod
- DRIBDAT_SECRET=changeme
@loleg
loleg / graffataq.lua
Last active June 7, 2025 09:47
Cosin graffiti simulator for TIC-80 https://make.echtzeitkultur.org/project/187
-- title: graffataq
-- author: seism
-- desc: Make drippy murals inspired by graffiti #CoSin
-- site: https://make.echtzeitkultur.org/project/187
-- license: MIT License
-- version: 0.3
-- script: lua
-- References:
-- - Pixel buffer methods and general idea borrowed from PAINT 31 https://tic80.com/play?cart=686
@loleg
loleg / Finding Real Estate Data.md
Last active April 23, 2025 12:15
💁 Where can I get quick access to real estate data with developer-friendly access and documentation?
@loleg
loleg / LLaVa_for_Accessible_Spaces.ipynb
Last active March 14, 2025 18:58
AI for Accessibility
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@loleg
loleg / datapackage.json
Created February 25, 2025 14:28
Data Package for Dribdat from Hack the Hackathon vol. 4 - November 2024 - Scripps Institution of Oceanography San Diego
{"contributors":[],"created":"2025-02-25T14:22","description":"An unconference series & interdisciplinary community exploring scientific collaboration, learning, and civic engagement through hackathons","homepage":"https://hackthackathon.github.io/","keywords":["dribdat","hackathon","co-creation"],"licenses":[{"name":"ODC-PDDL-1.0","path":"http://opendatacommons.org/licenses/pddl/","title":"Open Data Commons Public Domain Dedication & License 1.0"}],"name":"event-1","resources":[{"data":[{"aftersubmit":"","boilerplate":"### &#128640; Let's launch your idea!\r\n\r\nNeed help? Get in touch with the [organising team](/about), or raise [an issue](https://github.com/dribdat/dribdat/issues).\r\n","certificate_path":"","community_embed":"<div class=\"codeofconduct\">All attendees, sponsors, partners, volunteers and staff at our hackathon are required to agree with the <a href=\"https://hackcodeofconduct.org/\" target=\"_blank\">Hack Code of Conduct</a>. Organisers will enforce this code throughout the event. We expe
@loleg
loleg / yenanpu.py
Created February 17, 2025 08:53
"Ye Nan Pu" - a tiny animation in TIC-80
# title: Ye Nan Pu
# author: seism
# desc: a midnight heart-hack-ttack made at MountainBytes 2025
# site: https://mountainbytes.ch
# license: WTFPL License
# version: 0.1
# script: python
from math import sin
from random import random, seed