cmake -DCUTLASS_LIBRARY_KERNELS=cutlass3x_sm90* -DCUTLASS_ENABLE_CUBLAS=ON -DCUTLASS_ENABLE_CUDNN=ON -DCUTLASS_NVCC_ARCHS="90a" ..
Chris Sullivan csullivan
csullivan
/ install_python3.11.sh
Created
April 23, 2024 16:12
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| sudo add-apt-repository ppa:deadsnakes/ppa | |
| sudo apt install python3.11 python3.11-distutils python3.11-venv | |
| curl -sS https://bootstrap.pypa.io/get-pip.py | python3.11 |
csullivan
/ sharded_decode.py
Last active
September 6, 2023 23:30
Sharded decode, sharding rewrite done after FuseOpsByPattern (cublas/cutlass byoc) -- With debug tracing calls
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Ignore `tvm.save_and_copy_tensor` packed functions inserted for debugging | |
| @R.function | |
| def decode(input_ids1: R.Tensor((1, 1), dtype="int32"), all_seq_len: R.Shape(["n"]), kv_cache: R.Tuple(R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Object, R.Obj |
csullivan
/ passthrough_notes.md
Last active
August 23, 2023 21:25
QEMU/KVM GPU passthrough on 18.04 LTS notes
Blacklist the nvidia driver:
sudo bash -c "echo options nouveau modeset=0 >> /etc/modprobe.d/blacklist-nvidia-nouveau.conf"
sudo bash -c "echo blacklist nouveau > /etc/modprobe.d/blacklist-nvidia-nouveau.conf"
/etc/default/grub:
csullivan
/ test_torch_distributed.py
Created
July 17, 2023 05:44
Minimal NCCL torch.distributed example
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import os | |
| import torch | |
| import torch.distributed as dist | |
| def read_file_and_all_reduce(): | |
| # Get the rank and world size from environment variables | |
| rank = int(os.environ['LOCAL_RANK']) | |
| world_size = int(os.environ['WORLD_SIZE']) | |
| # initialize the process group |
csullivan
/ bradbury_if_only_we_had_taller_been.txt
Created
June 2, 2023 15:40
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| The fence we walked between the years | |
| Did balance us serene; | |
| It was a place half in the sky where | |
| In the green of leaf and promising of peach | |
| We’d reach our hand to touch, and almost touch the sky. | |
| If we could reach and touch, we said, | |
| ‘Twould teach us not to, never to, be dead. | |
| We ached and almost touched that stuff; | |
| Our reach was never quite enough. |
csullivan
/ cereal_polymorphic_serialization.cc
Last active
April 9, 2023 23:27
polymorphic data serialization example with cereal
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #include <iostream> | |
| #include <vector> | |
| #include <memory> | |
| #include <cereal/archives/binary.hpp> | |
| #include <cereal/types/vector.hpp> | |
| #include <cereal/types/string.hpp> | |
| #include <cereal/types/base_class.hpp> | |
| #include <cereal/types/memory.hpp> | |
| #include <cereal/access.hpp> |
csullivan
/ CMake_3_20_Ubuntu_18_04.md
Last active
March 30, 2023 05:39
— forked from bmegli/CMake_3_20_Ubuntu_18_04.md
apt reversible source builds with checkinstall-- Example: CMake 3.20 in Ubuntu 18.04 (reversible way)
- modern CMake is required for building a lot of new software
- CMake is dependency for many packages (e.g. ROS related)
- we don't want to remove CMake (which would remove packages that depend on it)
- we want safe procedure to update CMake that can be reversed easily
Check current version
csullivan
/ 2022-10-25_chris-sullivan_notes.md
Last active
November 14, 2022 17:29
Authored-by: Eric Lunderberg
Notes summarizing discussion between @Lunderberg and @csullivan on 2022_10_25
From previous conversation, possibility of representing pad/crop separately from the layout transform. This would allow algebraic
csullivan
/ bcdedit.txt
Last active
October 30, 2021 23:41
Repairing EFI/GPT Bootloader using the DISKPART and BCDEdit command
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Source: https://www.retrospect.com/au/support/kb/repair_efi_bootloader | |
| This guide details how to rebuild the BCD boot store for windows. | |
| Use diskpart to make System partition available. | |
| (This will allow us to use bcdedit later in this guide to repair the bootloader.) | |
| Boot from the Windows installation media |
NewerOlder