Skip to content

Instantly share code, notes, and snippets.

View sighingnow's full-sized avatar
💭
typing...

Tao He sighingnow

💭
typing...
447 followers · 986 following
View GitHub Profile
@sighingnow
sighingnow / cpp-tricks.md
Last active January 7, 2026 00:15
C++ Tricks.

Tricks in Modern C++

is_specialization_of

Whether the type is a specialization of template T.

template  class T, typename U>
@sighingnow
sighingnow / pipeline-model-parallel-visualization.ipynb
Last active December 26, 2025 00:22
Visualizing various different pipeline model parallel scheduling algorithms: GPipe, Pipedream(1F1B), Pipedream-2BW(async, no-flushes), and eager-1F1B
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@sighingnow
sighingnow / Makefile
Last active November 3, 2025 21:06
Detect operating system in Makefile.
# Detect operating system in Makefile.
# Author: He Tao
# Date: 2015-05-30
OSFLAG :=
ifeq ($(OS),Windows_NT)
OSFLAG += -D WIN32
ifeq ($(PROCESSOR_ARCHITECTURE),AMD64)
OSFLAG += -D AMD64
endif
@sighingnow
sighingnow / Docset for LLVM and Clang.md
Last active July 21, 2025 02:48
Build docset for LLVM/Clang

Build LLVM/Clang Docset

  1. Modify LLVM/Clang doxygen.config.in

    • GENERATE_DOCSET = YES
    • DISABLE_INDEX = YES
    • SEARCHENGINE = NO
    • GENERATE_TREEVIEW = NO
    • GENERATE_TAGFILE =
  • LLVM: @abs_top_builddir@/doxygen/llvm(clang).tag
@sighingnow
sighingnow / gpt-model.py
Created January 14, 2024 06:00
llm-arithmetic: flops, memory footprint, memory access I/O, and more for both training and inference (prefill and generation)
class GPTModel:
def __init__(
self,
name: str = None,
vocab_size: int = 51200,
sequence_length: int = 2048,
attention_heads: int = 32,
hidden_size: int = 2304,
layers: int = 24,
micro_batch_size: int = 1,
@sighingnow
sighingnow / kvcache.ipynb
Created December 26, 2023 02:39
LLM kv cache analysis
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@sighingnow
sighingnow / display-kconfig.sh
Created March 25, 2023 02:06
Display build configurations about current Linux kernel
cat /proc/config.gz | gunzip
@sighingnow
sighingnow / CRTP-(de)incomplete-(de)ambiguous.cpp
Created March 7, 2023 17:04
Fixes the incomplete type and ambiguous dependent name problem for CRTP: https://godbolt.org/z/3WGe1q5K5
template <typename U>
struct A_trait {
using T = int;
};
template <typename U, template <typename ...> class Trait = A_trait>
struct A {
using T = typename Trait<U>::T;
};
@sighingnow
sighingnow / PrintTargetProperties.cmake
Last active November 13, 2022 11:40
Print properties of a target in CMake
# Get all propreties that cmake supports
if(NOT CMAKE_PROPERTY_LIST)
execute_process(COMMAND cmake --help-property-list OUTPUT_VARIABLE CMAKE_PROPERTY_LIST)
# Convert command output into a CMake list
string(REGEX REPLACE ";" "\\\\;" CMAKE_PROPERTY_LIST "${CMAKE_PROPERTY_LIST}")
string(REGEX REPLACE "\n" ";" CMAKE_PROPERTY_LIST "${CMAKE_PROPERTY_LIST}")
endif()
list(APPEND CMAKE_PROPERTY_LIST "IMPORTED_LOCATION")
@sighingnow
sighingnow / PrintVariables.cmake
Last active June 5, 2022 04:03
Print all accessible variables in current context in CMake
function(print_cmake_variables)
get_cmake_property(_variableNames VARIABLES)
list (SORT _variableNames)
foreach (_variableName ${_variableNames})
if (ARGV0)
unset(MATCHED)
string(REGEX MATCH ${ARGV0} MATCHED ${_variableName})
if (NOT MATCHED)
continue()
endif()