Hans Elias J. hansihe

## tiktoken-to-hf.ipynb

      
              1 file
            
          
              2 forks
            
          
              17 comments
            
          
              14 stars
            
          
                xenova
                / tiktoken-to-hf.ipynb
            
            
              Last active
              May 10, 2024 00:59
            
              
                Convert tiktoken tokenizers to the Hugging Face tokenizers format
              
          
      Sorry, something went wrong. Reload?
      Sorry, we cannot display this file.
      Sorry, this file is invalid so it cannot be displayed.
      
          Viewer requires iframe.
      
    
## !wasmllvm.md

      
              6 files
            
          
              11 forks
            
          
              13 comments
            
          
              122 stars
            
          
                yurydelendik
                / !wasmllvm.md
            
            
              Last active
              February 23, 2024 05:08
            
              
                Using WebAssembly in LLVM
              
          
    NOTE: the content is out-of-date. All development is moved to the https://github.com/yurydelendik/wasmception
Using WebAssembly in LLVM

Compiling

# locations, e.g.
export WORKDIR=~/llvmwasm; mkdir -p $WORKDIR
export INSTALLDIR=$WORKDIR