Brian Lambert brian-pieces

## readme.md

      
              2 files
            
          
              0 forks
            
          
              0 comments
            
          
              1 star
            
          
                jarmitage
                / readme.md
            
            
              Last active
              March 15, 2023 14:45
            
              
                Test running ONNX models on Bela via ROOT@CERN's SOFIE inference code generator
              
          
    SOFIE


Code generation for fast inference of Deep Learning models
ROOT/TMVA SOFIE (“System for Optimized Fast Inference code Emit”) is a new package introduced in this release that generates C++ functions easily invokable for the fast inference of trained neural network models. It takes ONNX model files as inputs and produces C++ header files that can be included and utilized in a “plug-and-go” style. This is a new development and it is currently still in experimental stage.
SOFIE can take your trained ONNX model and generate blazingly fast C++ code from it, depending only on BLAS.


Announcement https://root.cern/doc/v626/release-notes.html#sofie-code-generation-for-fast-inference-of-deep-learning-models
SOFIE was created by Sitong An https://sitongan.github.io/ a Marie Curie Fellow at CERN
Supported ONNX operators: https://github.com/root-project/root/blob/master/tmva/sofie/inc/TMVA/OperatorList.hxx
SOFIE is part of TMVA, the ROOT Machine Learning library https://root.cern/manual/tmva/


## private_fork.md

      
              1 file
            
          
              488 forks
            
          
              78 comments
            
          
              1806 stars
            
          
                0xjac
                / private_fork.md
            
            
              Last active
              June 22, 2024 16:34
            
              
                Create a private fork of a public repository
              
          
    The repository for the assignment is public and Github does not allow the creation of private forks for public repositories.
The correct way of creating a private frok by duplicating the repo is documented here.
For this assignment the commands are:

Create a bare clone of the repository.
(This is temporary and will be removed so just do it wherever.)


git clone --bare git@github.com:usi-systems/easytrace.git

  
## latency.txt
Latency Comparison Numbers (~2012)
----------------------------------
L1 cache reference                           0.5 ns
Branch mispredict                            5   ns
L2 cache reference                           7   ns                      14x L1 cache
Mutex lock/unlock                           25   ns
Main memory reference                      100   ns                      20x L2 cache, 200x L1 cache
Compress 1K bytes with Zippy             3,000   ns        3 us
Send 1K bytes over 1 Gbps network       10,000   ns       10 us
Read 4K randomly from SSD*             150,000   ns      150 us          ~1GB/sec SSD
	Latency Comparison Numbers (~2012)
	----------------------------------
	L1 cache reference 0.5 ns
	Branch mispredict 5 ns
	L2 cache reference 7 ns 14x L1 cache
	Mutex lock/unlock 25 ns
	Main memory reference 100 ns 20x L2 cache, 200x L1 cache
	Compress 1K bytes with Zippy 3,000 ns 3 us
	Send 1K bytes over 1 Gbps network 10,000 ns 10 us
	Read 4K randomly from SSD* 150,000 ns 150 us ~1GB/sec SSD