ethanc8

Executorch LLM tutorial

Converting LLMs to Executorch format

• Conversion of stories110M (Llama-2 architecture) to Executorch on Colab

Building Executorch for edge devices

Using Executorch on edge devices

ethanc8

It seems that WizardLM has deleted all of their models. I'm posting here a few of the mirrors of these models. Feel free to add more mirrors as you find them -- you can copy the text of this post if you want.

I have not verified that the following mirrors are identical to the original models. Please use with caution.

If you find any more, please leave a comment here. If you have any on your hard disk and have sufficient bandwidth and time to upload them to HuggingFace, that would be greatly appreciated. Note that this focuses on bf16 versions of the models, in pytorch pickles or in safetensors, as those are closest to the original.

WizardLM-2

• WizardLM-2-7B, based on Mistral-7B-v0.1
• WizardLM-2-8x22B, based on Mixtral-8x22B
• WizardLM-2-70B, based on Llama2-70B, was never released

ethanc8

RoboRIO Deployment from Linux

Using open-ds and the proper radio configurations, you can deploy to the RoboRIO from Linux!

This might be useful for team members who mostly program on Linux, if you have vision/coprocessor code that is easier to develop on Linux but you also need to work on robot code, or if you want to set up a Raspberry Pi or other ARM64 system as a lab computer to do programming.

Networking setup

1. Connect power to the roboRIO
2. Plug a Power-Over-Ethernet splitter into the radio's left port, and connect the power cable to power and the other cable to the roboRIO (by plugging in a normal Ethernet cable)

ethanc8

Flashing the RoboRIO from Linux (work-in-progress)

Using the web configuration

Linux Drivers

APT repository

wget https://github.com/ethanc8/ni-driver-sources/releases/download/2023Q4/ni-ubuntu2204-drivers-2023Q4.deb

ethanc8

Quick tip: How to SSH between your Linux laptop and your Android phone using Termux

If you've ever wanted to write code on your Android phone, or work on files on your laptop while you're standing around somewhere you can't pull out your laptop, this is the way to do it!

Set up

On your Android phone, please install F-Droid. You'll need to download the APK and open it. If it asks you whether you want to install an "unknown app", allow it. Then, in F-Droid, search for "Termux" and install the "Termux" app.

Alternatively, you can download the Termux APK by itself, but it won't auto-update.

Now, you're ready to follow with this guide. Please follow this guide on a secure network, as it will temporarily leave your devices open to network attacks. Once you've finished the setup process, it will be safe to use on insecure networks.