Disclaimer: This is dumb. If anybody knows a better way, I'm all ears.
You have two Android projects. One is a library and one is an app that depends on that library. Both are on your local machine.
Now, say you want to test the library in the app before you publish it. Here's what you do.
You have an app and a lib: