Skip to content

Instantly share code, notes, and snippets.

@stuartcampbell
stuartcampbell / README.md
Created December 16, 2019 21:59 — forked from danielballan/README.md
data-transfer

Running a Local DataBroker

Place downloaded files

The shared Globus endpoint includes one messagepack (*.msgpack) file per Bluesky Run. DataBroker can run on top of these filesdirectly, and that's how we'll start. Alternatively, we can read the contents of these files into MongoDB to gain better performance and support for more advanced search queries. We'll address that process at the end. It may or may not be necessary depending on your needs.