Skip to content

Instantly share code, notes, and snippets.

@tonyfast
Last active August 29, 2015 14:04
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save tonyfast/eb173fc2e89099adb1ba to your computer and use it in GitHub Desktop.
Save tonyfast/eb173fc2e89099adb1ba to your computer and use it in GitHub Desktop.
Lab to the cloud on a dime

Abstract

A simple stack for sharing research data on the fly using Windows 7 + SyncToy + Task Scheduler + Dropbox. This is information generated from a Agilent Nanoindentation machine; it include raw data, processed reports, and visualizations as metadata.

Motivation

Many users generate information from a single piece of experimental equipment. This machine is a standalone desktop system that is networked. Also, the equipment is available for general use with our Shared Resources Equipment at Georgia Tech. Often users move small packets of information with thumb drives or email; there is no reason to sacrifice expediency for something that can be automated. This description aims to expedite this process on a budget.

How it works

Our information sits on a Windows 7 machine. The experimental software saves all information to a single folder. This folder is synced to a (public) Dropbox folder on my account (which I fortunately have a bunch of space in) using SyncToy.

Using SyncToy

How to Geek describes how to set up SyncToy and Task Scheduler. When I set up the SyncToy I use the contribute setting to move information from that native application folder to the Dropbox folder. contribute means that the native application is immutable and the Dropbox folder can be changed.

Later I will create an archival service for the immutable data.

Task scheduler is used to sync the application folder to the Dropbox folder either once a day or at the user's request using the SyncToy Application.

Federating Data on Dropbox

I have a large amount of space on my Dropbox account. I am using my Dropbox account to make the information publicly available in the cloud for my colleagues to access. The users can easily add a shared or public Dropbox folder to their own personal cloud.

When all is said and done there are three copies of the raw experimental information.

  1. Stored in the native application folder.
  2. Stored in a publicly available Dropbox folder from a data steward.
  3. Stored in a publicaly available Dropbox folder for a scientific user.

Advantages

  • More science should be done when scientists are doing science. Productivity enhancements are a simple way to not only get back to doing science, but save time in the scientific process.
  • Automatic Replication
  • Dropbox versions datafiles
  • Collaborators can access information organically from data generaters.
  • Webhooks can be added for automated workflows.
  • Dropbox provides native views for Excel files and Images.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment