curl-based HTTP mirroring script
This is a script that creatively uses the
curl CLI to download an HTTP resource (colloquially "file"); It saves time & bandwidth whenever possible, but not at the expense of correctness.
ETags to make sure that an unchanged resource is not transfered again, but a changed resource always is.
- Requests a CE-coded (a.k.a. compressed, e.g. gzipped) representation of the resource, falling back to the "regular" one.
- Supports continuation, using conditional requests, but in contrast to the
-C -curl flag works with CE-coded responses, and falls back to a "full body" request.