Elasticsearch Painless script which aims to calculate the difference in days between a date indexed into a document and the current date.
GET days_compare/_search
{
"script_fields": {
"diffdate": {
"script": {
"lang": "painless",
"source": """
UPDATE: I have baked the ideas in this file inside a Python CLI tool called pyds-cli. Please find it here: https://github.com/ericmjl/pyds-cli
Having done a number of data projects over the years, and having seen a number of them up on GitHub, I've come to see that there's a wide range in terms of how "readable" a project is. I'd like to share some practices that I have come to adopt in my projects, which I hope will bring some organization to your projects.
Disclaimer: I'm hoping nobody takes this to be "the definitive guide" to organizing a data project; rather, I hope you, the reader, find useful tips that you can adapt to your own projects.
Disclaimer 2: What I’m writing below is primarily geared towards Python language users. Some ideas may be transferable to other languages; others may not be so. Please feel free to remix whatever you see here!
There exist several DI frameworks / libraries in the Scala ecosystem. But the more functional code you write the more you'll realize there's no need to use any of them.
A few of the most claimed benefits are the following:
Hmm... I don't see any docs for 4.0 on https://webpack.js.org. I guess I'll just wing it.
All I need to do is npm i -D webpack@next, right?
+ webpack@4.0.0-beta.2
| From -> https://forum.synology.com/enu/viewtopic.php?t=98124 | |
| 1. Go to your console ( https://console.developers.google.com/ ) and create a project. | |
| 2. Create a bucket in Storage -> Cloud Storage -> Storage Browser | |
| 3. Go to Storage -> Cloud Storage -> Storage Access and enable Interoperability | |
| 4. Generate access key | |
| 5. Now go to DSM 5.2 and install Hyper Backup if you havent already. | |
| 6. Pick S3 storage | |
| 7. The input next to the label "S3 Server" is both text input and drop-down. This is where you write "storage.googleapis.com" | |
| 8. Enter key and secret. |
|
You'll probably be working with a single smartcard, so you'll want only one primary key ( |
| def s3_to_pandas(client, bucket, key, header=None): | |
| # get key using boto3 client | |
| obj = client.get_object(Bucket=bucket, Key=key) | |
| gz = gzip.GzipFile(fileobj=obj['Body']) | |
| # load stream directly to DF | |
| return pd.read_csv(gz, header=header, dtype=str) | |
| def s3_to_pandas_with_processing(client, bucket, key, header=None): |
| const timing = store => next => action => { | |
| performance.mark(`${action.type}_start`); | |
| let result = next(action); | |
| performance.mark(`${action.type}_end`); | |
| performance.measure( | |
| `${action.type}`, | |
| `${action.type}_start`, | |
| `${action.type}_end` | |
| ); | |
| return result; |
| -- This is v0.6 of the custom script for AlfredApp for iTerm 2.9+ | |
| -- Please see https://github.com/stuartcryan/custom-iterm-applescripts-for-alfred/ | |
| -- for the latest changes. | |
| -- Please note, if you store the iTerm binary in any other location than the Applications Folder | |
| -- please ensure you update the two locations below (in the format of : rather than / for folder dividers) | |
| -- this gets around issues with AppleScript not handling things well if you have two iTerm binaries on your system... which can happen :D | |
| on alfred_script(q) | |
| if application "iTerm2" is running or application "iTerm" is running then |