Push CSV data to Cyfe in command line

csv2json.awk

BEGIN{
  FS=","
  OFS=""
  getline
  for(i=1;i<=NF;i++)
    names[i] = ($i)
}
{
  print "{"
  for(i=1;i<=NF;i++)
  {
    printf " %s:%s%s\n",names[i],($i),(i == NF ? "" : ",")
  }
  print "}\n,"
}

cyfe-push-csv.bat

@echo OFF
setlocal

REM Push CSV data to Cyfe using Push API (https://www.cyfe.com/api)
REM
REM http://ellab.org/
REM @angusdev
REM
REM %1 json template file
REM %2 csv file
REM %3 the output json file (you will need to delete it manually)
REM %4 Push API Endpoint
REM

REM convert csv to data json
REM If you need to modify the header of the CSV, you can use below script instead
REM   sed "1s/^.*$/\"Column1\",\"Column2\"/" %2 > %2.0.tmp
REM   gawk -f csv2json.awk %2.0.tmp > %2.1.tmp
REM   del %2.0.tmp
gawk -f csv2json.awk %2 > %2.1.tmp
REM remove the last line (which is a ',')
sed "$ d" %2.1.tmp > %2.2.tmp
REM make the json
set JSON_HEAD="{ "data": ["
call :dequote %JSON_HEAD%
echo %ret% > %3
type %2.2.tmp >> %3
type %1 >> %3
REM remove temp files
del %2.1.tmp
del %2.2.tmp

REM call Cyfe Push API
REM use -k if encounter certificate problem
curl -H "Content-Type: application/json" --data @%3 https://app.cyfe.com/api/push/%4
REM curl -k -H "Content-Type: application/json" --data @%3 https://app.cyfe.com/api/push/%4

endlocal
goto :eof

:dequote
setlocal
rem The tilde in the next line is the really important bit.
set thestring=%~1
endlocal&set ret=%thestring%
goto :eof

:eof

Cyfe-Push-CSV.md

Push CSV Data to Cyfe in command line

Usage

In Cyfe.com

• Add Widget -> Custom -> Push API
• Click Configure Widget
• Copy the API Endpoint

For example, if the API Endpoint is https://app.cyfe.com/api/push/54cbb5c62f21f359341803978798

Run in command line:

./cyfe-push-csv.sh example.tmpl example.csv example.json 54cbb5c62f21f359341803978798
{"status":"ok","message":"Data pushed"}

On error:

./cyfe-push-csv.sh example.tmpl example.csv example.json 54cbb5c62f21f359341803978798
{"status":"error","message":"No data"}

Windows

On Windows, you will need to download the Windows port of gawk, sed and curl. UnxUtils is preferred as there is no need for extra DLLs.

cURL

• curl 7.40.0 (direct link)

UnxUtils

• gawk 3.1.3, sed 4.0.7 (direct link)

GnuWin32

• gawk 3.1.6 (direct link)
• sed 4.2.1 (direct link)
• libintl3.dll 0.14.4 (direct link)
• libiconv2.dll 1.9.2 (direct link)
• regex2.dll 2.7 (direct link)

Tested Platforms

• OS X Mavericks
• Windows 7 64 bit

Disclaimer

csv2json.awk program is modified from perkee's work

@angusdev
© 2015 ellab.org

cyfe-push-csv.sh

#!/bin/sh
#
# Push CSV data to Cyfe using Push API (https://www.cyfe.com/api)
#
# http://ellab.org/
# @angusdev
#
# $1 json template file
# $2 csv file
# $3 the output json file (you will need to delete it manually)
# $4 Push API Endpoint
#

# convert csv to data json
# If you need to modify the header of the CSV, you can use below script instead
#   sed '1s/^.*$/"Column1","Column2"/' $2 > $2.0.tmp
#   awk -f csv2json.awk $2.0.tmp > $2.1.tmp
#   rm -f $2.0.tmp
awk -f csv2json.awk $2 > $2.1.tmp
# remove the last line (which is a ',')
sed '$ d' $2.1.tmp > $2.2.tmp
# make the json
echo "{ \"data\": [" > $3
cat $2.2.tmp >> $3
cat $1 >> $3
# remove temp files
rm -f $2.1.tmp
rm -f $2.2.tmp

# call Cyfe Push API
curl -H "Content-Type: application/json" --data @$3 https://app.cyfe.com/api/push/$4
echo

example.csv

example.json

{ "data": [
{
 "Date":20150101,
 "Users":10
}
,
{
 "Date":20150102,
 "Users":21
}
,
{
 "Date":20150103,
 "Users":15
}
  ],
  "onduplicate":  {
    "Users":  "replace"
  },
  "color":  {
    "Users":  "#52ff7f"
  },
  "type":  {
    "Users":  "line"
  }
}

example.tmpl

  ],
  "onduplicate":  {
    "Users":  "replace"
  },
  "color":  {
    "Users":  "#52ff7f"
  },
  "type":  {
    "Users":  "line"
  }
}