Merge pull request #75 from jackwaudby/master

fixed sed issue, updated README.md

Author: szarnyasg

.gitignore

@@ -11,3 +11,4 @@ validation_params.csv
 *-actual.json
 *-expected.json
 results-*/
+*.DS_Store

cypher/README.md

@@ -40,6 +40,14 @@ The following script takes care of those steps:
 ./convert-csvs.sh
 ```
 
+Note, if you are using OSX please install `gnu-sed`. 
+```bash
+brew install gnu-sed 
+# GNU "sed" is installed as "gsed"
+# to use as "sed" add a "gnubin" directory to PATH from your start-up file 
+export PATH="/usr/local/opt/gnu-sed/libexec/gnubin:$PATH"
+```
+
 #### Delete your database and load the SNB CSVs
 
 Be careful -- this deletes all data in your database, imports the SNB data set and restarts the database.

cypher/load-scripts/convert-csvs.sh

@@ -1,5 +1,7 @@
 #!/bin/bash
 
+echo "starting preprocessing"
+
 # replace headers
 while read line; do
   IFS=' ' read -r -a array <<< $line
@@ -21,3 +23,5 @@ sed -i "s#|\([0-9][0-9][0-9][0-9]\)-\([0-9][0-9]\)-\([0-9][0-9]\)|#|\1\2\3|#g" "
 # convert each datetime of format yyyy-mm-ddThh:mm:ss.mmm+0000
 # to a number of format yyyymmddhhmmssmmm
 sed -i "s#|\([0-9][0-9][0-9][0-9]\)-\([0-9][0-9]\)-\([0-9][0-9]\)T\([0-9][0-9]\):\([0-9][0-9]\):\([0-9][0-9]\)\.\([0-9][0-9][0-9]\)+0000#|\1\2\3\4\5\6\7#g" ${NEO4J_DATA_DIR}/*${POSTFIX}
+
+echo "preprocessing finished"