Landon Curt Noll
499be5983d
If the [jsp tool](https://github.com/kjozsa/jsp) is installed, it will be used in favor of the [JSONPath.sh tool](https://github.com/lcn2/JSONPath.sh). Updated `bin/jfmt-wrapper.sh`, `bin/jprint-wrapper.sh`, and `bin/jval-wrapper.sh` to use jsp if found. These 3 tools may be given `-t tool` where tool is either "_jsp_" or "_JSONPath.sh_" for force the use of the tool. They also use `-Q` to perform a quick check tool using trivial input. The `bin/jval-wrapper.sh` tool had been simplified. The `-w`, `-i` and `-u` options are gone. Instead it has: ``` -b print only values (def: print both JSON member and JSON value) -q remove enclosing double quotes (def: keep any enclosing double quotes) ``` Add `make all_jfmt` to Makefile to canonically format all entry and author handle JSON files. A sed script `bin/unicode-fix.sed` has been added that converts JSON string "_\u[0-9A-Fa-f]{4}_" encoding that may arise from known JSON data. This is done as a work-a-round for [Unicode / UTF-8 issues](https://github.com/xexyl/jparse/issues/13) with `jstrdecode(1)`. The `bin/unicode-chk.sh` tool, if given on file arguments, scans all `.entry.json` and `author/author_handle.json` JSON files to be sure that, after `bin/unicode-fix.sed` processing, no JSON string "_\u[0-9A-Fa-f]{4}_" encodings remain. Removed all `-j jparse` args from commands. Instead the `jparse(1)` tool is looked for along $PATH. Added `combine_author_handle.sh` tool to transform all of the `author/author_handle.json` files into a temporary as a single JSON file so that `bin/jval-wrapper.sh` tool may be used to extract all "_sort_word_" or all "_entry_id_" values. Changed `bin/all-jfmt.sh` VERSION from "1.0 2024-08-31" to "1.1 2024-09-24". Changed `bin/csv2entry.sh` VERSION from "1.2.3 2024-08-30" to "1.3 2024-09-23". Changed `bin/cvt-submission.sh` VERSION from "1.1 2024-08-31" to "1.2 2024-09-23". Changed `bin/entry2csv.sh` VERSION from "1.2.1 2024-08-17" to "1.3 2024-09-23". Changed `bin/gen-authors.sh` VERSION from "1.12 2024-08-18" to "1.13 2024-09-23". Changed `bin/gen-location.sh` VERSION from "1.6 2024-08-18" to "1.7 2024-09-23". Changed `bin/gen-status.sh` VERSION from "1.6 2024-08-17" to "1.7 2024-09-23". Changed `bin/gen-years.sh` VERSION from "1.4 2024-08-17" to "1.5 2024-09-23". Changed `bin/jfmt-wrapper.sh` VERSION from "1.1 2024-08-20" to "1.2 2024-09-23". Changed `bin/jprint-wrapper.sh` VERSION from "1.1 2024-08-20" to "1.3 2024-09-23". Changed `bin/jval-wrapper.sh` VERSION from "1.0.4 2024-08-20" to "1.1 2024-09-23". Changed `bin/manifest.entry.json.awk` VERSION from "1.1.2 2024-07-28" to "1.2 2024-09-17". Changed `bin/output-index-author.sh` VERSION from "1.8 2024-08-17" to "1.9 2024-09-23". Changed `bin/output-year-index.sh` VERSION from "1.4.4 2024-08-05" to "1.5 2024-09-23". Changed `bin/subst.entry-index.sh` VERSION from "1.5 2024-08-13" to "1.6 2024-09-23". Added `bin/combine_author_handle.sh` VERSION "1.0 2024-09-23". Added `bin/unicode-chk.sh` VERSION "1.0 2024-09-23". Added `bin/unicode-fix.sed` VERSION "1.0 2024-09-23". Perform `make www` to perform the above and test under macOS. FYI: On our MacBook Pro, `make www` took: ``` make www 631.79s user 264.95s system 94% cpu 15:53.71 total ``` FYI: On our MacBook Pro, `make quick_www` took: ``` make quick_www 81.43s user 58.26s system 102% cpu 2:16.02 total ```
733 lines
22 KiB
Bash
Executable File
733 lines
22 KiB
Bash
Executable File
#!/usr/bin/env bash
|
|
#
|
|
# jval-wrapper.sh - print JSON values to stdout
|
|
#
|
|
# We form a wrapper for the `jval(1)`, a tool that allow the printing of JSON values.
|
|
#
|
|
# We propose that the grammar used by JSONPath.sh(1):
|
|
#
|
|
# https://github.com/lcn2/JSONPath.sh
|
|
#
|
|
# becomes the model for how `jval(1)` prints JSON values. Consider, for, example:
|
|
#
|
|
# JSONPath.sh -w -f 1984/mullender/.entry.json '$author_set..author_handle'
|
|
#
|
|
# and in particular:
|
|
#
|
|
# JSONPath.sh -w -b -f 1984/mullender/.entry.json '$author_set..author_handle'
|
|
#
|
|
# as a model of printing the `author_handle` values from the JSON `author_set` array.
|
|
#
|
|
# See the following URL for more information.
|
|
#
|
|
# https://github.com/lcn2/JSONPath.sh?tab=readme-ov-file#jsonpath-patterns-and-extensions
|
|
#
|
|
# Copyright (c) 2024 by Landon Curt Noll. All Rights Reserved.
|
|
#
|
|
# Permission to use, copy, modify, and distribute this software and
|
|
# its documentation for any purpose and without fee is hereby granted,
|
|
# provided that the above copyright, this permission notice and text
|
|
# this comment, and the disclaimer below appear in all of the following:
|
|
#
|
|
# supporting documentation
|
|
# source copies
|
|
# source works derived from this source
|
|
# binaries derived from this source or from derived source
|
|
#
|
|
# LANDON CURT NOLL DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS SOFTWARE,
|
|
# INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS. IN NO
|
|
# EVENT SHALL LANDON CURT NOLL BE LIABLE FOR ANY SPECIAL, INDIRECT OR
|
|
# CONSEQUENTIAL DAMAGES OR ANY DAMAGES WHATSOEVER RESULTING FROM LOSS OF
|
|
# USE, DATA OR PROFITS, WHETHER IN AN ACTION OF CONTRACT, NEGLIGENCE OR
|
|
# OTHER TORTIOUS ACTION, ARISING OUT OF OR IN CONNECTION WITH THE USE OR
|
|
# PERFORMANCE OF THIS SOFTWARE.
|
|
#
|
|
# chongo (Landon Curt Noll, http://www.isthe.com/chongo/index.html) /\oo/\
|
|
#
|
|
# Share and enjoy! :-)
|
|
|
|
|
|
# firewall - run only with a bash that is version 5.1.8 or later
|
|
#
|
|
# The "/usr/bin/env bash" command must result in using a bash that
|
|
# is version 5.1.8 or later.
|
|
#
|
|
# We could relax this version and insist on version 4.2 or later. Versions
|
|
# of bash between 4.2 and 5.1.7 might work. However, to be safe, we will require
|
|
# bash version 5.1.8 or later.
|
|
#
|
|
# WHY 5.1.8 and not 4.2? This safely is done because macOS Homebrew bash we
|
|
# often use is "version 5.2.26(1)-release" or later, and the RHEL Linux bash we
|
|
# use often use is "version 5.1.8(1)-release" or later. These versions are what
|
|
# we initially tested. We recommend you either upgrade bash or install a newer
|
|
# version of bash and adjust your $PATH so that "/usr/bin/env bash" finds a bash
|
|
# that is version 5.1.8 or later.
|
|
#
|
|
# NOTE: The macOS shipped, as of 2024 March 15, a version of bash is something like
|
|
# bash "version 3.2.57(1)-release". That macOS shipped version of bash
|
|
# will NOT work. For users of macOS we recommend you install Homebrew,
|
|
# (see https://brew.sh), and then run "brew install bash" which will
|
|
# typically install it into /opt/homebrew/bin/bash, and then arrange your $PATH
|
|
# so that "/usr/bin/env bash" finds "/opt/homebrew/bin" (or whatever the
|
|
# Homebrew bash is).
|
|
#
|
|
# NOTE: And while MacPorts might work, we noticed a number of subtle differences
|
|
# with some of their ported tools to suggest you might be better off
|
|
# with installing Homebrew (see https://brew.sh). No disrespect is intended
|
|
# to the MacPorts team as they do a commendable job. Nevertheless we ran
|
|
# into enough differences with MacPorts environments to suggest you
|
|
# might find a better experience with this tool under Homebrew instead.
|
|
#
|
|
if [[ -z ${BASH_VERSINFO[0]} ||
|
|
${BASH_VERSINFO[0]} -lt 5 ||
|
|
${BASH_VERSINFO[0]} -eq 5 && ${BASH_VERSINFO[1]} -lt 1 ||
|
|
${BASH_VERSINFO[0]} -eq 5 && ${BASH_VERSINFO[1]} -eq 1 && ${BASH_VERSINFO[2]} -lt 8 ]]; then
|
|
echo "$0: ERROR: bash version needs to be >= 5.1.8: $BASH_VERSION" 1>&2
|
|
echo "$0: Warning: bash version >= 4.2 might work but 5.1.8 was the minimum we tested" 1>&2
|
|
echo "$0: Notice: For macOS users: install Homebrew (see https://brew.sh), then run" \
|
|
""brew install bash" and then modify your \$PATH so that \"#!/usr/bin/env bash\"" \
|
|
"finds the Homebrew installed (usually /opt/homebrew/bin/bash) version of bash" 1>&2
|
|
exit 4
|
|
fi
|
|
|
|
|
|
# setup bash file matching
|
|
#
|
|
# We must declare arrays with -ag or -Ag, and we need loops to "export" modified variables.
|
|
# This requires a bash with a version 4.2 or later. See the larger comment above about bash versions.
|
|
#
|
|
shopt -s nullglob # enable expanded to nothing rather than remaining unexpanded
|
|
shopt -u failglob # disable error message if no matches are found
|
|
shopt -u dotglob # disable matching files starting with .
|
|
shopt -u nocaseglob # disable strict case matching
|
|
shopt -u extglob # enable extended globbing patterns
|
|
shopt -s globstar # enable ** to match all files and zero or more directories and subdirectories
|
|
|
|
|
|
# set variables referenced in the usage message
|
|
#
|
|
export VERSION="1.1 2024-09-23"
|
|
NAME=$(basename "$0")
|
|
export NAME
|
|
export V_FLAG=0
|
|
GIT_TOOL=$(type -P git)
|
|
export GIT_TOOL
|
|
if [[ -z "$GIT_TOOL" ]]; then
|
|
echo "$0: FATAL: git tool is not installed or not in \$PATH" 1>&2
|
|
exit 5
|
|
fi
|
|
"$GIT_TOOL" rev-parse --is-inside-work-tree >/dev/null 2>&1
|
|
status="$?"
|
|
if [[ $status -eq 0 ]]; then
|
|
TOPDIR=$("$GIT_TOOL" rev-parse --show-toplevel)
|
|
fi
|
|
export TOPDIR
|
|
export REPO_TOP_URL="https://github.com/ioccc-src/temp-test-ioccc"
|
|
# GitHub puts individual files under the "blob/master" sub-directory.
|
|
export REPO_URL="$REPO_TOP_URL/blob/master"
|
|
|
|
|
|
# Until we have a true jval tool, we will use wither jsp or the modified JSONPath.sh
|
|
#
|
|
# XXX - XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX - XXX
|
|
# XXX - GROSS HACK - GROSS HACK - GROSS HACK - GROSS HACK - GROSS HACK - GROSS HACK - XXX
|
|
# XXX - until we have the jval command, we use external tools to get data from JSON - XXX
|
|
# XXX - GROSS HACK - GROSS HACK - GROSS HACK - GROSS HACK - GROSS HACK - GROSS HACK - XXX
|
|
# XXX - XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX - XXX
|
|
#
|
|
export JSP_REPO="https://github.com/kjozsa/jsp"
|
|
export JSONPATH_REPO="https://github.com/lcn2/JSONPath.sh"
|
|
export FIZZBIN_JSON='"fizzbin"'
|
|
export JSP_TOOL=""
|
|
JSP_TOOL=$(type -P jsp)
|
|
export JSONPATH_SH=""
|
|
JSONPATH_SH=$(type -P JSONPath.sh)
|
|
# set the defaiult XPath for JSON
|
|
export XPATHJSON_USE="jsp"
|
|
export JSONPATH_ARG
|
|
export PATTERN=""
|
|
#
|
|
export PRINT_ONLY_VALUES=""
|
|
export REMOVE_QUOTES=""
|
|
export QUICK_CHECK=""
|
|
|
|
|
|
# set usage message
|
|
#
|
|
export USAGE="usage: $0 [-h] [-v level] [-V] [-n] [-N] [-b] [-q] [-t tool] [-Q] file.json [pattern]
|
|
|
|
-h print help message and exit
|
|
-v level set verbosity level (def level: 0)
|
|
-V print version string and exit
|
|
|
|
-n do nothing (same as -N) (def: do the action)
|
|
-N do not process file, just parse arguments and ignore the file (def: process the file)
|
|
|
|
-b print only values (def: print both JSON member and JSON value)
|
|
-q remove enclosing double quotes (def: keep any enclosing double quotes)
|
|
|
|
-t tool tool to use: jsp or JSONPath.sh (def: try jsp, otherwise try JSONPath.sh)
|
|
-Q quick check tool using trivial input (def: do not)
|
|
|
|
file.json JSON file to read, - ==> read stdin
|
|
pattern JSONPath query (def: $PATTERN}
|
|
|
|
Exit codes:
|
|
0 all OK
|
|
1 JSONPath.sh exited non-zero
|
|
2 -h and help string printed or -V and version string printed
|
|
3 command line error
|
|
4 bash version is too old
|
|
5 internal tool not found
|
|
6 file.json does not exist or is not readable
|
|
>= 10 internal error
|
|
|
|
$NAME version: $VERSION"
|
|
|
|
|
|
# setup
|
|
#
|
|
export NOOP=
|
|
export DO_NOT_PROCESS=
|
|
|
|
|
|
# parse command line
|
|
#
|
|
while getopts :hv:VnNbqt:Q flag; do
|
|
case "$flag" in
|
|
h) echo "$USAGE" 1>&2
|
|
exit 2
|
|
;;
|
|
v) V_FLAG="$OPTARG"
|
|
;;
|
|
V) echo "$VERSION"
|
|
exit 2
|
|
;;
|
|
n) NOOP="-n"
|
|
;;
|
|
N) DO_NOT_PROCESS="-N"
|
|
;;
|
|
b) PRINT_ONLY_VALUES="-b"
|
|
;;
|
|
q) REMOVE_QUOTES="true"
|
|
;;
|
|
t) # validate -t tool
|
|
case "$OPTARG" in
|
|
jsp) XPATHJSON_USE="jsp" ;;
|
|
JSONPath.sh) XPATHJSON_USE="JSONPath.sh" ;;
|
|
*) echo "$0: ERROR: unknown -t option: $OPTARG" 1>&2
|
|
echo 1>&2
|
|
echo "$USAGE" 1>&2
|
|
exit 3
|
|
;;
|
|
esac
|
|
;;
|
|
Q) QUICK_CHECK="true"
|
|
;;
|
|
\?) echo "$0: ERROR: invalid option: -$OPTARG" 1>&2
|
|
echo 1>&2
|
|
echo "$USAGE" 1>&2
|
|
exit 3
|
|
;;
|
|
:) echo "$0: ERROR: option -$OPTARG requires an argument" 1>&2
|
|
echo 1>&2
|
|
echo "$USAGE" 1>&2
|
|
exit 3
|
|
;;
|
|
*) echo "$0: ERROR: unexpected value from getopts: $flag" 1>&2
|
|
echo 1>&2
|
|
echo "$USAGE" 1>&2
|
|
exit 3
|
|
;;
|
|
esac
|
|
done
|
|
#
|
|
# parse the command line arguments
|
|
#
|
|
if [[ $V_FLAG -ge 1 ]]; then
|
|
echo "$0: debug[1]: debug level: $V_FLAG" 1>&2
|
|
fi
|
|
#
|
|
shift $(( OPTIND - 1 ));
|
|
#
|
|
if [[ $V_FLAG -ge 1 ]]; then
|
|
echo "$0: debug[5]: argument count: $#" 1>&2
|
|
fi
|
|
case "$#" in
|
|
1) JSON_FILE="$1"
|
|
;;
|
|
2) JSON_FILE="$1"
|
|
PATTERN="$2"
|
|
;;
|
|
*) echo "$0: ERROR: expected i or 2 args, found: $#" 1>&2
|
|
echo "$USAGE" 1>&2
|
|
exit 3
|
|
;;
|
|
esac
|
|
#
|
|
if [[ $JSON_FILE == "-" ]]; then
|
|
JSON_FILE=""
|
|
fi
|
|
if [[ -n $JSON_FILE ]]; then
|
|
if [[ ! -e $JSON_FILE ]]; then
|
|
echo "$0: ERROR: JSON_FILE does not exist: $JSON_FILE" 1>&2
|
|
exit 6
|
|
fi
|
|
if [[ ! -f $JSON_FILE ]]; then
|
|
echo "$0: ERROR: JSON_FILE is not a regular file: $JSON_FILE" 1>&2
|
|
exit 6
|
|
fi
|
|
if [[ ! -r $JSON_FILE ]]; then
|
|
echo "$0: ERROR: JSON_FILE is not an readable file: $JSON_FILE" 1>&2
|
|
exit 6
|
|
fi
|
|
fi
|
|
|
|
|
|
# verify that we have a topdir directory
|
|
#
|
|
REPO_NAME=$(basename "$REPO_TOP_URL")
|
|
export REPO_NAME
|
|
if [[ -z $TOPDIR ]]; then
|
|
echo "$0: ERROR: cannot find top of git repo directory" 1>&2
|
|
echo "$0: Notice: if needed: $GIT_TOOL clone $REPO_TOP_URL; cd $REPO_NAME" 1>&2
|
|
exit 6
|
|
fi
|
|
if [[ ! -e $TOPDIR ]]; then
|
|
echo "$0: ERROR: TOPDIR does not exist: $TOPDIR" 1>&2
|
|
echo "$0: Notice: if needed: $GIT_TOOL clone $REPO_TOP_URL; cd $REPO_NAME" 1>&2
|
|
exit 6
|
|
fi
|
|
if [[ ! -d $TOPDIR ]]; then
|
|
echo "$0: ERROR: TOPDIR is not a directory: $TOPDIR" 1>&2
|
|
echo "$0: Notice: if needed: $GIT_TOOL clone $REPO_TOP_URL; cd $REPO_NAME" 1>&2
|
|
exit 6
|
|
fi
|
|
|
|
|
|
# cd to topdir
|
|
#
|
|
if [[ ! -e $TOPDIR ]]; then
|
|
echo "$0: ERROR: cannot cd to non-existent path: $TOPDIR" 1>&2
|
|
exit 6
|
|
fi
|
|
if [[ ! -d $TOPDIR ]]; then
|
|
echo "$0: ERROR: cannot cd to a non-directory: $TOPDIR" 1>&2
|
|
exit 6
|
|
fi
|
|
export CD_FAILED
|
|
if [[ $V_FLAG -ge 5 ]]; then
|
|
echo "$0: debug[5]: about to: cd $TOPDIR" 1>&2
|
|
fi
|
|
cd "$TOPDIR" || CD_FAILED="true"
|
|
if [[ -n $CD_FAILED ]]; then
|
|
echo "$0: ERROR: cd $TOPDIR failed" 1>&2
|
|
exit 6
|
|
fi
|
|
if [[ $V_FLAG -ge 3 ]]; then
|
|
echo "$0: debug[3]: now in directory: $(/bin/pwd)" 1>&2
|
|
fi
|
|
|
|
|
|
# verify that we have a bin subdirectory
|
|
#
|
|
export BIN_PATH="$TOPDIR/bin"
|
|
if [[ ! -d $BIN_PATH ]]; then
|
|
echo "$0: ERROR: bin is not a directory under topdir: $BIN_PATH" 1>&2
|
|
exit 6
|
|
fi
|
|
export BIN_DIR="bin"
|
|
|
|
|
|
# verify that the bin/unicode-fix.sed tool is executable
|
|
#
|
|
export UNICODE_FIX_SED="$BIN_DIR/unicode-fix.sed"
|
|
if [[ ! -e $UNICODE_FIX_SED ]]; then
|
|
echo "$0: ERROR: bin/unicode-fix.sed does not exist: $UNICODE_FIX_SED" 1>&2
|
|
exit 5
|
|
fi
|
|
if [[ ! -f $UNICODE_FIX_SED ]]; then
|
|
echo "$0: ERROR: bin/unicode-fix.sed is not a regular file: $UNICODE_FIX_SED" 1>&2
|
|
exit 5
|
|
fi
|
|
if [[ ! -r $UNICODE_FIX_SED ]]; then
|
|
echo "$0: ERROR: bin/unicode-fix.sed is not an readable file: $UNICODE_FIX_SED" 1>&2
|
|
exit 5
|
|
fi
|
|
|
|
|
|
# validate the XPath for JSON tool
|
|
#
|
|
case "$XPATHJSON_USE" in
|
|
|
|
# case: we will use JSONPath.sh
|
|
#
|
|
JSONPath.sh)
|
|
|
|
# try JSONPath.sh
|
|
#
|
|
if [[ -z $JSONPATH_SH || ! -x $JSONPATH_SH ]]; then
|
|
echo "$0: ERROR: JSONPath.sh tool is not installed, is not executable, or not in \$PATH" 1>&2
|
|
echo "$0: notice: obtain jsp from: $JSP_REPO" 1>&2
|
|
echo "$0: notice: or obtain jsp via \"pipx install jsp\" and placing ~/.local/bin in \$PATH" 1>&2
|
|
echo "$0: notice: obtain JSONPath.sh from: $JSONPATH_REPO" 1>&2
|
|
echo "$0: notice: if possible install jsp instead of JSONPath.sh as jsp is faster" 1>&2
|
|
exit 5
|
|
fi
|
|
|
|
# case: -Q - perform quick check
|
|
#
|
|
if [[ -n $QUICK_CHECK ]]; then
|
|
# verify JSONPath.sh supports -S -A -p
|
|
if ! "$JSONPATH_SH" -S -A -p >/dev/null 2>&1; then
|
|
echo "$0: ERROR: JSONPath.sh tool does not support -S -A: $FIZZBIN_JSON" 1>&2
|
|
echo "$0: notice: we recommend you obtain and install jsp from: $JSP_REPO" 1>&2
|
|
echo "$0: notice: or obtain jsp via \"pipx install jsp\" and placing ~/.local/bin in \$PATH" 1>&2
|
|
echo "$0: notice: otherwise install JSONPath.sh from: $JSONPATH_REPO" 1>&2
|
|
echo "$0: notice: if possible install jsp instead of JSONPath.sh as jsp is faster" 1>&2
|
|
exit 5
|
|
fi <<< "$FIZZBIN_JSON"
|
|
fi
|
|
;;
|
|
|
|
# case: we will use jsp
|
|
#
|
|
jsp)
|
|
|
|
# try jsp
|
|
#
|
|
if [[ -z $JSP_TOOL || ! -x $JSP_TOOL ]]; then
|
|
echo "$0: ERROR: jsp.sh tool is not installed, is not executable, or not in \$PATH" 1>&2
|
|
echo "$0: notice: obtain jsp from: $JSP_REPO" 1>&2
|
|
echo "$0: notice: or obtain jsp via \"pipx install jsp\" and placing ~/.local/bin in \$PATH" 1>&2
|
|
echo "$0: notice: obtain JSONPath.sh from: $JSONPATH_REPO" 1>&2
|
|
echo "$0: notice: if possible install jsp instead of JSONPath.sh as jsp is faster" 1>&2
|
|
exit 5
|
|
fi
|
|
|
|
# case: -Q - perform quick check
|
|
#
|
|
if [[ -n $QUICK_CHECK ]]; then
|
|
# verify jsp
|
|
if ! "$JSP_TOOL" --indent 4 --format --no-color >/dev/null 2>&1; then
|
|
echo "$0: ERROR: jsp tool does not support --indent 4 --format --no-color: $FIZZBIN_JSON" 1>&2
|
|
echo "$0: notice: you might need to update and reinstall jsp from: $JSP_REPO" 1>&2
|
|
echo "$0: notice: or obtain jsp via \"pipx install jsp\" and placing ~/.local/bin in \$PATH" 1>&2
|
|
echo "$0: notice: or you might try to obtain and install JSONPath.sh from: $JSONPATH_REPO" 1>&2
|
|
echo "$0: notice: if possible install jsp instead of JSONPath.sh as jsp is faster" 1>&2
|
|
exit 5
|
|
fi <<< "$FIZZBIN_JSON"
|
|
fi
|
|
;;
|
|
|
|
# case: we do not have an XPath for JSON tool
|
|
#
|
|
*)
|
|
echo "$0: ERROR: cannot find an XPath JSON tool to use" 1>&2
|
|
echo "$0: notice: we recommend you obtain and install jsp from: $JSP_REPO" 1>&2
|
|
echo "$0: notice: or obtain jsp via \"pipx install jsp\" and placing ~/.local/bin in \$PATH" 1>&2
|
|
echo "$0: notice: otherwise install JSONPath.sh from: $JSONPATH_REPO" 1>&2
|
|
echo "$0: notice: if possible install jsp instead of JSONPath.sh as jsp is faster" 1>&2
|
|
exit 5
|
|
;;
|
|
esac
|
|
|
|
|
|
# print running info if verbose
|
|
#
|
|
# If -v 3 or higher, print exported variables in order that they were exported.
|
|
#
|
|
if [[ $V_FLAG -ge 3 ]]; then
|
|
echo "$0: debug[3]: VERSION=$VERSION" 1>&2
|
|
echo "$0: debug[3]: NAME=$NAME" 1>&2
|
|
echo "$0: debug[3]: V_FLAG=$V_FLAG" 1>&2
|
|
echo "$0: debug[3]: GIT_TOOL=$GIT_TOOL" 1>&2
|
|
echo "$0: debug[3]: TOPDIR=$TOPDIR" 1>&2
|
|
echo "$0: debug[3]: REPO_TOP_URL=$REPO_TOP_URL" 1>&2
|
|
echo "$0: debug[3]: REPO_URL=$REPO_URL" 1>&2
|
|
echo "$0: debug[3]: JSP_REPO=$JSP_REPO" 1>&2
|
|
echo "$0: debug[3]: JSONPATH_REPO=$JSONPATH_REPO" 1>&2
|
|
echo "$0: debug[3]: FIZZBIN_JSON=$FIZZBIN_JSON" 1>&2
|
|
echo "$0: debug[3]: JSP_TOOL=$JSP_TOOL" 1>&2
|
|
echo "$0: debug[3]: JSONPATH_SH=$JSONPATH_SH" 1>&2
|
|
echo "$0: debug[3]: XPATHJSON_USE=$XPATHJSON_USE" 1>&2
|
|
echo "$0: debug[3]: PATTERN=$PATTERN" 1>&2
|
|
echo "$0: debug[3]: PRINT_ONLY_VALUES=$PRINT_ONLY_VALUES" 1>&2
|
|
echo "$0: debug[3]: REMOVE_QUOTES=$REMOVE_QUOTES" 1>&2
|
|
echo "$0: debug[3]: QUICK_CHECK=$QUICK_CHECK" 1>&2
|
|
echo "$0: debug[3]: NOOP=$NOOP" 1>&2
|
|
echo "$0: debug[3]: DO_NOT_PROCESS=$DO_NOT_PROCESS" 1>&2
|
|
echo "$0: debug[3]: JSON_FILE=$JSON_FILE" 1>&2
|
|
echo "$0: debug[3]: REPO_NAME=$REPO_NAME" 1>&2
|
|
echo "$0: debug[3]: CD_FAILED=$CD_FAILED" 1>&2
|
|
echo "$0: debug[3]: BIN_PATH=$BIN_PATH" 1>&2
|
|
echo "$0: debug[3]: BIN_DIR=$BIN_DIR" 1>&2
|
|
echo "$0: debug[3]: UNICODE_FIX_SED=$UNICODE_FIX_SED" 1>&2
|
|
fi
|
|
|
|
|
|
# -N stops early before any processing is performed
|
|
#
|
|
if [[ -n $DO_NOT_PROCESS ]]; then
|
|
if [[ $V_FLAG -ge 3 ]]; then
|
|
echo "$0: debug[3]: arguments parsed, -N given, exiting 0" 1>&2
|
|
fi
|
|
exit 0
|
|
fi
|
|
|
|
|
|
# -n means we have nothing to do
|
|
#
|
|
if [[ -n $NOOP ]]; then
|
|
if [[ $V_FLAG -ge 1 ]]; then
|
|
echo "$0: debug[3]: -n given, nothing to do, exiting 0" 1>&2
|
|
fi
|
|
exit 0
|
|
fi
|
|
|
|
|
|
# canonically process JSON from standard input via jsp
|
|
#
|
|
case "$XPATHJSON_USE" in
|
|
|
|
# case: use jsp
|
|
#
|
|
jsp)
|
|
|
|
# if not set, set the default jsp pattern
|
|
#
|
|
PATTERN="${PATTERN:=$}"
|
|
|
|
# case: jsp processing from standard input
|
|
#
|
|
if [[ -z $JSON_FILE ]]; then
|
|
|
|
if [[ $V_FLAG -ge 3 ]]; then
|
|
echo "$0: debug[3]: about to: $JSP_TOOL --no-color --format --indent 0 -- '$PATTERN'" 1>&2
|
|
fi
|
|
"$JSP_TOOL" --no-color --format --indent 0 -- "$PATTERN"
|
|
status="$?"
|
|
if [[ $status -ne 0 ]]; then
|
|
echo "$0: ERROR: $JSP_TOOL --no-color --format --indent 0 -- '$PATTERN' failed", \
|
|
"error code: $status" 1>&2
|
|
exit 1
|
|
fi
|
|
|
|
# case: jsp processing from a file
|
|
#
|
|
else
|
|
|
|
if [[ $V_FLAG -ge 3 ]]; then
|
|
echo "$0: debug[3]: about to: $JSP_TOOL --no-color --format --indent 0 -- '$PATTERN' < $JSON_FILE" 1>&2
|
|
fi
|
|
"$JSP_TOOL" --no-color --format --indent 0 -- "$PATTERN" < "$JSON_FILE"
|
|
status="$?"
|
|
if [[ $status -ne 0 ]]; then
|
|
echo "$0: ERROR: $JSP_TOOL --no-color --format --indent 0 -- '$PATTERN' < $JSON_FILE failed", \
|
|
"error code: $status" 1>&2
|
|
exit 1
|
|
fi
|
|
|
|
# case: print only values from jsp output
|
|
#
|
|
fi | if [[ -n $PRINT_ONLY_VALUES ]]; then
|
|
|
|
# case: -q -b (print only values and remove double quotes) via jsp
|
|
#
|
|
if [[ -n $REMOVE_QUOTES ]]; then
|
|
|
|
sed -E -e '/^\s*[]{}[],?\s*$/d' \
|
|
-e 's/^\s*("[^"]*[^\\]*"):\s+/\1\t/' \
|
|
-e 's/^"[^\t]*"\t//' \
|
|
-e 's/,?$//' \
|
|
-e 's/^"//' \
|
|
-e 's/",?$//' \
|
|
-e '/^\[$/d'
|
|
status="$?"
|
|
if [[ $status -ne 0 ]]; then
|
|
echo "$0: ERROR: pipe from -t jsp options: -q -b: sed -E -e ... failed", \
|
|
"error code: $status" 1>&2
|
|
exit 1
|
|
fi
|
|
|
|
# case: -b (print only values) via jsp
|
|
#
|
|
else
|
|
|
|
sed -E -e '/^\s*[]{}[],?\s*$/d' \
|
|
-e 's/^\s*("[^"]*[^\\]*"):\s+/\1\t/' \
|
|
-e 's/^"[^\t]*"\t//' \
|
|
-e 's/,?$//' \
|
|
-e '/^\[$/d'
|
|
status="$?"
|
|
if [[ $status -ne 0 ]]; then
|
|
echo "$0: ERROR: pipe from -t jsp options: -b: sed -E -e ... failed", \
|
|
"error code: $status" 1>&2
|
|
exit 1
|
|
fi
|
|
fi
|
|
|
|
# case: print both JSON member and JSON value from jsp output
|
|
#
|
|
else
|
|
|
|
# case: -q without -b (print both JSON member and JSON value and remove double quotes) via jsp
|
|
#
|
|
if [[ -n $REMOVE_QUOTES ]]; then
|
|
|
|
sed -E -e '/^\s*[]{}[],?\s*$/d' \
|
|
-e 's/^\s*("[^"]*[^\\]*"):\s+/\1\t/' \
|
|
-e 's/,?$//' \
|
|
-e 's/^"//' \
|
|
-e 's/"\t"?/\t/' \
|
|
-e 's/"$//' \
|
|
-e '/\t\[$/d'
|
|
status="$?"
|
|
if [[ $status -ne 0 ]]; then
|
|
echo "$0: ERROR: pipe from -t jsp options: -q: sed -E -e ... failed", \
|
|
"error code: $status" 1>&2
|
|
exit 1
|
|
fi
|
|
|
|
# case: without -b (print only values) via jsp
|
|
#
|
|
else
|
|
|
|
sed -E -e '/^\s*[]{}[],?\s*$/d' \
|
|
-e 's/^\s*("[^"]*[^\\]*"):\s+/\1\t/' \
|
|
-e 's/,?$//' \
|
|
-e '/\t\[$/d'
|
|
status="$?"
|
|
if [[ $status -ne 0 ]]; then
|
|
echo "$0: ERROR: pipe from -t jsp: sed -E -e ... failed", \
|
|
"error code: $status" 1>&2
|
|
exit 1
|
|
fi
|
|
|
|
fi
|
|
fi
|
|
;;
|
|
|
|
|
|
# case: use JSONPath.sh
|
|
#
|
|
JSONPath.sh)
|
|
|
|
# if not set, set the default JSONPath.sh pattern
|
|
#
|
|
PATTERN="${PATTERN:=$.*}"
|
|
|
|
# case: JSONPath.sh processing from standard input
|
|
#
|
|
if [[ -z $JSON_FILE ]]; then
|
|
|
|
if [[ $V_FLAG -ge 1 ]]; then
|
|
echo "$0: debug[1]: about to: $JSONPATH_SH -w -u -- '$PATTERN'" 1>&2
|
|
fi
|
|
"$JSONPATH_SH" -w -u -- "$PATTERN"
|
|
status="$?"
|
|
if [[ $status -ne 0 ]]; then
|
|
echo "$0: ERROR: $JSONPATH_SH -w -u -- '$PATTERN' failed", \
|
|
"error code: $status" 1>&2
|
|
exit 1
|
|
fi
|
|
|
|
# case: JSONPath.sh processing from a file
|
|
#
|
|
else
|
|
|
|
if [[ $V_FLAG -ge 1 ]]; then
|
|
echo "$0: debug[1]: about to: $JSONPATH_SH -w -u -f $JSON_FILE -- '$PATTERN'" 1>&2
|
|
fi
|
|
"$JSONPATH_SH" -w -u -f "$JSON_FILE" -- "$PATTERN"
|
|
status="$?"
|
|
if [[ $status -ne 0 ]]; then
|
|
echo "$0: ERROR: $JSONPATH_SH -w -u -f $JSON_FILE -- '$PATTERN' failed", \
|
|
"error code: $status" 1>&2
|
|
exit 1
|
|
fi
|
|
|
|
# case: print only values from JSONPath.sh output
|
|
#
|
|
fi | if [[ -n $PRINT_ONLY_VALUES ]]; then
|
|
|
|
# case: -q -b (print only values and remove double quotes and []'s) via JSONPath.sh
|
|
#
|
|
if [[ -n $REMOVE_QUOTES ]]; then
|
|
|
|
sed -E -e 's/^\S*\s*//' \
|
|
-e 's/^"//' \
|
|
-e 's/"$//'
|
|
status="$?"
|
|
if [[ $status -ne 0 ]]; then
|
|
echo "$0: ERROR: pipe from -t jJSONPath.sh options: -q -b: sed -E -e ... failed", \
|
|
"error code: $status" 1>&2
|
|
exit 1
|
|
fi
|
|
|
|
# case: -b (print only values) via JSONPath.sh
|
|
#
|
|
else
|
|
|
|
sed -E -e 's/^\S*\s*//'
|
|
status="$?"
|
|
if [[ $status -ne 0 ]]; then
|
|
echo "$0: ERROR: pipe from -t jJSONPath.sh options: -b: sed -E -e ... failed", \
|
|
"error code: $status" 1>&2
|
|
exit 1
|
|
fi
|
|
fi
|
|
|
|
# case: print both JSON member and JSON value from JSONPath.sh output
|
|
#
|
|
else
|
|
|
|
# case: -q without -b (print both JSON member and JSON value and remove double quotes and []'s) via JSONPath.sh
|
|
#
|
|
if [[ -n $REMOVE_QUOTES ]]; then
|
|
|
|
sed -E -e 's/^\s+//' \
|
|
-e 's/\s+$//' \
|
|
-e 's/^\["?//' \
|
|
-e 's/^(\S*),"/\1,/' \
|
|
-e 's/\]\t/\t/' \
|
|
-e 's/"\t"?/\t/' \
|
|
-e 's/"$//'
|
|
status="$?"
|
|
if [[ $status -ne 0 ]]; then
|
|
echo "$0: ERROR: pipe from -t JSONPath.sh options: -q: sed -E -e ... failed", \
|
|
"error code: $status" 1>&2
|
|
exit 1
|
|
fi
|
|
|
|
# case: without -b (print only values) via JSONPath.sh
|
|
#
|
|
else
|
|
|
|
sed -E -e 's/^\s+//' \
|
|
-e 's/\s+$//'
|
|
status="$?"
|
|
if [[ $status -ne 0 ]]; then
|
|
echo "$0: ERROR: pipe from -t JSONPath.sh: sed -E -e ... failed", \
|
|
"error code: $status" 1>&2
|
|
exit 1
|
|
fi
|
|
fi
|
|
fi
|
|
;;
|
|
|
|
|
|
# case: we do not know which XPath JSON tool to use
|
|
#
|
|
*)
|
|
|
|
echo "$0: ERROR: XPATHJSON_USE is neither jsp nor JSONPath.sh: $XPATHJSON_USE" 1>&2
|
|
exit 10
|
|
;;
|
|
esac
|
|
|
|
|
|
# All Done!!! All Done!!! -- Jessica Noll, Age 2
|
|
#
|
|
exit 0
|