checkpoint manifest, added fix_numbers_csv.sh

Added more manifest information to tmp/manifest.numbers
and tmp/missing-manifest.numbers.  There is MORE empty
fields that need to be filled in.

Renamed some tmp files:

    tmp/author-names.txt -> tmp/author_names.txt
    tmp/author-wins.csv -> tmp/author_wins.csv
    tmp/missing-manifest.csv -> tmp/missing_manifest.csv
    tmp/year-prize.csv -> tmp/year_prize.csv

Added fix_numbers_csv.sh to post-process CSV files exported by numbers.
The DOS file format is converted into a Unix file format and
the CSV file is canonically sorted.  Then both tmp/manifest.csv
and tmp/missing_manifest.csv are combined and canonically sorted
to form tmp/full_manifest.csv.

Finally the tmp/full_manifest.csv file was imported into numbers
and saved as a numbers file.
This commit is contained in:
Landon Curt Noll committed 2023-10-18 12:48:40 -07:00
1 parent 3b004b4514
commit afed94b5f7
12 files changed
+5621 -1668

No files matched your search

+38 -33
View File
@@ -177,7 +177,7 @@ A `sort_word` match this regexp:
This file.
### [author-names.txt](author-names.txt)
### [author_names.txt](author_names.txt)
A text file of full names of each `author`: one full name per line.
@@ -188,7 +188,7 @@ Anonymous YYYY
```
### [author-wins.csv](author-wins.csv)
### [author_wins.csv](author_wins.csv)
A CSV (Comma Separated Values) file: one line per `author`.
@@ -297,7 +297,7 @@ This is a JSON file containing an example `author/author_handle.json` for a
fictitious `author`.
An `author/author_handle.json` file will be derived from the contents of the
[author.csv](author.csv) file and the [author-wins.csv](author-wins.csv) file.
[author.csv](author.csv) file and the [author_wins.csv](author_wins.csv) file.
### [example.dot_winner.json](example.dot_winner.json)
@@ -306,7 +306,7 @@ This is a JSON file containing an example `year/dir/.winner.json` for a
fictitious `winner`.
A `year/dir/.winner.json` file will be derived from the contents the `year/dir/.id` file,
the [author-wins.csv](author-wins.csv) file, the `year/dir/.year` file, and the
the [author_wins.csv](author_wins.csv) file, the `year/dir/.year` file, and the
contents of the `year/dir` directory.
@@ -316,6 +316,27 @@ A list of files that exist, or should exist once the tools to generate certain f
such as the `index.html`, or the `.winner.json` files for each entry, are created.
### [fix_numbers_csv.sh](fix_numbers_csv.sh)
This tool will fix the [manifest.csv](manifest.csv) and [missing_manifest.csv](missing_manifest.csv)
files, removing carriage returns and appending a newline if it was missing.
This tool also creates / updates [full_manifest.csv](full_manifest.csv).
### [full_manifest.csv](full_manifest.csv)
Combined and sorted [manifest.csv](manifest.csv) and [missing_manifest.csv](missing_manifest.csv).
This file is formed by the [fix_numbers_csv.sh](fix_numbers_csv.sh) tool.
### [full_manifest.numbers](full_manifest.numbers)
This file is formed by opening [manifest.csv](manifest.csv) in numbers
and saving the result as a numbers file.
### [gen_author_json.sh](gen_author_json.sh)
Temporary tool used to generate the `author/author_handle.json` files.
@@ -323,7 +344,7 @@ Temporary tool used to generate the `author/author_handle.json` files.
The following command, executed in this directory, created the `author/` directory:
```sh
rm -rf ../author ; ./gen_author_json.sh author_handle.txt author.csv author-wins.csv ../author
rm -rf ../author ; ./gen_author_json.sh author_handle.txt author.csv author_wins.csv ../author
```
@@ -409,18 +430,10 @@ via the [macOS](https://www.apple.com/macos/)
3. Click ((Export))
* 3a. If needed click ((Replace))
4. open a terminal window
5. cd to the `tmp` directory
6. tr -d '\015' < manifest.csv > tmp.csv
7. echo >> tmp.csv
8. mv -f tmp.csv manifest.csv
4. execute ./[fix_numbers_csv.sh](fix_numbers_csv.sh)
### [missing-manifest.numbers](missing-manifest.numbers)
### [missing_manifest.numbers](missing_manifest.numbers)
A [macOS](https://www.apple.com/macos) [Numbers](https://www.apple.com/numbers/)
@@ -480,40 +493,32 @@ NOTE: The winners_rank cells are either JSON null or JSON numbers.
NOTE: All other cells are JSON strings that need to be double quoted, including the year.
### [missing-manifest.csv](missing-manifest.csv)
### [missing_manifest.csv](missing_manifest.csv)
The [missing-manifest.csv](missing-manifest.csv) is a CSV file that was exported from the
[missing-manifest.numbers](missing-manifest.numbers) file.
The [missing_manifest.csv](missing_manifest.csv) is a CSV file that was exported from the
[missing_manifest.numbers](missing_manifest.numbers) file.
In case of conflict, the data in [missing-manifest.numbers](missing-manifest.numbers) file is
considered missing-manifestitative over the [missing-manifest.csv](missing-manifest.csv) file.
In case of conflict, the data in [missing_manifest.numbers](missing_manifest.numbers) file is
considered missing_manifestitative over the [missing_manifest.csv](missing_manifest.csv) file.
The [missing-manifest.csv](missing-manifest.csv) is generated from the [missing-manifest.numbers](missing-manifest.numbers) file,
The [missing_manifest.csv](missing_manifest.csv) is generated from the [missing_manifest.numbers](missing_manifest.numbers) file,
via the [macOS](https://www.apple.com/macos/)
[Numbers](https://www.apple.com/numbers/) spreadsheet app, as follows:
0. open [missing-manifest.csv](missing-manifest.csv) in numbers: modify if/as needed
0. open [missing_manifest.csv](missing_manifest.csv) in numbers: modify if/as needed
1. File -> Export To -> CSV...
* 1a. `[ ]` Include table names (unset)
* 1b. Text Encoding: Unicode (UTF-8)
* 1c. Click ((Save..))
2. Save As: missing-manifest.csv
2. Save As: missing_manifest.csv
* 2a. Select the `tmp` directory
3. Click ((Export))
* 3a. If needed click ((Replace))
4. open a terminal window
5. cd to the `tmp` directory
6. tr -d '\015' < missing-manifest.csv > tmp.csv
7. echo >> tmp.csv
8. mv -f tmp.csv missing-manifest.csv
4. execute ./[fix_numbers_csv.sh](fix_numbers_csv.sh)
### [sql/winners.sql](sql/winners.sql)
@@ -527,7 +532,7 @@ to generate data for the old winners directory tree.
A text file containing `winner_id` strings: one `winner_id` per line.
### [year-prize.csv](year-prize.csv)
### [year_prize.csv](year_prize.csv)
A CSV file: one line per `winner`.
File renamed without changes.
File renamed without changes.
Internal Server Error - gitea
500 Internal Server Error

An error occurred:

An error occurred

Gitea Version: 28.1.0