Maintenance

As we start to build out these databases, I'm accumulating a list of tasks that can only be done at the command line, but which we currently have to ask HBR (Systems) to do:

1. Rebuild the search index:

   php symfony search:populate

   We have to do this every time we make changes directly in the db; and there are lots of such changes to be done, because the UI for the app is based around editing individual records, so there's no way to (for instance) change the status of a bunch of records we've imported from CSV to "published" without editing the db.
2. Import digital images: This happens when we've bulk-uploaded archival description records for a specific repository using the CSV route, but we then want to upload a digital surrogate (picture of the object) for each record. It requires uploading the digital images themselves to a directory on the server, along with a CSV file that links each image to an identifier in the db, and then running:

   php symfony digitalobject:load /path/to/your/loadfile.csv

3. Exporting data in EAD (XML) format: Some of our repositories are using this aggregation process to create AtoM records which they will then import back into an AtoM instance of their own (Nanaimo is going to be doing this). The process for this involves bulk-exporting all the archival descriptions associated with that repository in EAD format:

   php symfony export:bulk --criteria="i.repository_id = (SELECT object_id FROM slug WHERE slug='example-repo-slug')" /path/to/my/exportFolder

We do need to be able to print the odd page, so I've set up the Brother printer on the network by:

1. Plugging in the ethernet cable from the regular printer.
2. Changing the ip address in the Brother printer setup to match that associated with the old printer and printer.hcmc.uvic.ca (196.214).

It works fine; Linux found it automatically, and so did OSX. I haven't installed it on any student workstations.

vips (available on the Linux command line) can create Zoomify tilesets like this:

vips dzsave clean_C1.png clean_C1 --layout zoomify --suffix .png

As far as we can tell, these are identical to those created by Zoomify (and we got the same number of tile groups folders using vips as we did with Zoomify).

We actually need JPEGs because OpenLayers can't yet handle PNGs, so we've determined that this is what we want for tiling (assuming that we want full-quality images).

 vips dzsave img.jpg img --layout zoomify --suffix .jpg[Q=100]

Linguistics have a rather confusing audio setup in their booth which is basically using an entire mixing desk to supply phantom power to a mic; they also have problems with playback to the in-booth speakers because the're missing a Y-splitter cable to feed mono 1/4-inch jacks to a stereo mini jack to the speakers. Greg and I spent some time working around the problem, and arrived at a setup which works perfectly in Audacity and has nice level settings, but it's not working with the VocaliD system which runs in the Chrome browser; they're going to contact tech support for VocaliD about that. I wish they had a limiter on their mic input too; the head-mounted mic very easily clips.

This entry is to help me next time I need to do the same thing.

I frequently run XPath in oXygen to find stuff. For example, I just wanted to find all the non-conformant xml:id attributes in a file. So, I used this XPath expression to find them:

//person[matches(@xml:id,'[a-z]{5}')

and it responded with output like this:

System ID: /path/to/my/file/FILENAME.xml
Description: xml:id="feefifofum_3"
XPath location: /TEI[1]/text[1]/body[1]/div[1]/listPerson[2]/person[166]
Start location: 1703:21
End location: 1708:30

ad nauseam

I'm only interested in the actual xml:id value (feefifofum_3) so I ran this regex:

^System.*\nDescription: xml:id="(.*)?".*\n.*\n(^Start.*\n)?(^End.*\n)?

and replaced the match with the first group \1 (or $1 in oXygen)

Note to self, because I'll forget:

git ls-remote --tags https://github.com/TEIC/Stylesheets.git | egrep -o "([0-9]+\.)+[0-9]+" | sort -t . -k 1,1n -k 2,2n -k 3,3n | tail -n1

This will work assuming version numbers are x.y.z.

Connecting to UVic's eduroam wireless network using Ubuntu 18.04

Security: WPA2 Enterprise
Authentication: PEAP
CA Certificate: /etc/ssl/certs/GlobalSign_Root_CA_-_R3.pem
PEAP Version: Automatic
Inner Authentication: MSCHAPv2
Username: netlink@uvic.ca

Note that the cert above may be a symlink to
/usr/share/ca-certificates/mozilla/GlobalSign_Root_CA_-_R3.crt

Whatever file you point to, the md5sum of the cert that works is
221eb05e63024bb1b6420f8606d0c092

New monitors came, set up new standing desk, after switching my desk with one from the other room which is more suitable for it. Time to completion about two hours. Reminder to self: I need to find and bring a 14mm hex wrench to adjust the counterweight so that it stays in position more firmly.

Registered for the MS Insider program and downloaded an ISO for Windows 10. Built a VM for testing, especially the new browser engine -- works fine with Agas. The VM won't scale the screen, though.

We've decided to use PostGreSQL for this project due to its more sophisticated static views ('materialized views') and the efficient updating of materialized views ('refresh concurrently').
Downside? These features don't show up until v9.4, so I installed 9.4 and PHPPGadmin on my VM.

I now have a reasonable first pass at a schema - for now it only addresses the core data sets (soldiers, war diaries, and ancillary tables that help flesh out those main tables).

In order to clean up as much as possible, Martin is going to write some (streaming) XSLT to smooth out some of the inevitable bumps that exist in data sets of this size. To produce a MySQL dump in XML format, you can use PHPmyAdmin or mysqldump on the CLI. Doing it from PHPmyAdmin I ended up with a 908MB file, whereas the command 'mysqldump --xml -u root -p cgwp > /tmp/cgwp.xml' produces a 729MB file. I haven't investigated why this is, but the header of the documents suggest that PHPmyAdmin has its own take on dumping XML.