Phone and personal meetings with three people re the latest developments; slight reshuffling of plans.
August 15, 2018
Met with PAB to discuss progress; projected edits/additions are still not complete, so we'll hold off on moving data into svn for the moment. Rescheduled to October. Meanwhile, I updated my backup of the data from eXist, and we troubleshot a set of obsolete and duplicate data files. All sorted now.
August 14, 2018
Meetings today with MC, JJ and JT, with lots of planning and the writing of a sitrep to pass to MB.
Updated the stats and found a bug in the author count report (now people count), so I fixed that and updated again.
Rebuilt the schema because new places have been added and linked to; rebuilt the site and uploaded the results; worked with GL to clear a machine and disk space to house our new RA, and scheduled her on the machine for the coming semester.
The requirement to include components such as spaces and square brackets in the GET URL for the server is severely problematic, because the eXist httpclient:get function rejects them; if they're escaped using percent escapes, the Solr server doesn't like them, but if they're escaped using XML entities, eXist rejects them.
This may be gotten around by using httpclient:post, with httpclient:field elements; see the testSolr.xql file currently in the Graves app, where I've been doing some early testing.
I may actually need to go back to running my own local Solr and local eXist for this dev work, because it's too awkward having to edit stuff in the live site (which is the only way to call the real Solr instance).
August 13, 2018
First day back after vacation; lots of catching up. Late duty too.
First hour back after vacation spent hunting up, signing, submitting and otherwise bureaucratizing.
I've made a start on creating the taxonomy, with one sample major category with subheadings, and I've now written some comprehensive ODD processing that not only builds these values into the schema, but also extracts and preprocesses the Schematron, for later speedy validation. I've also updated the ODD to add new things we need, and added some Schematron rules to constrain how anchors are going to be used. Talked at length with EC about this work. We will need some processing into HTML to enable easy comparison of two coded texts side-by-side, for reconciliation/checking purposes.
A total of 2825 new page-images (in three different sizes) from the following volumes have been added to the Colonial Despatches collection: CO 60 Vol 29 (BC 1867 Despatches to London September to December); CO 60 Vol 30 (BC 1867 Public Offices part 1 and Miscellaneous); and CO 60 Vol 31 (BC 1867 Public Offices part 1 and Miscellaneous Individuals). These will now be linked into the transcription documents.