HCMC Blogs

Posting 21 hours of G & T used to cover the three non-vacation days between Christmas and New Year.

Posting hours from isolation log 2020-12-21 to 2020-12-23 (short week, taking vacation on the 24th).

Isolation log week 41

Work done from home and in the office 2020-12-21 to 2020-12-23 (short week, taking vacation on the 24th).

Total hours: 21.50
G&T hours: +0.50

Monday 2020-12-21

0.25 hours: Update Jenkins servers.
0.50 hours: LEMDO: Add Schematron rule to try to prevent build break from last night. Took a few shots to get it right.
2.00 hours: Endings/staticSearch: Cleaned up and pruned some old branches; merged JT's branch for apostrophe handling; fixed a bug in scroll-to-text-fragment URL construction; tested it in Graves and MoEML; created a new branch for issue 51, document sort keys, which we need for the Despatches; implemented and tested it.
1.00 hours: ColDesp: Configured new metatags for all documents consisting of sort keys as required by JT for search result returns.
3.25 hours: LEMDO: Handled CSS margin ticket; discussed with JT and JJ the current behaviour of popups on the site, agreed on a more elaborate multiple-popup implementation, planned out the details and created a ticket for it; fixed broken behaviour whereby when annotations and collations were turned off in the toolbox, their signals/symbols remained confusingly visible; discussion with JJ on peer-reviewed status versus catRef; decided on status, implemented and re-edited existing documents accordingly.
0.50 hours: Wendat: Integrated translations from ML into project stats page; added new stat for unclear passages, and integrated that into diagnostics chart.

Total: 7.50 hours

Tuesday 2020-12-22

0.25 hours: Update Jenkins servers.
0.50 hours: ColDesp/Endings/staticSearch: Test results of new sort key implementation in Despatches build; inform Despatches team; create pull requests on staticSearch repo to land the code in the dev branch.
1.00 hours: Despatches: Switch back to dev branch of staticSearch following merge; create icons for different doc types to use in search results, and integrate into site build.
1.00 hours: HCMC Staff meeting.
2.00 hours: LEMDO: Project meeting; fixes for and Schematron to prevent two types of nested links; add harvesting of required XML source documents into anthology trees; add document status row to page metadata.
0.50 hours: Endings/staticSearch: Write documentation for new sort key feature; triage tickets and create new milestone ready for a decision on 1.1 release.
1.75 hours: MyNDIR: Setting up initial Author Mode CSS for easier direct proofing in Oxygen per discussion with PB.

Total: 7.00 hours

Wednesday 2020-12-23

0.25 hours: Update Jenkins servers.
4.00 hours: Endings/staticSearch/Graves/ColDesp: Raise and complete ticket for format consistency for meta tags; bring Graves and ColDesp into alignment with the new forms and test. Triage all tickets assigned to Release 1.1, and assign some to 1.2, summarize others and raise questions, and start dialog with JT on the ones which may be implemented for the upcoming 1.2. Do some code-polishing and documentation, particularly in the JS for the search.
1.25 hours: MoEML: More fixes for broken and redirected links throughout the collection, based on W3C linkchecker results (page #23).
0.25 hours: ColDesp: Tweak size of search page hit doc icons.
1.00 hours: Scancan: Set up vol 28 master with what we have so far; test-built PDF and made tweaks to processing to handle odd characters in headings.
0.25 hours: MyNDIR: More tweaks to Author Mode CSS.

Total: 7.00 hours

Posting hours from isolation log 2020-12-14 to 2020-12-18.

Isolation log week 40

Work done from home and in the office 2020-12-14 to 2020-12-18

Total: 40.00 hours

G&T hours: +5.00

Monday 2020-12-14

0.25 hours: Update Jenkins servers.
0.50 hours: Endings/staticSearch: Fix a couple of issues discovered as a result of Scancan work this weekend.
2.00 hours: Scancan: Set up Jenkins job; integrate staticSearch; test and debug default search behaviour; start implementing custom overrides to provide links to old volumes and to current PDFs.
0.25 hours: LEMDO: Add new Schematron to prevent egXMLs in headings.
1.00 hours: Endings: Library archiving meeting.
1.00 hours: Mariage: Unsuccessful attempts to get current eXist configured as existing Mariage webapp is configured. May have to go for full-blown staticization instead.
2.50 hours: Scancan: More testing, debugging, and refining the integration of staticSearch. Almost done.

Total: 7.50 hours

Tuesday 2020-12-15

0.25 hours: Update Jenkins servers.
1.00 hours: LEMDO: Fixing a couple of build breaks introduced by unexpected encoding patterns in documentation. Found workaround encodings and added Schematron to prevent unwanted patterns.
1.00 hours: Scancan: Tweaks to search weighting to push old full-volume PDFs down the list in relevance scoring (still not properly tuned).
2.00 hours: HCMC Staff Meeting.
3.00 hours: LEMDO/MoEML: MoEML Project meeting, LEMDO QME state-of-play meeting, implementing four changes arising from that, testing and debugging.
0.50 hours: Endings/staticSearch: Did a documentation ticket, followed up on a couple of other issues.
0.50 hours: Mariage: Debugging XQuery code no longer working on new eXist. Determined it was due to using early implementation of XQuery maps code, subsequently removed from the spec and no longer supported by eXist. Could be rewritten, but probably best to put the time into staticizing Mariage.
0.25 hours: LEMDO: Diagnosing and fixing build break due to double link.

Total: 8.50 hours

Wednesday 2020-12-16

0.25 hours: Update Jenkins servers.
0.25 hours: MoEML: Diagnose overnight build break and change colliding id.
1.50 hours: Endings/staticSearch: first implementation of KWIC pointers to document fragment ids (issue 88) along with scroll-to-text-fragment, which now seems to be working.
1.00 hours: Endings/diagnostics: debug issues raised on ticket, check and test problem with Nashorn JS engine now no longer supported in Oxygen's JDK; with JT implement partial solution. More to do here.
0.50 hours: Keats: Fix JS bug I noticed while testing staticSearch. Test switch to new fragment-supporting staticSearch, but page-load JavaScript undermines it; needs more investigation.
1.00 hours: Scancan: Add fragment ids to major article sections; update vnu validator version and fix new warnings resulting; test with new staticSearch branch, but still need to rewrite custom override JS to have this work properly.
2.00 hours: Endings/staticSearch: add feature detection to allow regular fragment navigation in non-Chrome browsers; test in other browsers; discussions of the best way forward with scroll-to-text-fragment. Switched MoEML to the test branch to see the results tomorrow.
0.50 hours: Emails on Moses, Endings meeting poll, ticket triage.

Total: 7.00 hours

Thursday 2020-12-16

0.25 hours: Update Jenkins servers.
0.50 hours: Endings/staticSearch: find scrolling bug when search string is empty, raise ticket, commit fix (hopefully), and kick off MoEML build to test. Following test with Keats, switched it back to dev branch, since page-load JS interferes with it anyway. More discussion on ticket.
0.25 hours: Scancan: fix for obsolete @type on style tags.
0.25 hours: LEMDO: Re-encoded bibliography using proper tagging.
0.50 hours: Endings/staticSearch: Confirm bugfix worked, cherry-pick commit into dev, close ticket; read background to Mozilla's position on scroll-to-text-fragment.
0.50 hours: Scancan: Port recent staticSearch changes into override JS, build, bugfix and test; add more robust fragment id generation that will not change with every build; add lang attribute to root element of all files; fix broken ids in old volumes.
2.00 hours: MoEML: Test scroll-to-fragment and fragment-link features in MoEML search; add document status descriptor to search page; implement special styling for semi-diplomatic texts, and fix XSLT bug in handling of lgs in the process.
1.00 hours: Wendat: Implement tagging protocol for "interesting things", and add documentation and harvesting process.
2.25 hours: ColDesp: Working on errant spaces, and discovered a lot of erroneous tagging that needed fixing, as well as lots of XSLT sloppiness of my own making, now fixed; not clear yet whether all problems are solved.
0.50 hours: Wendat: Project meeting.

Total: 8.00 hours

Friday 2020-12-17

0.25 hours: Update Jenkins servers.
2.00 hours: ColDesp: Deep dive into remaining issues with unwanted whitespace around quotes and footnote numbers; various fixes committed at different stages of the build process. Now apparently all fixed.
0.25 hours: DVPP: Working on getting an RA paid for work in the fall. Not yet resolved.
1.25 hours: TEI: Weekly meeting with SB and NC to work on Stylesheets issue for adding anchors to examples. Worked through a CORS problem on my Jenkins at the same time (blocking of inline styles).
4.00 hours: Endings/staticSearch/Scancan/MoEML: Building on JT's work on XSLT yesterday, adding new scrollToTextFragment switch, documentation, and implementation; tested in the various other projects; worked through some plans on tickets; after JT merged changes, switched projects back to dev branch; created schema patching stage in build process so we can get rng interleave output (working around TEI bug); updates to documentation.
0.25 hours: Keats: Added Schematron to help avoid bad image links.
1.00 hours: LEMDO: Discussion with JT on video issues; researched adding poster frames to videos, and scripted addition of poster frames to 21 scene videos.

Total: 9.00 hours

Edition 3.7 of Dr. Kim Blank's excellent site Mapping Keats's Progress has been released.

Posting hours from work log for 2020-12-07 to 2020-12-11.

Isolation log week 39

Work done from home and in the office 2020-12-07 to 2020-12-11

Total hours: 34.75

G&T hours: -0.25

Monday 2020-12-07

0.25 hours: Update Jenkins servers.
1.00 hours: Maint/HCMC: Started work on an svn/github log parser for easier project tracking.
0.50 hours: Greek Athenaze exercise bug fix. Took longer than it should because of confusion between HP versions.
5.25 hours: LEMDO: Revisited inclusion method for editions: simply relying on links on the edition page is not practical. Implemented system using relatedItem elements in the header, added processing and Schematron for it, and fixed existing edition pages to comply. For FV, created 19 individual scene pages and imported thumbnail images required from old site. Implemented processing for inline persName to create popups; analyzed the use of the front element and its processing, and wrote some utility XSLT to add front elements where they're missing in born-digital docs to aim at some consistency in retrieving the document title. Processed QME anthology pages with this XSLT.

Total: 7.00 hours

Tuesday 2020-12-08

0.25 hours: Update Jenkins servers.
0.25 hours: LEMDO: List out work from the last two weeks ahead of project meeting this morning.
2.00 hours: HCMC Staff meeting.
1.50 hours: LEMDO: Project meeting; add processing for orgName.
0.25 hours: MyNDIR: Debug build warning and add Schematron to avoid it.
1.50 hours: Scancan: Encode new review; required some research as book info was wrong.
1.50 hours: LEMDO: Implement processing to generate metadata table on web pages.

Total: 7.25 hours

Wednesday 2020-12-09

0.25 hours: Update Jenkins servers.
0.25 hours: Scancan: Update review with keywords and author bio.
0.25 hours: LEMDO: Add handling for list/@rend (needs later work on CSS to complete ticket).
1.50 hours: Wendat: Project meeting, prep for it, and tweaks to search build configurations.
2.50 hours: LEMDO: Remove and disallow all uses of list/@rendition in documentation; replace with @rend; add XSLT and CSS to handle; test and debug; fix strange templates removing various attributes in documentation XSLT; switch other uses of @rendition over to conceptual elements (foreign, emph etc.) and add XSLT and CSS handling for four of these.
1.00 hours: Coldesp: Debug/discuss over-use of q element in born-digital content; fix rendering and display of vessel names (italic in born-digital contexts, otherwise as-shown).
0.25 hours: MyNDIR: Debug svn problem for PAB.
0.50 hours: Maint/HCMC: VCS logging tool: got the basic structure working for svn.

Total: 6.50 hours (dental appt this morning).

Thursday 2020-12-10

0.25 hours: Update Jenkins servers.
0.50 hours: Endings: Testing new phpBB.
0.50 hours: Admin: Emails, ticket checks on various projects.
4.50 hours: Wendat: Implementation of historical stats retrieval process, creation of diagnostics framework with progress chart, integration of diagnostics and progress into build process; project meeting.

Total: 5.75 hours (internet outage in the morning).

Friday 2020-12-11

0.25 hours: Update Jenkins servers.
1.50 hours: TEI: With SB, complete Stylesheets ticket #471 and create pull request.
2.00 hours: LEMDO: Deal with various FV content tickets to help push QME to release-ready.
1.00 hours: ColDesp: Inverstigate and remediate inconsistent tagging of vessel names across the collection; fix CSS to unitalicize vessel names which appear in quotations.
0.50 hours: Maint: Check status of eXist apps on Peach, warn Moses team that the app may not survive the move to a new VM; check status of Graves and RT ticket.
1.00 hours: Graves: Build, test and deploy static web site, and put in ticket for domain pointer change.
0.50 hours: LEMDO: Get bibl pointers working for simpler bibliography creation.
1.50 hours: Scancan: Meeting with eds re future plans; implementation and testing of staticSearch as replacement for eXist application.

Total: 8.25 hours

Posting hours from work log for 2020-11-30 to 2020-12-04.

A new version of the Colonial Despatches site, edition 2.2, was published on 2nd December 2020, including the following new features:

• Added more organizations to index as well as some descriptions (currently 64 organizations).
• Tagged majority of organizations in the database (12761).
• Added a few hundred more abstracts.
• All places with a known location has a map.
• The initial version of the Indigenous glossary of terms has been completed.
• Fixed a couple encoding bugs (missing divs in transcribed enclosures, unwanted text edits).
• Removed titles and roles from Despatch citations as per request from Principal Investigator.
• "Mentions of [entity] in the documents" in the indexes are now sorted by date sent and date received when available.

This is the third completely static version of the site, in compliance with the Project Endings Principles for Digital Longevity.