HCMC Blogs

Isolation log week 52

Work done from home and in the office 2021-03-15 to 2021-03-19

Total: 38.75 hours
G&T: +3.75 hours

Monday 2021-03-15

0.25 hours: Update Jenkins servers.
1.50 hours: Maint: Migration of svn server with LW and GN. Warning teams, testing, checking, letting teams know when it was back up, planning and informing everyone about Jenkins migration; setting up Jenkins for migration with LW.
0.25 hours: Francotoile: Feedback from SA, resulting in discussion and further testing.
3.75 hours: Endings/staticSearch: With JT, fixing a number of outstanding issues relating to language and sorting and closed some tickets; design and testing of advanced search filter control that we'll need for VIHistory.
1.75 hours: LEMDO: Initial work on validating egXMLs.

Total: 7.50 hours

Tuesday 2021-03-16

0.25 hours: Update Jenkins servers.
1.00 hours: Wendat: Split documentation for MSS from Cognates, and add some extra bits for cognates.
1.00 hours: Endings/staticSearch: Test Closure compiler, and fix a couple of issues that it detected in the JS. Lay out plan for integrating it into our build process, with questions for JT. Fix typo in typeAhead class being tested. Created new branch for closure work.
1.50 hours: HCMC Staff meeting.
2.00 hours: LEMDO: Discussion of surrogate renaming/reorg. With KL revisited the alphabetization of BIBL1, and rewrote the sequencing algorithm and matching Schematron to eliminate diacritics, spaces and punctuation; normalized sequences of initials, added Schematron for that, and fixed and constrained punctuation at element boundaries.
0.25 hours: Admin: Workstudy timesheet. Tip: these can be edited in Teams.
1.25 hours: Francotoile: Tweaking the map, which is currently wrapping annoyingly. More to do here. Rolled back OL version to 4.6.5 because some behaviour was failing.
0.25 hours: TEI: Review of pull request arising out of one of my feature requests.
0.50 hours: Wendat: Cognate team meeting.
0.25 hours: Endings: Updated Principles doc and website to cover any-url condition.
0.75 hours: Wendat: Main project meeting.

Total: 9.00 hours

Wednesday 2021-03-17

0.25 hours: Update Jenkins servers.
0.25 hours: MyNDIR: Per PAB, built a fresh version of the site and posted it in a temporary location ahead of the Jenkins migration tomorrow.
4.00 hours: Endings/staticSearch: In a branch, added Closure compiler into the project, split out all the JS, added code to reconstitute it and compile it, added debug version in output, added timings to all tests and debug version of search page for side-by-side testing, cleaned up some warnings (lots more to do), and tested with MyNDIR and Keats before adding pull request.
0.75 hours: Clipart library: Researched and tested various batch methods of converting our ancient clipart Illustrator files to SVG. None of the scriptable options seems to work, although one online service did a reasonable job. I would like to get this done.
1.75 hours: LEMDO: Finished cleaning up born-digital front elements that shouldn't exist; added and tested Schematron to catch them; generated list of alt titles to be considered for changing to sub; cleaned up XSLT handling front elements. Ticket closed. Then spent some time debugging a weird case of mixed TEI and XHTML output.

Total: 7.00 hours

Thursday 2021-03-18

0.25 hours: Update Jenkins servers.
0.75 hours: Maint: On deck for Jenkins server migration; testing when it came back up; suppressing temporary credentials and documenting.
0.50 hours: Endings/staticSearch: Addition of JS compiler results in a message containing "0 errors" which triggers Jenkins builds to fail; updated log parsing rules in all Jenkins jobs to take account of this.
1.50 hours: LEMDO: Discussion on egs of IML tags in documentation; fixes for build break involving id collision; some XSLT cleanup.
1.00 hours: Wendat: Started work on the author/proofing view for cognate stuff, starting with a new document type.
3.25 hours: MoEML: Redirects for duplicated PERS entries; project meeting; discussion with JJ on old tickets; investigation of how far I'd got in converting the modern mapping coordinates to GeoJSON (not far); sprint on writing XSLT to generate GeoJSON from old coord sets, including conformance to the right-hand-rule, which is an interesting challenge which I think I've solved.

Total: 7.25 hours

Friday 2021-03-19

0.25 hours: Update Jenkins servers.
1.50 hours: TEI: Weekly meeting with SB and NC, working on integration of Saxon 10 into TEI repo.
1.25 hours: Wendat: Some progress with Author Mode CSS for reconstructed forms. Added some missing languages and a missing biblio entry, and rebuilt schema to fix validation issues.
3.00 hours: MoEML: Complete, test and run the GeoJSON generation code to add GeoJSON locations to all locations files with old-style coordinates. Tweak and fix schematron.
2.00 hours: Endings: Project meeting, and encoding/publishing of abstracts and program on the Endings website.

Total: 8.00 hours

Posting hours from isolation log 2021-03-08 to 2021-03-12.

Isolation log week 51

Work done from home and in the office 2021-03-8 to 2021-03-12

Total: 38.25 hours
G&T hours: +3.25

Monday 2021-03-08

0.25 hours: Update Jenkins servers.
0.75 hours: Francotoile: JS tweaks to make the bookmarks and hash=parsing synchronize properly. What remains is I think just cosmetic.
0.50 hours: MoEML/LEMDO: Questions on new tickets assigned to me; raising a new ticket for MoEML places with reversed coordinates.
0.50 hours: Mariage: Meeting with CC re Oxygen update and relocating svn repo URL.
5.50 hours: Francotoile: Bookmark system debugged and reworked a bit to allow editing of existing bookmarks; staticSearch functionality added and search page working. Added post-processing of search page to allow language switching; devised approach to using the same search index to search within a video page's single transcription; implemented the first half of that.

Total: 7.50 hours

Tuesday 2021-03-09

0.25 hours: Update Jenkins servers. Odd error with cert in Firefox, which eventually cleared itself.
0.25 hours: LEMDO: Prep for meeting by listing completed work in minutes doc.
3.00 hours: Francotoile: Settle on strategy for in-page search, and create XSLT file that will eventually handle it. Implement, test, fix. Add hit highlighting in target page. Add full listings page with sortable table. Everything now working except for the map.
1.50 hours: HCMC Staff meeting.
1.50 hours: LEMDO: Project meeting; implement grid layout for bibliography/personography etc. db-style collection pages, with xml:ids showing in a separate column; for other collections such as ORGS1 and taxonomies, add parenthetical ids where grid layout is not possible.
2.00 hours: Wendat: Add harvesting of second collection of keystroke shortcuts from the wendat_cognates.xpr project file to the documentation.

Total: 8.50 hours

Wednesday 2020-03-10

0.25 hours: Update Jenkins servers.
0.50 hours: Maint: For LW's move of MySQL server, ran tests on our sites before and after. All seems to be well.
3.00 hours: Francotoile: Generated GeoJSON geo elements for all of the transcriptions; re-acquainted myself with BreezeMap xml structures; wrote XSLT to generate the map.xml content that will be processed by BreezeMap into GeoJSON.
1.25 hours: Wendat: Met with CBR to walk through the first example encodings of cognate forms, fixing the schema as we go; reported back to ML and EH with a couple of questions.
0.75 hours: MoEML: Identified all location files with reversed GeoJSON coordinates; wrote identity transform to fix them; added Schematron rule to prevent the problem; validated all files.
1.50 hours: LEMDO: Confirmed that previous work to add section anchors in documentation is working, and then figured out a simple CSS fix for the problem whereby target div headings scroll behind the fixed banner; waiting to see if there are any side-effects. Then tweaked and tested XSLT to remove front elements from born-digital documents following recent policy reversal; processed 1H4 documents as a pilot, and will check results tomorrow.

Total: 7.25 hours

Thursday 2020-03-11

0.25 hours: Update Jenkins servers.
0.25 hours: LEMDO: Fix for broken menu item; check-in with JJ and KLB on results of yesterday's work.
0.50 hours: Moses: Repo reorganization requested by ECH.
1.50 hours: Keats: Set up data structure and schema validation for recording relationships, with example and keystroke shortcuts, and informed KB he can start entering data.
0.25 hours: Discussion with GN about possible tile server setup.
2.00 hours: BreezeMap/Francotoile: Started work on building a map for Francotoile, borrowing code from BreezeMap. Before starting, switched the default branch of BM to dev, and renamed master to main, then tested with recent versions of OL. Current version causes an error with the opacity control, so I'm sticking with 4.6.5 for now. Adapted the JSON generation code and set up the map for Francotoile, and it's basically working, but lots more to do.
0.25 hours: Scancan: Fix for typo in vol 26 title page.
1.00 hours: LEMDO: Carefully processed my way through the entire collection removing unwanted front elements, and rewrote the XSLT that generates page titles so that it uses metadata info instead, as discussed with JJ and KLB.
1.50 hours: DVPP: Processed the bulk of the XML files to integrate metadata changes (first few were done the other day). Should be close to up to date with recent db changes now.

Total: 7.50 hours

Friday 2020-03-12

0.25 hours: Update Jenkins servers.
2.00 hours: TEI: Weekly meeting with SB and NC, working on a refresh of p5subset.xml in the Stylesheets repo, fixes arising from it, and updates to the release manual.
0.50 hours: Wendat: Added new keystroke shortcuts for the reconstruction work.
3.50 hours: Francotoile: Completed customization of BreezeMap for this project, fixed some bugs, updated info on some of the site pages, tweaked the JSON used in the map, and many other fixes. Tested on all available browsers. Wrote to CC with the URL of the Jenkins site, ready to start the next phase (checking, approval of changes, creation of Help material that was never originally done).
0.75 hours: Scancan: Started major reorganization to get obsolete code out of the way before addressing feature request from guest editors; rewrote old XSLT 1.0 transformation to bring it up to date.
0.50 hours: LEMDO: Retrieved copies of all facsimiles to USB drive for TEH to do reorganization/renaming; attend part of meeting with principals.

Total: 7.50 hours

Posting hours from isolation log 2021-03-01 to 2021-03-05.

Martin Holmes and Joey Takeda have released the third production version of their staticSearch tool, one of the key products from Project Endings. This version adds several new features and improvements. See the release notes and full documentation.

Isolation log week 50

Work done from home and in the office 2021-03-01 to 2021-03-05

Total: 37.25 hours
G&T +2.25 hours

Monday 2021-03-01

0.25 hours: Update Jenkins servers.
0.25 hours: Admin: Feb leave report, email, reminder on hours for timesheets.
0.25 hours: Wendat/Academic: Viewing first conference presentation.
0.50 hours: Scancan: Update to documentation and query on captions; rework of dual image to incorporate higher-res versions from sources.
0.25 hours: Depts: Pulled images out of PDFs for HT.
0.25 hours: Wendat: Questions for ML about remaining layers of keyboard map.
1.75 hours: MoEML: Wrestling with highlighting of search hits in target pages, and how it interacts with our weird scrolling setup. Seems to be working now.
1.25 hours: LEMDO: Fixes for broken pointers; diagnosing of issues with note popup display; tentative fix committed.
2.75 hours: Francotoile: Build-out of HTML framework, creation of initial JS and CSS, setup of language-interface-switching based on local storage, layout of home page.

Total: 7.50 hours

Tuesday 2021-03-02

0.25 hours: Update Jenkins servers.
1.00 hours: TEI: Working on getting the Oxygen plugin built and released with HC. That process is no longer automated or properly documented (yet).
1.50 hours: HCMC: Staff meeting.
2.50 hours: LEMDO: Re-sequence all BIBL1 bibl entries alphabetically, then tweak Schematron to enforce it. Diagnose and (finally) fix the problem with note popups in supplementary texts. Tweak XSLT for egXMLs to properly space commented ellipses in feasibly-valid examples.
1.00 hours: Endings/staticSearch: Prep for release 1.2, with testing, rebuild of searchable TEI Guidelines, and detailed documentation of the release process.
0.50 hours: BreezeMap/staticSearch/staticizing: discussions with GN of the various projects we're working on and possible extensions to the shared libs.
1.00 hours: Francotoile: Basic page layout done, and staticSearch meta tags now in the headers.
0.50 hours: Wendat: Prep of regex workshop and project meeting.

Total: 8.25 hours

Wednesday 2021-03-03

0.25 hours: Update Jenkins servers.
3.50 hours: LEMDO: Raising and completing a couple of bug tickets; long diagnosis/discussion of problems with front matter in mixed-content supplementary texts; framing of new policy and documentation.
0.25 hours: Keats: (Today and yesterday) Preliminary email discussions to lay out the framework and parameters for network graph.
2.00 hours: Francotoile: Layout of video panels now done with flex and grid, and all subpanels are being created; panel-switching is now working, with graceful degradation; build process on Jenkins now creates the site.
0.50 hours: Endings/staticSearch: Built and released version 1.2, following step-by-step guide we developed over the last couple of days, to confirm it's all correct.
0.75 hours: Wendat/academic: Watching videos of ICLDC presentations ahead of our session tomorrow.

Total: 7.25 hours

Thursday 2021-03-04

0.25 hours: Update Jenkins servers.
1.50 hours: LEMDO: More work on page titles and titleStmt stuff in the header; wrote XSLT to standardize born-digitals removing unwanted front elements; other tweaks.
0.50 hours: MoEML: Fix for build break caused by inaccessible schema component for the KML schema on the internet; after figuring it out, I tweaked the local backup schema package so that it contains everything needed.
2.00 hours: Wendat: Viewed a couple more presentations, and attended our own session and a following one.
0.50 hours: Keats: More work on figuring out what the network graph data structure should look like, in email discussion with KB. I think we're getting there...
2.25 hours: Francotoile: Fixed encoding issues in current TEI data (pointers that were not pointing correctly); rework grid/flex structure to accommodate full transcript; add rendering of transcript with key timing transition data ready for JS to use.

Total: 7.00 hours

Friday 2021-03-05

0.25 hours: Update Jenkins servers.
2.00 hours: TEI: Working with SB and NC on migration of Stylesheets from Saxon 9 to 10.
0.25 hours: Keats: More discussion of force-directed graph and data structures for it.
0.75 hours: Wendat: Meeting with CBR on validity, keystroke shortcuts, and cognate work. Follow-up with ML.
4.00 hours: Francotoile: Wrote and tested video caption timer; added processing for popup notes embedded in transcriptions; added listing of related items; lots of CSS tweaking; started on bookmark handling; added language switcher at top of page.

Total: 7.25 hours

Posting hours from isolation log 2021-02-22 to 2021-02-26.

My machine at home has one 4K monitor on the right and a 1920x1200 monitor on the left, which is in portrait mode. I'm using Wayland.

Getting the monitor settings to persist through reboots and screen locking/sleeping is problematic. Even worse, when the screen blanks (locking) and is subsequently unlocked I lose my rotation and the resolution drops to 1680x1050.

Annoyingly, the max resolution of 1920x1200 is not available at this point (no idea why) so, although I can rotate it, the resolution is rubbish. At this point I can only reboot the machine to get things back to a usable state.

The problem has been partially resolved by setting kernel args in grub (video=DP-1:1200x1920@60). Although this makes my settings persistent through power cycles it has no impact on the screen blanking issue.

I came upon a suggestion to add my monitors.xml to the gdm settings, which sounds reasonable:
sudo cp ~/.config/monitors.xml /var/lib/gdm3/.config/
sudo chown gdm:gdm /var/lib/gdm3/.config/monitors.xml

Apparently the monitor layout will persist across restarts and screen locks.
We'll see.

Isolation log week 49

Work done from home and in the office 2021-02-22 to 2021-02-26

Total: 37.50 hours
G & T hours: +2.50

Monday 2021-02-22

0.25 hours: Update Jenkins servers.
0.50 hours: MoEML: Discussions/testing with KLB on work done at the weekend.
0.50 hours: DVPP: Refreshed TEI from db for the first three periodicals. Working slowly through them.
0.75 hours: Wendat: More work on keystroke shortcuts; more questions to ML.
0.50 hours: MoEML: Testing Agas map issue on Macs and Windows, as well as beta versions of Firefox on Ubuntu. The problem appears to be confined to Ubuntu 20.04, but it's there in the current beta and stable too.
2.00 hours: Francotoile: Created ODD file (was missing in original) and new schema from it; created remediated versions of XML ready for building static version.
0.75 hours: Wendat: Listing out my guesses at remaining characters on bottom row of Alt+Shift set for ML to confirm or correct.
1.00 hours: LEMDO: Adding new remarks to div spec; investigation of processing of front element in born-digital texts and creation of remediation plan.
1.50 hours: Francotoile: Created XML docs for non-video files; ported data out of XQL into About page; wrote to CC to clarify a couple of things.

Total: 7.25 hours

Tuesday 2021-02-23

0.25 hours: Update Jenkins servers.
1.00 hours: LEMDO: Prep and project meeting; checking in on tickets; discussions.
1.50 hours: HCMC Staff meeting.
1.50 hours: Keats: Work on icons not showing up on some browsers, and unwanted colours in emoji. Some digging around with London historical maps.
2.00 hours: Wendat: Working on keyboard mapping; suppress one non-Wendat doc from search; project meeting.
1.50 hours: Endings/staticSearch: Review and merge JT's fix for hyphenation issue, and subsequent tweak; branch, fix, and pull request for JSON sanitization issue, which needed a fair bit of research before I could be sure I was covering the bases; ticket triage ahead of upcoming 1.2 release.

Total: 7.75 hours

Wednesday 2021-02-24

0.25 hours: Update Jenkins servers.
1.50 hours: Endings/staticSearch: Testing and timing new branch work from JT; create fix for documentation rendering issue with footnotes and create PR.
4.00 hours: Francotoile: Set up new schema build process, using DMaus's schxslt libs as an alternative to RJ's old Schematron libs. Got all schema and validation targets working. Put infrastructure for the rest of the build process, so we're ready to start. Fix missing French caption per CC. Set up and test Jenkins job (currently only doing validation).
0.25 hours: Keats: Diagnose svn conflict issue for KB.
2.00 hours: LEMDO: Fix indenting and spacing in BIBL1; add and test Schematron rule to enforce order of bibls by @xml:id; investigation of status of front elements in born-digital (a bit of a shambles); Schematron and long discussion on how to wrangle these without being overly permissive.

Total: 8.00 hours

Thursday 2021-02-25

0.25 hours: Update Jenkins servers.
2.00 hours: TEI: Testing following release, diagnosis of rendering problem in four pages of the release, meeting with SB, MS and EBB to start work on a fix.
1.25 hours: Endings/staticSearch: Rebuild of searchable TEI Guidelines, with a few extra tweaks to weighting; a bit of ticket triage; worked on one of three remaining tickets for 1.2 release milestone.
4.00 hours: LEMDO: Working on the issue of front elements in born-digital documents: nailed down the structure we need, wrote and tested XSLT to generate it, processed the entire collection, validated and fixed errors in the results, added stronger Schematron rules, found and fixed more errors from those.

Total: 7.50 hours

Friday 2021-02-26

0.25 hours: Update Jenkins servers.
0.50 hours: LEMDO: Debugging build break due to invalid template file.
2.00 hours: TEI: With SB, MS and NC: Diagnosed and fixed rendering problem manifested in TEI release yesterday; planned and scheduled point release to remediate; set up Jenkins jobs for that.
1.50 hours: Endings/staticSearch: Completed ticket on prefixing property names, added build break messages to warn users, added documentation, created pull request.
1.50 hours: DVPP: Completed and submitted revisions to jTEI article.
0.25 hours: Academic: Quick reading and acceptance of article review request.
1.00 hours: Francotoile: Analysis of existing JS, which can be much simplified; initial setup of XSLT framework for generating pages.

Total: 7.00 hours

Posting hours from isolation log 2021-02-16 to 2021-02-19.