From work log during week 6 of working from home (2020-04-20 to 2020-04-24): + 2.5 hours.
The static release site, which is on home1t/coldesp, has now been running for a few weeks without problems, so today I've brought down the old Cocoon version that was on tomcat-devel. After stopping it in the Tomcat manager app, I took a backup of it, which I zipped and stored in my home directory on Squash at Colonial_Despatches/cocoon_final_backup_2020/coldesp_old_peach.zip.
We could now undeploy the tomcat-devel app completely, freeing some space and resources on Tomcat; we should probably do that so that a restart of Tomcat doesn't inadvertently restart the old app. I'll wait for everyone's OK before doing that.
Regarding the new static site: I need to put together detailed instructions on how to deploy a new edition. Basically, you have to rsync the content from the build on Jenkins to the deployment folder (coldesp/www), but it's important to ensure that the rsync DOES NOT INCLUDE THE DELETE FLAG, since there is a lot of other material required by the site (such as hundreds of thousands of page-images) which are not part of the Jenkins build, and they must not be deleted. (They are backed up on Squash, though.)
Isolation log week 6:
Work done from home 2020-04-20 to 2020-04-24.
Week 6 total hours: 37.5
G & T hours +2.5
Monday 2020-04-20
0.25 hours: Update Jenkins servers. Jenkins package key problems now sorted out.
0.25 hours: Wendat: Add anchors to working HTML output so encoders can easily refer to individual pages when sending questions.
1.50 hours: Scancan: Finished Vanherpen article encoding, rebuilt XAR file and pushed to server to make it available for proofing.
2.00 hours: MyNDIR: Finding fonts based on PS's specs; downloading, building WOFF2s, and integrating into the CSS; basic page layout CSS.
0.50 hours: LEMDO: Examining feedback from publisher on PDF, researching obscure font size issues.
0.50 hours: MoEML: Discussion on training of Junior Programmer in the coming months with JJ.
2.50 hours: MyNDIR: Integrating staticSearch into the MyNDIR site.
Total: 7.50 hours.
Tuesday 2020-04-21
0.25 hours: Update Jenkins servers.
0.25 hours: Gather, sign and submit timesheets for DVPP RAs.
1.00 hours: LEMDO: First batch of changes and tweaks based on publisher feedback on the PDF.
1.50 hours: HCMC Blue Jeans meeting.
0.75 hours: LEMDO: More work on PDF changes.
0.75 hours: MoEML: EEBO will disappear in July, and be replaced by ProQuest; discussion on how to migrate our URLs, and emails to two other project leads who may be facing the same problem to see if they're aware of solutions; issue raised with ProQuest.
1.50 hours: JTEI Issue 12: Finished proofing of article 166 with KT.
1.50 hours: MyNDIR: Post-processing for static search page to make layout more user-friendly.
Total: 7.50 hours
Wednesday 2020-04-22
0.25 hours: Update Jenkins servers.
0.25 hours: Review/revise JT's draft of abstract for UBC DH conference.
2.50 hours: LEMDO PDF: wrestling with font sizes, margins, borders, running headers, and inconsistencies in encoding practice.
2.00 hours: MyNDIR: Hook the staticSearch search-completed hook to ensure that filter sets with selections are always expanded; add a info icon to represent search hits which are info documents so don't have an image; reformat search page to avoid Blink bug; include entity names in all languages; fix footer.
1.00 hours: ColDesp: BlueJeans project meeting.
2.00 hours: MyNDIR: Build gallery page, fix validation errors, tweak build process to make sure everything gets validated, work around the various permutations and locations where document titles might appear, so that search results, browser bar, gallery and main page headings show something consistent and useful.
Total: 8.00 hours
Thursday 2020-04-23
0.25 hours: Update Jenkins servers.
1.50 hours: Final revisions to jTEI article based on presentation at TEI 2018 conference.
0.25 hours: Corrrespondence with ProQuest re transition from EEBO URLs to ProQuest URLs; creating plan of action for MoEML team.
0.50 hours: Coldesp: stop old Cocoon app on tomcat-devel; take complete backup; push backup to Squash; document on blog.
1.25 hours: LEMDO project meetings.
0.50 hours: Scancan: Correspondence with editor on corrections to articles from vol 27 and 28.
1.50 hours: MyNDIR: Basic keyword list working; still needs styling; fix broken handling of relatedItems.
1.00 hours: Wendat: Project meeting, and encoding of a small document into sections of the documentation file.
1.00 hours: MyNDIR: Keyword page working, header components modularized for home page functionality.
Total: 7.75 hours
Friday 2020-04-24
0.25 hours: Update Jenkins servers.
2.00 hours: MyNDIR: Home/splash page done for desktop, and some more styling changes.
0.25 hours: Helping debug Landscapes SVN issue: looking for logs on revision server, Googling and testing.
1.00 hours: New Schematron to constrain whitespace, a few thousand fixes to whitespace in data, some correspondence with PAB and PS.
0.25 hours: MoEML: Research on online XSLT courses for incoming Junior Programmer.
0.50 hours: TEI: Weekly meeting with SB to plan XSLT working group meeting and check in on tickets.
1.50 hours: DVPP: Rewrite Oxygen poem transformation scenario so that it incorporates HTML validation to catch CSS errors. Slightly awkward to do because the presence of vnu.jar breaks Oxygen functionality, since they have different versions of the same classes in their jars.
1.00 hours: Scancan: Author's proofing corrections for Lavender piece, vol 27.
Total: 6.75 hours
From work log during week 5 of working from home (2020-04-14 to 2020-04-17): + 2 hours.
Isolation log week 5:
Work done from home 2020-04-14 to 2020-04-17.
Week 5 (4-day week) total hours: 30
G & T hours +2
Tuesday 2020-04-14
0.25 hours: Update Jenkins servers.
0.25 hours: Build LEMDO PDFs, report H5 bad links to RA; set up proofing for jTEI article; comment on a couple of TEI tickets; answer queries on HotPot users list.
1.00 hours: Scancan: first third of Vanherpen text body encoded, and some tweaks to Schematron.
1.50 hours: HCMC Blue Jeans meeting.
0.50 hours: MoEML: Fix for obscure bug reported by LS, involving pulling following punctuation inside quotation marks.
1.00 hours: UVic connectivity problem: gathering reports from users around the world, reporting on the ticket, testing myself, helping RAs work around it.
0.50 hours: MyNDIR: Upgrade to Saxon 10 and test, fix build problem on Jenkins, add docImage metadata to site pages.
1.50 hours: JTEI issue 12: Editors' meeting, final proofing of first part of article 166.
1.00 hours: MyNDIR: Work on HTML5 page layout, validation and image display.
Total: 7.50 hours.
Wednesday 2020-04-15
0.25 hours: Update Jenkins servers.
0.75 hours: Emails on DNS blacklisting, MoEML hiring, jTEI issue 12, Liddell Award, etc.
2.00 hours: LEMDO print: Testing various approaches to building the CIP data page (title page verso); implementing selected approach.
1.00 hours: Discussion with JT re DHSI and UBC presentations on staticSearch, and implementing wildcard support in staticSearch.
0.50 hours: Emails: Despatches user access, conference presentations, DNS issue.
0.50 hours: Liddell Award: more attempts to find a way to get software to work.
3.00 hours: MyNDIR: port all old XSLT templates to the new static site build and compress/adapt/fix/make valid.
Total: 8.00 hours.
Thursday 2020-04-16
0.25 hours: Update Jenkins servers.
1.50 hours: MyNDIR: Rewrite VNU handling to get around current bug; fix bugs in HTML rendering; make output valid; start on site JavaScript.
1.25 hours: LEMDO: Project meeting.
1.50 hours: LEMDO: Render graphic intended for two-page spread; split it in half; write handling for it and test.
1.00 hours: LEMDO: Start building experimental print edition for two-play volume (Honest Whore 1 & 2).
0.75 hours: Wendat: Project meeting.
1.00 hours: Hot Potatoes: Logging bug report ( still used in HTML5, which doesn't allow it); purging all instances in code and source files; building release 7.0.3.0; releasing and announcing.
Total: 7.25 hours.
Thursday 2020-04-17
0.25 hours: Update Jenkins servers. Apt key problem with Jenkins repo. Keeping tabs on this.
0.50 hours: Update build process for DVPP, Keats, Mariage and ColDesp to handle buggy VNU version.
0.25 hours: Update static version of VNU in MoEML and Mariage repos; expecting fallout from this in the form of broken builds.
0.25 hours: DVPP: Fix build error caused by duplicate poem in two different year folders.
0.50 hours: ColDesp: Fix missing info in citations reported by GL.
0.75 hours: TEI: Meeting with SB to look at changes to Stylesheets Test2 and prepare for next Stylesheets Group meeting.
1.50 hours: Mariage: Fix fallout from update to VNU validator; updates to handling of language attributes.
1.00 hours: MyNDIR: Implement page-level JS; reorganize standalone XML; generate pages for all entities; tweak page content/layout; various fixes.
0.25 hours: DVPP: Diagnose validation issue related to TEI Schematron; raise ticket to fix bug in Schematron.
0.25 hours: Liddell Award: investigating strategies for testing a submission, and related communication.
1.75 hours: MyNDIR: Initial work on implementing PS's design.
Total: 7.25 hours
From work log during week 4 of working from home (2020-04-06 to 2020-04-10): + 2 hours.
Isolation log week 4:
Work done from home 2020-04-06 to 2020-04-10.
Week 4 (4-day week) total hours: 30
G & T hours +2
Monday 2020-04-06
0.25 hours: Update Jenkins servers, reboot them, test, check for plugin updates, remove old kernels.
1.75 hours: Inaugural meeting of the TEI Internationalization Working Group (6am start).
1.50 hours: LEMDO print editions: fine details of font configuration.
1.50 hours: MoEML bug fixing: problem of regnal dates used in abstracts, causing build failure.
1.00 hours: DVPP: fix bad filenames on server; fix records linking to them in db; refresh TEI files with stale image links.
0.50 hours: JTEI issue 12: One encoded text remediated and submitted to be posted for proofing; one author-edited text added to repo.
1.00 hours: Scancan: second half of bibliography for vol 28 article; fix Schematron rule for foreign word italicization.
Total: 7.50 hours.
Tuesday 2020-04-07
0.25 hours: Update Jenkins servers.
1.50 hours: TEI Stylesheets Working Group meeting.
1.00 hours: HCMC Blue Jeans meeting.
2.00 hours: LEMDO: More PDF work; preparing versions to share with publisher; beginning documentation of PDF process; discussions about various obsolete components of the repo; tweaks to ODD file; adding test for Xelatex at the beginning of PDF build process.
1.50 hours: LEMDO: Add and integrate documentation for constructing and generating print editions.
0.75 hours: staticSearch: Create new branch for document thumbnail feature; add documentation for it; do implementation part 1 (of 4).
0.75 hours: DVPP: Adding a new search page specifically for the poem notes field.
0.25 hours: DVPP: Refresh TEI for English Woman's Journal; OCR poems in EWJ 1860.
Total: 8.00 hours.
Wednesday 2020-04-08
0.25 hours: Update Jenkins servers.
0.25 hours: DVPP: Fix bugs in code for new search page.
1.50 hours: Evaluation/ranking for Liddell Award: One evaluation done, but the other requires a particular configuration of Python packages that I can't get working. Wrote to committee chair to ask if it's OK to ask candidate for a docker container; later got it half-working, but still in discussion with committee chair.
0.25 hours: DVPP: Refresh TEI for Chambers 1900 and OCR poems.
2.00 hours: staticSearch thumbnail image feature parts 2 and 3 of 4: implemented relative path recalculation, with tests; integrated this into the tokenization routine.
1.00 hours: LEMDO PDF: reorganize and modularize XSLT; obsolete some old status files; discussions on Asana re graphics etc.
0.50 hours: LEMDO discussions on locations for generic texts, svn log, and other issues.
1.00 hours: Scancan: Pre-tag content in ODT file using format-based search-and-replace to provide quicker encoding in Oxygen.
0.25 hours: LEMDO PDF: rebuild AYL and Oth and upload to shared folder; debug broken links in H5 preventing build, and report to editor.
Total: 7.00 hours.
Thursday 2020-04-09
0.25 hours: Update Jenkins servers.
0.25 hours: Fix TEI Stylesheets Test2 broken build resulting from @sydb's commit yesterday.
1.50 hours: staticSearch: Finish implementation of support for images in results; Over to JT for testing before merge.
0.50 hours: LEMDO: Starting work on the Catalogue In Publishing information page for the PDF.
2.50 hours: LEMDO project meeting. Way too long.
0.25 hours: LEMDO: troubleshooting connectivity issues for RAs (it was TELUS's fault); updating docs with safer repo URL, and informing team how to change their URL.
0.25 hours: staticSearch: Discussion/decision to merge new docImage work into dev branch; doing the merge.
1.00 hours: Wendat project meeting; more TELUS connectivity issues for Wendat RA.
1.00 hours: Dealing with project build fallout from staticSearch update, and also the issue of the SVN version on Jenkins not reading svn properly.
Total: 7.50 hours
From work log during week 3 of working from home (2020-03-30 to 2020-04-03): + 2 hours.
So it turns out that regular army types don't have attestation records/papers. Presumably because they didn't 'enlist'.
This means that users will require special instructions for people like Lt. Colonel Thomas Fraser Homer-Dixon
I have a functional editor, and I'm ready to test it. For the time being I'll do my own testing to make sure the egregious errors are fixed.
Next task is to start integrating the new editor design from PS.