Category: "Activity log"

Corrections to first article vol 25, and encoding of second article

September 5th, 2017

One question outstanding on the first article, and the second is still missing abstract, bio and keywords.

First article for vol 25 done

August 30th, 2017

Had a bit of a sprint on this one to keep the momentum going, and enhanced my tagging tools HTML a bit too.

Remaining corrections for vol 24 done

August 29th, 2017

Some questions still outstanding with HT.

Proofing corrections to Woolf

August 28th, 2017

A couple of questions still outstanding, but basically done.

Editorial intros (en and fr) for vol 24; intro to vol 25 article

August 28th, 2017

The final parts of vol 24 are now encoded and ready for proofing, and I continued work on the first vol 25 article.

Set up first article for vol 25 and encoded biblio

August 25th, 2017

Making good use of style-based search in LibreOffice Writer to pre-tag a bunch of stuff.

New review encoded

August 24th, 2017

Encoded a new review, which will probably end up in vol 27. It's up for proofing.

Proofing edits

August 21st, 2017

Made editor's proofing corrections to four pieces plus the master vol 24 document, and rebuilt everything.

Meeting re future plans and the current vol

August 16th, 2017

Met with HT to plan the next three volumes, and to go through some of the proofing corrections for vol 24. I have four texts ready to be worked on. Spent some time fixing up the layout of the Woolf text, to avoid unwanted wrapping of poetic half-line in PDF.

Lingard abstracts chopped; volume PDF built

June 30th, 2017

HT truncated the abstracts for Lingard so they fit on the page; rebuilt everything and published, and also posted the full vol 24 PDF for proofing (although editorial intros are still missing).

Various edits, and one new review

June 26th, 2017

Encoded the new Virtanen review and added it to the master; added two lots of keywords; re-encoded a revised version of the Peterson review, then more changes to that; and various other tweaks.

TWeaks for vol 24

June 21st, 2017

Edits to various bits and pieces per HT. Published a new xar.

Last piece for vol 24 encoded

June 19th, 2017

Also added a couple of French abstracts. We're now on final tweaks for everything; one article's abstracts are too long and need to be cut, others may lack keywords, and final proofing is needed for everything. Also the intro articles are not there yet.

Completed Woolf while doing tech support

June 11th, 2017

In between doing tech support for the SHARP and metal conferences, I've churned through the Woolf translation, and HT has sent me keywords, which I've entered. There are a couple of outstanding issues: underlining with <hi rend="underline"> works correctly in the PDF but not in the HTML, and I still have to make some decisions about the ellipses: do we need to continue with the old practice of tagging them, or can they just now be straightforward characters? In any case, there are instances of ellipsis and three-dots in this one document.

More pages of Woolf intro done

June 9th, 2017

Encoded a few more pages. Moving steadily along.

Woolf translation: poem and more of the intro done

June 8th, 2017

Encoded the whole of the actual translation, mainly using s/r in gedit, because it's so well structured. Seems to be rendering well. Did a few more pages of the intro, and confirmed that there are no conventional endnotes; the Notes section is keyed to the stanza numbers.

Added new element and handling for it

June 7th, 2017

For the new translation we definitely need the <caesura> element, so I have:

  • Manually added the element to the RNG file which I'm now maintaining as the P4 schema.
  • Added it to the content model of the <l> element.
  • Added handling for it in the output to XHTML5 and PDF, and tested.
  • Added handling for it in the P5 output, and tested.

Bibliography for Woolf article done

June 7th, 2017

Tweaked and improved my tagging tool JavaScript. This goes very smoothly nowadays.

Started on Woolf translation: more font issues

June 5th, 2017

I've set up the framework file for the new translation, which is huge, and done a bunch of search-and-replace by style in an ODT version to cut down on the encoding work. We already have one font problem: one of the headers (which are bold) includes the title of a work (which is italic), and the bold/italic font that we fall back to is impoverished with regard to Unicode character ranges, so the o with ogonek is lost. I've had to add an extra tag around that title where it appears in these contexts (<hi rend="normal">) to unset the bold for that specific text run. I think I've had to do this before.

Fix for missing para in review; set up Volume 24

May 26th, 2017

NVD sent proofing corrections for her review, and it turned out I'd built it before adding the final para. That's now done. Then set up the master file for Volume 24, as well as two empty placeholders for the editorial intros, and built the result to see how long it is (168 pages). It's still missing one translation, so it'll be more substantial in the end.

Lingard corrections entered; new review encoded

May 23rd, 2017

Minor editorial corrections for Lingard translation done; new review by NVD encoded. Due to the small size of the site, my current publication method is simply to rebuild the entire webapp and push it up to eXist.

Old volumes are now indexed and searched

April 21st, 2017

I used jira to create XHTML versions of the OCRed volumes, and integrated the results into the existing search; it now seems to work pretty well, so I pushed it to the live jetty.

Tweak to Lingard translation

April 20th, 2017

The headers for the translation itself were appearing at the bottom of a page in the PDF. I set up a special case of div0[@type='NewPage'] which the XSLT now handles to force a page-break in this case. Republished the XAR.

Volume pages now being created; other updates to site

April 10th, 2017

I've extracted the editorial content from the master volumes, and I'm now building a separate index page for each of the volumes we've created, including the editorial stuff. On the other listings pages, volume numbers are now links to the volume pages. This answers (I think) the last of HT's requirements for the new site, other than a redesign.

I've also tested Apache Tika with the old volume PDFs, and the results are very promising; I think we may be able to process them to ugly XHTML, which eXist could then index, and provide people with search capabilities and linking out to the specific page in which the hit is found.

New translation done; updates to rendering

April 7th, 2017

The new translation is done, thanks to numerous hacky shortcuts to converting ODT to TEI, including search-and-replace on the contents.xml file. The results highlighted a couple of minor layout annoyances, so I've also fixed those. The document comes in at about 100 pages. It's now posted for proofing.

New translation for vol 24

April 5th, 2017

Received a new translation and started working on it. I've used the LibreOffice macro search tool to good effect, enabling me to add some tagging in a semi-automated way to the word-processor doc using styles, and I'm now transferring that content into the XML document. The metadata is done, the bibliography is done, and I'm working through the editorial intro.

301 redirects for old URLs now working

April 3rd, 2017

Simple redirect XQuery module that handles both the PDFs and the HTMLs now implemented.

Tweaking and refining the web app

March 30th, 2017

Worked a lot on the search today, constraining it to published documents only, and tweaking how it returns results. I've also added VNU validation of the HTML to the build process, and fixed some problems arising out of that; I've turned popup notes into <aside> elements so that their inline text can be ignored by the indexer, while the footnote rendering at the bottom of the document will be indexed; and I've refined the indexing after using the monex profiler. I also tweaked the P5 output so that it validates with the correct schema links. I think we're more or less there now; what we have is already much better than what's on the site, and I see no problem issues at all.

eXist app finished

March 28th, 2017

I'm now happy with the way everything is working. There are tweaks I could make -- I need to put in place redirects for the old URLs, and I should revisit the collection.xconf and indexing, and there will be more pages that need to be created for the new site -- but it's all basically there, and what we have now could replace the current webapp immediately. Will start that process next week.

eXist app basically working

March 27th, 2017

I've added an eXist app build to the process and I'm now testing and bugfixing locally to bring this project thoroughly into the Enddings fold. Everything is basically working, but I'm finding I now want to enhance some aspects of the rendering and display so that it's a cleaner and simpler setup than the previous app; I'm adding citation stuff in a footer, as well as getting the search working, based on Mariage. Should all be done soon.

Static site complete

March 20th, 2017

The new static build process is now complete, including all the DC header stuff, the teiHeader display widget, and the search page (which of course won't do anything until it's in the context of a webapp). With HT's approval, I have now switched all the old URLs over to the new on the existing site, and added 301 redirects through the sitemap.xmap. See the relevant stanzas there to see how it's done; I doubt we'll ever need to do this sort of thing again with such an old Cocoon, but it took me a while to figure out. I still need to add validation to the build process.

Substantial changes to the webapp

March 17th, 2017

I've given up trying to figure out how XEP is working on Peach (or why changes to its configuration don't work), and although I'll keep implementing those changes, I've now moved over to a system where PDFs are pre-built and uploaded to Peach, and just serialized from the sitemap. I've also put new URLs in place alongside the old, so you can go to and get the HTML page, as well as pdf/arthur_1_24.pdf to get the PDF and similarly for the XML. I'm waiting to hear from HT about whether we should switch over to using these URLs in the site as a whole, and send out 301s for the old ones. Had to re-learn some Cocoon foo to do all this, but it looks like it might be quite straightforward to manage a transition to the new URL structure on the old site, and run it for a good while that way, then roll out a new Jetty/eXist as with other Endings projects when we're ready.

Arthur translation corrected

March 17th, 2017

I've done all the corrections to the Arthur translation, including:

  • Removing the numbering
  • Spacing out the separate sections
  • Moving the notes from the English side to the original text
  • Two textual corrections the translator asked for

and the PDF is now all good from the point of view of character display.

Arthur translation: font issues

March 16th, 2017

Some unusual Unicode chars were not rendering properly in the new translation. I discovered that they were not available in the old Gentium fonts we were using, but they were supported in the latest 2014 versions, so I downloaded those and reconfigured xep.xml to get them working locally. When I went to do the same on Peach, I discovered that although it appears that XEP is running in cocoon-legacy/resources/xep, and that's certainly where it's looking for its fonts (which I proved by moving some temporarily), adding the new fonts and changing xep.xml there doesn't solve the problem. It seems that XEP must actually be running somewhere else. There is a version at /home1t/tapor/xep, and that might be the one whose xep.xml needs to be updated, but that file is not group-writable and we don't have the login for the tapor user. I've asked sysadmin to make it gw so I can experiment with changing that one. But the oddest thing is that both the xep batch files on the server are pointing at Java 1.6, which is not there, so either there's yet another installation, or it's being run directly by the Jar file somehow. We need to get away from this dependency, perhaps even sooner than I had planned.

Also did some XSLT work to allow for side-by-side translations that don't need to have their rows numbered, which is the case for the new text, and fixed a couple of other things. More to do there.

Finished corrigenda: now onto tei Header metadata rendering

March 15th, 2017

The Corrigenda page is now done, so the last major task is rendering the metadata in the teiHeader. I'm adapting and slimming down the old code, which is painfully repetitive.

More static output progress

March 13th, 2017

Article, review and author listings pages are now being created and appear to be working. Fixed a number of bugs with CSS. Made the table sorting work in JS instead of by calls to the server for a new page (which static can't do); it's faster anyway. Remaining to do: Corrigenda, proofing list, and the XHTML front matter for articles and reviews, including the display of titles and the teiHeader rendering. After that I think we might be done, although of course we should be adding a bunch of Dublin Core to the headers.

I switched everything to XHTML5 to work around some CSS cascade annoyances, and I think it'll make more sense going forward anyway.

More work on static output

March 10th, 2017


  • Added an ant buildfile, with Saxon in the repo to do the XSLT.
  • Implemented cleanup and re-copying of resources as part of the build.
  • Fixed a range of rendering problems in the HTML.
  • Fixed the menu so the correct button for the page is "pressed".
  • Fixed a bunch of namespace problems (more to do, I think).

Finished the new translation encoding

March 6th, 2017

We may need to tweak the layout and rendering of this a bit; it's not ideal right now, and has some features (such as a row-numbering column) which were set up for the first translation and may not suit this one. Waiting for feedback. Also refined the tagging tools page a bit.

New translation progress

March 3rd, 2017

Encoded the rest of the introduction and started on the side-by-side translation. Some questions sent to HT on style and duplicate note numbers.

New translation encoding under way

March 1st, 2017

The new translation document came in. The translation's not long, but there's a fair bit of intro material and lots of footnotes. Did the header, front matter and first few paras, along with the bibliography; I've left old content from the last translation in place so it's clear how the encoding is structured.

I did hit one strange error which took a while to resolve. When I copy-pasted text from the Word file open in LibreOffice into Oxygen, I got errors because of the inclusion of non-Unicode chars, specifically 0x7 and 0x8. After opening the document.xml file in Oxygen to see what these were, it turned out that these were the positions of bookmarkStart and bookmarkEnd elements in the text. I don't need the bookmarks, so I search-and-replaced all the bookmark elements away and saved back into the Word file archive; no more problems.

Tweaked the tagging-tools page a bit too, to handle editor list encoding better.

Static output progress

February 23rd, 2017

Menus and headings now being included in output files, and site info files are now being generated. Also fixed some outdated info on the site, which is good. Need to post-process the menu to "press" appropriate button for certain pages.

Static build: all documents now build to XHTML

February 21st, 2017

I've fixed a wealth of weird biblStructs, replacing them with bibls, throughout the collection, and all documents are now being converted to XHTML. The next stage is to build a site around them.

More progress with static build

February 17th, 2017

I've made a lot of progress. This is the current state of play:

  • Basic working XHTML documents are being produced from the P4 source.
  • The main set of templates used to achieve this is harvested using a special XSLT stylesheet from the old XSLT files.
  • However, many of those old templates prove to be broken in odd ways; they're a sort of hybrid between XSLT 1 and 2, and when run with Saxon 9 they cause errors, mainly due to string functions being called on input which is a sequence rather than a single item.
  • All of these errors occur in the horrible MLA Bibliography processing library, and they're caused by oddities in specific biblStructs.
  • Rather than fix the original code, which would mean maintaining two trees, it seems more sane to turn the old biblStructs into bibls where necessary; the output will be the same, but the code complexities should vanish, and we won't be producing any more biblStructs anyway.

So this gives me a path forward, and I'll start working through the odd cases when I have a chance.

Two more reviews updated

February 17th, 2017

Entered HT's proofing corrections for a couple of reviews.

Author's proofing corrections

February 17th, 2017

... for Kott review now done, review is published.

Started a static build process

February 16th, 2017

I've been concerned for a while that, although I do generate both P5 and PDF versions of all articles and reviews and store them in svn as a matter of course, I'm not able to do that for XHTML versions; and in addition, the structure of the ancient site, based as it is on query strings containing ids, is not friendly to archiving tools. I've now started creating a static XHTML build process which will hopefully result in archivable versions of the web pages and a better URL structure (which should presumably be integrated into the old webapp in the medium term, so that archiver URLs are rewritten). Ultimately, we want to have a rich static archive we can pass on to any future editor at another institution.

Encoded latest article

February 15th, 2017

Encoded (at home this morning), but with some questions outstanding with editors. P5 and PDF versions not yet generated because I have no XEP here.

More corrections to Sayers

February 7th, 2017

I think we're done with this one now.

Updates and fixes to contributor notes; proofing corrections to Sayers article

February 3rd, 2017

I think we're now up to date with articles. Still trying to work out an editorial workflow for annotating PDFs...

Added examples to contributor notes

February 1st, 2017

XPath and regex fest to find a sets of examples from our documents to illustrate style rules for the contributor notes. I think it now has enough good examples.

Tweak to Sayers article (pic added)

January 31st, 2017

At HT's request, added a new pic and caption to Sayers article.

Encoded new review

January 9th, 2017

Encoded a new review received from NVD, and added it to the repo; haven't created transformed versions or uploaded to the site yet.

Two tweaks to published review

December 13th, 2016

Fixes done at reviewer's request, change element given @n to ensure the changes are logged in the corrigenda page.

Added preprint watermark

November 23rd, 2016

Per discussion with HT a couple of weeks ago, added a background watermark image to articles and reviews which have not yet been published. Easy for the XHTML, but a little trickier for the PDF; took a while to figure out where to add it (fo:region-body in all fo:simple-page-masters), and how exactly to set it up (using custom rx:background-content-width attribute to specify the width in inches, since it's an SVG image).

Rebuilt vol 23 to include image credits in captions

November 16th, 2016

Sent full vol PDF and extracted colour plates pdf to S at the bookstore for reprint. Fixed Durbach version uploaded to site.

Adding acknowledgement to vol 23 article

November 15th, 2016

Some acknowledgements need to be added to images in the Durbach translation, so I first experimented with adding them to the actual image files; that proved unworkable because all the images have different resolutions, and are scaled differently in the PDF output, so the text ends up inelegantly scaled and shows at different sizes. I've now added the acknowledgement to the caption of each figure, and asked HT if that will work OK.

Vol 23 contents all now published

October 24th, 2016

The print volume has arrived, so page numbers are now set in stone; I've added them to all the articles and reviews, and set all the previously unpublished contents to published. I also reverted the PDF of the master volume to a previous state prior to the addition of the section heading page, since the one that was printed was that version. The cover still has two different page numbers -- that's not in svn -- but when I get a moment I'll revert that too.

Latest review done

October 20th, 2016

Still missing keywords. That means I'm up to date for vol 24 submissions right now.

Sayers article finished

October 20th, 2016

Posted for proofing.

More of Sayers done

October 19th, 2016

Trudging on through it at the end of the day. More than two-thirds done now.

Bit more on Sayers

October 18th, 2016

...while waiting for another meeting to start.

Added inline heading for editions/translations

October 17th, 2016

Per HT, last minute change to the rendering which added an additional title page heading up the Editions and Translations section. Since this changed page numbering, had to redo the cover. Turned out to be a wild goose chase, since the press had already rolled, but it'll be there for next issue.

Article encoding in process, and tagging tools developing well

October 13th, 2016

Finished the bibliography and moved onto the main body of the document; I'm enhancing the tagging tools as I go, and they're getting very slick.

Encoding of first vol 24 article under way

October 12th, 2016

Lots of progress with tagging tools and Schematron. Metadata and half the biblio done so far.

Two vol 24 reviews published

October 11th, 2016

Entered HT's corrections for Frandy and Urberg reviews, and built a couple more issues into the Schematron (US spellings in -or vs -our; use of ampersand) so we catch them more easily in the future.

Scanned article for vol 24

October 6th, 2016

We have permission to republish an article from elsewhere as accompaniment to a translation, but an electronic version is not available, so I've had to scan the original (which has lots of Danish text). I OCRed it with Tesseract. The results were not great; tried it again using Google Drive's online OCR, and it did a much better job. Not practical for large document sets, but good for small docs with complicated language issues (this has lots of Danish).

Urberg review encoded for vol 24

September 29th, 2016

Schematron is helping nicely.

Schematron rules for future use; Frandy review done

September 26th, 2016

Created a Schematron schema which enforces a set of the rules that we have settled on, along with others from Chicago, and tested it against vol 23 content; many minor violations but nothing serious, so we'll leave them alone. Encoded the Frandy review for vol 24 using these rules, which was helpful (although it'll be more so for articles).

Vol 23: more errors, fixes, and final submission

September 23rd, 2016

Discovered that one of the images had never been displayed because it wound up too big for a single page and was just dropped by XEP; two other errors also fixed, page count changed, so cover re-created. PDF and cover now submitted to bookstore.

Vol 23 cover

September 22nd, 2016

In order to work on CS4 on Jonagold, I had to change the cover process a little bit. I followed the previous post to extract the TOC pages, then I copied all Gentium, Garamond and StempelGaramond fonts (there were lots, with many different names) from the old WinXP vm and my current desktop over to the Mac fonts folder. Then I was able to open the two TOC pages and combine them into one. I then opened the old AI file from vol 22 and re-edited it for the new volume. The spine width is 0.8837" based on the algorithm provided by the book machine people. I had to delete some spurious extra artboards created by the CS4 import, and had to turn bleeds up to 0.4" in the document settings in order to get a PDF with the spine guides visible. I think I have it now. Long, tedious process...

Second round of final edits done

September 22nd, 2016

Final pass through the whole text with HT's edits. We should be ready to go now; moving on to the cover.

Final edits from first pass through print PDF done

August 31st, 2016

Finished all the remaining content, which includes all the remaining reviews. Some questions still outstanding. Updates posted to the site, and Corrigenda page now showing changes to published reviews.

Edits to Holmila & Tilli article

August 30th, 2016

This article is now complete, but there are two outstanding questions with HT about items in the bibliography.

Edits to PG and Reeploeg

August 29th, 2016

Added the cast of characters to PG and normalized some of the speaker prefixes; did all edits to Reeploeg, which were significant particularly in the bibliography.

Mellor corrections, and starting on Durbach

August 22nd, 2016

Substantial, gnarly corrections to one review, and beginning of another round of fixes to PG, prompted by a new cast list, which throws up inconsistencies in the speaker elements.

Neijmann and Karlsson done, plus other minor corrections

July 29th, 2016

Some bits and pieces that came in electronically for PG and DeLong, and the Karlsson and Neijmann articles are fully corrected. Everything that was on my desk is now done; more to come from HT after the vacation.

DeLong corrections done

July 26th, 2016

Substantial changes to biblio on this one.

Finished PG corrections; other tweaks

July 25th, 2016

Had to do some tweaking to XSLT and markup to make Act 2 start on a fresh page. Some questions still outstanding with HT re corrections.

French abstracts and ed note, and other tweaks

July 22nd, 2016

Added and tagged the French versions of the editorial note and the abstracts for the 7 articles, as well as a couple of other tweaks.

Editor's proofing corrections for PG, Act 1 1-iv

July 21st, 2016

A couple of questions outstanding with HT.

Editor's proofing corrections #1

July 19th, 2016

Corrections to bios, editorial note, first article, and other bits and pieces.

Abstract, bio, keywords for Gilmore article

July 11th, 2016

Rebuilt and reposted the volume PDF too.

Encoded editorial note

July 8th, 2016

Full book is now built and HT has access for proofing; tweaked some code handling links to local page references to make it more flexible (there's one in the ed note).

Encoded Gilmore article

July 7th, 2016

That's the last for this volume, and brings the page-count to 288.

Entered author's proofing corrections to Reeploeg article

July 3rd, 2016

Not published yet.

Created volume 23 master

June 28th, 2016

Built the volume, with everything included except one outstanding article and the editorial intro. It comes to 276 pages right now. Also retrieved old built volumes and put them into the repo.

Images integrated into PG

June 28th, 2016

I have eleven colour images for the PG text, and I've now extracted them from their PDFs and integrated them into the text between two acts, per suggestion from HT. Waiting to see whether she's happy with the result.

Reeploeg article finished

June 27th, 2016

Ready for proofing.

Set up Reeploeg and encoded bibliography

June 23rd, 2016

Long biblio with a lot of minor typos that made it tricky. Done and dusted. Article content next.

Lingard review: entered author's corrections

June 10th, 2016

Author's proofing corrections done.

Lingard review encoded

June 6th, 2016

Presumably the last review for issue 23.

Tweaks to a couple of docs

June 2nd, 2016

...on authors' instructions through HT.

H-T article finished

May 30th, 2016

Encoded the body of the Holmila-Tilli article and posted it for proofing.

Entered author's proofing corrections for PG

May 16th, 2016

This involved some tweaks to the XSLT/FO for the PDF generation to handle page-break avoidance and block versus inline versions of stage directions.

Set up next article and encoded biblio

May 4th, 2016

Holmila/Tilli is huge, with an enormous bibliography. Set it up and did the bibliography today. Biblio has a lot of non-standard stuff in it; I have a q in with HT about this. Tagging tools have made progress too.

TXT button hidden

May 3rd, 2016

One of our authors tried proofing with the TXT version in a non-Unicode editor, resulting in much confusion, so I've hidden the TXT buttons on the site.

Karlsson article encoded

May 3rd, 2016

Lots of help from the tagging tool I've built, which I'm extending steadily.

Finished Peer Gynt encoding

April 19th, 2016

Did the last two scenes. It's now up for feedback/proofing.

Editor's proofing corrections for review, plus PG Act 2 Scene 6

April 18th, 2016

Corrections to the Mellor review, and the next scene of PG done. A couple of confirmations still awaited from NVD on my tweaks to her corrections.

Ibsen Act 2 Scene 5 done

April 13th, 2016

Steady progress.