More text-analysis on the ColDesp content
Pursuing my work on using Craig's Zeta to characterize participants in a correspondence, I've started trying to reproduce the work I did in the summer using the latest versions of the DH's spreadsheets, and also to extend it. The main thing I've done today is to extract individual sets of data for the correspondence between Douglas and Newcastle, Lytton's successor. Getting a single archive of the plain text out of the db is a relatively simple XQuery:
declare default element namespace "http://www.tei-c.org/ns/1.0";
let $docs := collection('/db/coldesp/correspondence')//TEI[teiHeader/fileDesc/titleStmt/author/name='Douglas'][teiHeader/fileDesc/titleStmt/respStmt/name='Newcastle'],
$output := concat('begin... ', string-join(for $d in $docs
return $d//div[@type='despatch_to_london']//text()[not(ancestor::head or ancestor::opener or ancestor::closer or ancestor::index or ancestor::note)], ' '), ' ...end')
return $output
and
declare default element namespace "http://www.tei-c.org/ns/1.0";
let $docs := collection('/db/coldesp/correspondence')//TEI[teiHeader/fileDesc/titleStmt/author/name='Newcastle'][teiHeader/fileDesc/titleStmt/respStmt/name='Douglas'],
$output := concat('begin... ', string-join(for $d in $docs
return $d//div[@type='despatch_from_london']//text()[not(ancestor::head or ancestor::opener or ancestor::closer or ancestor::index or ancestor::note)], ' '), ' ...end')
return $output
The time-consuming bit is creating all the individual files (768 and 469 respectively) through XSLT, but that's now done too; I don't know if I'll actually need those, because I'll probably do what I did before and run the analyses on aggregated content segmented into uniform blocks. I've created a text set for them in the Intelligent Archiver program and generated a word list, and I'm now trying to figure out how to do a cluster analysis with this data using Minitab, and how to use the latest incarnation of the Craig's Zeta spreadsheet. I'll need to move more quickly on this next week to get my abstract done.