Did a whole pile of work over the break, which is best viewed on the GitHub repo. Today I've been bugfixing and optimizing the JSON retrieval stuff, which is now working pretty well even on heavily-throttled connections. Raised issues for a couple of bugs, and started adding a search for our interviews site (but was stopped by a bug).
JT has rewritten the JSON and search page generation code so that filter fieldsets on the search page now have ids which match their JSON files; that means the JS can trickle-retrieve them after startup, allowing for the normal sequence to be superceded if a search is initiated during the process. I have the JS retrieving them successfully; now I just have to tweak the search-preparation code so it can get specific ones more quickly if required, and then tweak the search execution code to use the new split-out filters instead of the old docs.json. After that, we can dispense with docs.json. 120 minutes.
With JT, drafted and submitted proposal for DHQ paper. 120 minutes.
<p>Over the weekend and the last couple of days, we've made a lot of progress getting date filters set up to handle documents with date ranges; adding boolean filters, and getting them tested in live projects; planning the upcoming fragmentation of the docs.json data; and adding support for custom titles for documents to be displayed in the search results. All going well, and most of the new features are already merged into the master branch, which is being tracked by DVPP. It's very convenient to be able to switch the branch tracking from dev to master in Keats and DVPP for local testing purposes, while leaving the Jenkins build comparatively stable. 1000 minutes at a guess.</p>
I've nearly finished the code which will get a single set of docIds that conform to the currently-selected filter set. Once that's done, I can integrate it with the text search code and have filters finally working properly.
Started work on the document descriptor filters today. Method to check a doc against its filters is not fully working yet, but the bones are in place. 120 minutes.
I've done a lot on this over the past few days. The basic search functionality is working, and I'm now focusing on the extraction, storage and implementation of document taxonomy filters. I've also worked a bit on the schema for the config file (there's a lot more to do there), and added a real-life site build for testing (using Keats). 840 minutes over many days.