FrancoToile

Just realized that the production instance of FrancoToile is running eXist 1.5. The dev instance is running eXist 2.x and there were some headaches in migrating from an earlier dev instance running 1.4, so I'm not going to risk updating the production instance with the site files from the dev instance until I've updated the exist running on the production environment. That will have to wait until I return in September.

1. The problem of duplicated files mentioned in the previous blog post has been solved.
2. The inverted transcript for frac1 and frac2, as mentioned in previous blog post, has been corrected.
3. The problem with prmf6 mentioned in previous blog post has been solved.

4. ES and SA encountered a strange problem with the list of items in Keywords. Some items (grandes écoles, système éducatif français, classes préparatoires) are displaying in the list while not showing anywhere in the xml files. In the list these words have to be removed, and the items "musique" and "vie personnelle" should be translated into English.
SA solved the problem.

5. ES added the transcript for all videos that are available and on the site. Nine of them need to be annotated.
6. The [age] section of the search function, when selected on its own leads to an error message. However, when selected with another filter (e.g. [male] + [10-25]) the age filters functions properly. SA will look into this.

7. SA contacted Pat with regards to thumbnails. If this can be fixed quickly, it will be done before SA goes on vacation at the end of this week. Otherwise, the site will go live and thumbnails will be added at a later stage. SA will inform ES and CC.
8. ES noted an issue with the display of "there are no other video from". While the syntax in French has been fixed, now only "from Mali" or "du Mali" is displaying.
9. ES asked SA whether it could be possible to make a search within annotations optional so that the site user can choose to look for a word in the transcripts only or within the transcripts+annotations. In theory, this could be done. More discussion to follow if CC agrees with this idea.

Hours worked since beginning of August: 15

SA uploaded latest changes to Francotoile21.

(1) ES noticed the following problems to be fixed before moving to the production site:

- veqf1 should be removed from server as it was renamed/replaced, as follows: vepf2.
- mixc1 should be removed from server as it was renamed/replaced, as follows: mixbc1.
- eduf2 and eduf3 should be removed from server as they were renamed/replaced, as follows: pscf2 and pscf3.
- prmf5 appears twice on the map (?) Both files should be deleted from server, as the video is missing.
- lafc1 should be removed from server as it was renamed frac2. NOTE: ES notices that transcripts are inverted - frac1 has the transcript of frac2 and frac2 has the transcript of frac 1. This has to be amended.
- cltca1 and lacfa1 should be removed from server as they were renamed/replaced, as follows: cltq1 and vepq1.
- prmf6 (Valentin's video) displays as xxxx1 on the map (??) The video is not playing. Will need to look into this.

(2) In response to SA's questions, here is the list of videos that are missing thumbnails:

mixbc1 ; fraq3 ; fraq4 ; fraq5 ; fraq6 ; vepq1 ; cltq1 ; franb1 ; franb2 ; franb3 ; cltc1 ; frac1 ; frac2 ; edum1 ; pscf2 ; pscf3 ; pscf4; prmf6 ; cltf4 ; vepf2 ; accf2 ; fraf3 ; vepf1 ; lsrf3

1. The following videos have been transformed, edited and given to SA for upload on the website:
Émilie (cltf4), Jennifer (fraq5 & 6), Rémi (accf2) and Rémi&Émilie (pscf4)

2. xml files have been created and added to database for the above files on the exception of pscf4. Since this video involves two subjects, and because CC mentioned that it could a recurring format in the future, it will be necessary to discuss in more details how to:
- enter a transcript differentiating between Subject 1 and Subject 2,
- locate each character separately on the map,
This discussion should ideally take place with CC present, as these will be her decisions to make, and upon SA's return from vacation, early September.

3. various edits on xml files were made (fixes on dates, ages, etc.). Changes have been committed to the server.

4. The transcript and timeline for subtitles for fraq3 (Jordan) have been done. The file still needs to be annotated. Committed to the server.

5. ES reviewed the "theme" tags that exist on the server to amend the xml files appropriately, add new ones if necessary and clean up the dropdown search list on the site.

6. SA will upload all new changes + additions to the test server Francotoile 21 so that ES can check them next week. Thumbnails still have to be inserted on the Google map. The site should go live next week.

To be continued: transcripts and annotations for fraq3 (annotations only), fraq4, franb1, franb2, franb3, accf2, pscf4, cltf4

Hours worked since July 1st: 74 hours

ES gave me franb1.mp4, franb2.mp4, franb3,mp4.
I processed those through handbrake from mp4 to mp4, because the source files generated "unknown option" errors when I tried to process them with ffmpeg2theora, but the mp4's generated by handbrake worked. I've uploaded the files to the media folder in the florevid account.

Get source mp4 file on desktop
In Handbrake
- create mp4 output in a temp folder that is a stub
In terminal client
- cd to temp folder
- execute
find . -name *.mp4 -exec ffmpeg2theora --videoquality 6 {} \;
should end up with a .ogv file
Upload both to media folder in florevid account

I've also found that if I used the *.mp4 argument I would get "unknown option" errors, but if I specify the actual file name, I don't. Obviously means I have to do the files one at a time rather than as a batch.

Coordinates on Google map for all subjects under 19 have been amended, as follows:

1. For lsrq1, prmq1, prmq3, prmq4, prmq5, prmq6, vacq1, vacq2, vacq3 - Nationality settlement and Residence settlement tags were amended to "Saguenay-Lac-Saint-Jean" and geographic coordinates were changed to 48.547869, -71.648631

2. For lsrf1, lsrf2, prmf1, prmf2, prmf3, prmf4, prmf6, vacf1, vacf2, vacf3, secf1, secf2 - Nationality settlement and Residence settlement tags were amended to "La-Roche-Sur-Yon" and geographic coordinates were changed to 46.66169, -1.447642

3. Pierre's files were copied to DVD. ES will make sure that the DVD gets to him on his return from France.

4. Videos from Acadie were edited and added to the site. They have been named as follows:
franb1 (Véronique) / franb2 (Guy) / franb3 (Kim)
Transcripts to be done.

5. Transcript and annotations for vepf1 completed.

6. Xml files have been added for Jordan's videos (fraq3 & fraq4). Transcripts to be done.

7. Received new videos from CC, in .mpg format. This format cannot be opened by iMovie for editing. Will have to transformed in .mov files. SA is looking into it.

1. After discussing filenames with CC, the following changes occurred were added to the site:

Jean-Philippe (pscf 2 & 3) ; Pierre (lsrf3 & vepf1) ; Josette (vepf2) ; Elvis (frac2) ; Gary (cltq1 & vepq1) ; Natasha (mixbc1)

2. Annotations were added for lsrf3
3. Transcript + annotations started for vepf1 (to be continued)
4. New videos made in Acadie collected. To be transferred to POMME.
5. To be done: change location for children's videos.

We met at the HCMC to discuss works so far and issues regarding the site and the last experiment. Decisions made: 1. we need to update geographical location (LONG/ LAT) of any speakers who are not adult. We decided to use "chef-lieu" in France and region in other parts (for instance Vancouver island if we had children from Victoria, or lower mainland for Vancouver and suburbs)- ES will will update new coordinates- 2. issues in search page has already been solved. for instance * can replace one or more characters while ? can replace one letter only. this means that the message should be updated to reflect new function. also we need to grasp the user's attention by having an icon that indicate need to adapt the search. 3. the system need to search title and video descriptive 4. we need to replace "browse" by "map" and in French "vidéos" by "carte". 5. update on videos-

Went through rest of Francotoile pages and made changes needed to get the pages to validate.
Most errors were because the code was calling the version of the i18n:echo method that returns an element (which was an element in the wrong namespace) rather than the version that returns text.
A couple of instances of code producing tei elements into the output xhtml which of course didn't validate.
One instance where the html element included a style namespace which didn't validate and does not appear to be in use, so I commented out that html line and replaced it with a simpler one.

in player.xql I've added "/text()" to the end of these three lines to force the query to return a string rather than an element.
{$movie//tei:person/tei:trait[@type='description']/tei:p/text()}
let $title := $movie//tei:titleStmt/tei:title/text() | $movie//tei:titleStmt/tei:title/tei:title/text()
let $relatedTitle := $related//tei:titleStmt/tei:title/text() | $related//tei:titleStmt/tei:title/tei:title/text()

If I return a string:
- I do not get the text of any embedded elements (e.g. the title of a publication in the title of the interview), which is why in the $title line, there is the or condition which at least returns the text of the embedded title, but not as a title for styling
- the output validates
If I return the element:
- I get a validation error "element from an unrecognized namespace" in the output xhtml
- I'm not sure what happens with embedded elements, presumably more validation errors.