FrancoToile

1. The following videos have been transformed, edited and given to SA for upload on the website:
Émilie (cltf4), Jennifer (fraq5 & 6), Rémi (accf2) and Rémi&Émilie (pscf4)

2. xml files have been created and added to database for the above files on the exception of pscf4. Since this video involves two subjects, and because CC mentioned that it could a recurring format in the future, it will be necessary to discuss in more details how to:
- enter a transcript differentiating between Subject 1 and Subject 2,
- locate each character separately on the map,
This discussion should ideally take place with CC present, as these will be her decisions to make, and upon SA's return from vacation, early September.

3. various edits on xml files were made (fixes on dates, ages, etc.). Changes have been committed to the server.

4. The transcript and timeline for subtitles for fraq3 (Jordan) have been done. The file still needs to be annotated. Committed to the server.

5. ES reviewed the "theme" tags that exist on the server to amend the xml files appropriately, add new ones if necessary and clean up the dropdown search list on the site.

6. SA will upload all new changes + additions to the test server Francotoile 21 so that ES can check them next week. Thumbnails still have to be inserted on the Google map. The site should go live next week.

To be continued: transcripts and annotations for fraq3 (annotations only), fraq4, franb1, franb2, franb3, accf2, pscf4, cltf4

Hours worked since July 1st: 74 hours

ES gave me franb1.mp4, franb2.mp4, franb3,mp4.
I processed those through handbrake from mp4 to mp4, because the source files generated "unknown option" errors when I tried to process them with ffmpeg2theora, but the mp4's generated by handbrake worked. I've uploaded the files to the media folder in the florevid account.

Get source mp4 file on desktop
In Handbrake
- create mp4 output in a temp folder that is a stub
In terminal client
- cd to temp folder
- execute
find . -name *.mp4 -exec ffmpeg2theora --videoquality 6 {} \;
should end up with a .ogv file
Upload both to media folder in florevid account

I've also found that if I used the *.mp4 argument I would get "unknown option" errors, but if I specify the actual file name, I don't. Obviously means I have to do the files one at a time rather than as a batch.

Coordinates on Google map for all subjects under 19 have been amended, as follows:

1. For lsrq1, prmq1, prmq3, prmq4, prmq5, prmq6, vacq1, vacq2, vacq3 - Nationality settlement and Residence settlement tags were amended to "Saguenay-Lac-Saint-Jean" and geographic coordinates were changed to 48.547869, -71.648631

2. For lsrf1, lsrf2, prmf1, prmf2, prmf3, prmf4, prmf6, vacf1, vacf2, vacf3, secf1, secf2 - Nationality settlement and Residence settlement tags were amended to "La-Roche-Sur-Yon" and geographic coordinates were changed to 46.66169, -1.447642

3. Pierre's files were copied to DVD. ES will make sure that the DVD gets to him on his return from France.

4. Videos from Acadie were edited and added to the site. They have been named as follows:
franb1 (Véronique) / franb2 (Guy) / franb3 (Kim)
Transcripts to be done.

5. Transcript and annotations for vepf1 completed.

6. Xml files have been added for Jordan's videos (fraq3 & fraq4). Transcripts to be done.

7. Received new videos from CC, in .mpg format. This format cannot be opened by iMovie for editing. Will have to transformed in .mov files. SA is looking into it.

1. After discussing filenames with CC, the following changes occurred were added to the site:

Jean-Philippe (pscf 2 & 3) ; Pierre (lsrf3 & vepf1) ; Josette (vepf2) ; Elvis (frac2) ; Gary (cltq1 & vepq1) ; Natasha (mixbc1)

2. Annotations were added for lsrf3
3. Transcript + annotations started for vepf1 (to be continued)
4. New videos made in Acadie collected. To be transferred to POMME.
5. To be done: change location for children's videos.

We met at the HCMC to discuss works so far and issues regarding the site and the last experiment. Decisions made: 1. we need to update geographical location (LONG/ LAT) of any speakers who are not adult. We decided to use "chef-lieu" in France and region in other parts (for instance Vancouver island if we had children from Victoria, or lower mainland for Vancouver and suburbs)- ES will will update new coordinates- 2. issues in search page has already been solved. for instance * can replace one or more characters while ? can replace one letter only. this means that the message should be updated to reflect new function. also we need to grasp the user's attention by having an icon that indicate need to adapt the search. 3. the system need to search title and video descriptive 4. we need to replace "browse" by "map" and in French "vidéos" by "carte". 5. update on videos-

Went through rest of Francotoile pages and made changes needed to get the pages to validate.
Most errors were because the code was calling the version of the i18n:echo method that returns an element (which was an element in the wrong namespace) rather than the version that returns text.
A couple of instances of code producing tei elements into the output xhtml which of course didn't validate.
One instance where the html element included a style namespace which didn't validate and does not appear to be in use, so I commented out that html line and replaced it with a simpler one.

in player.xql I've added "/text()" to the end of these three lines to force the query to return a string rather than an element.
{$movie//tei:person/tei:trait[@type='description']/tei:p/text()}
let $title := $movie//tei:titleStmt/tei:title/text() | $movie//tei:titleStmt/tei:title/tei:title/text()
let $relatedTitle := $related//tei:titleStmt/tei:title/text() | $related//tei:titleStmt/tei:title/tei:title/text()

If I return a string:
- I do not get the text of any embedded elements (e.g. the title of a publication in the title of the interview), which is why in the $title line, there is the or condition which at least returns the text of the embedded title, but not as a title for styling
- the output validates
If I return the element:
- I get a validation error "element from an unrecognized namespace" in the output xhtml
- I'm not sure what happens with embedded elements, presumably more validation errors.

1. Jordan's videos have been edited and passed on to SA for upload on website

2. ES sent a few emails to SA with regards to recent fixes:
a. ES noticed that mixc1 was no longer showing on the google map in the Browse page.
b. Film titles are still not showing in the video titles for sngl1 and sngl2
c. ES noticed that both the live and test website behave differently on different versions of browsers. ES asked SA if it would be possible to update Firefox and other browsers on POMME to their newer versions.
d.ES will do more testing during the weekend on newer versions of Firefox, Chrome, Opera, Safari and IE to find out whether there are major differences of behaviour.
e. the extension of the full transcript has helped for reading some of the annotations but various files are still affected with the "flickering" and "scroll down bar" problem. ES sent a list of those files by email to SA.
f. The thumbnails for newly added videos are not showing on the website.

3. Five new transcripts have been created and added and committed to the database, one that still requires to get annotated:
a. cltc1, frac1, lafc1 (Elvis)
b. fraf3 (Maeva)
c. cltf4 (Pierre) - annotations still to be created

Hours worked since July 1: 50 hours

The data files have a who attribute with value "#interviewer" for full utterances by the interviewer. The code for generating the full transcript captured that attribute and generated the correct xhtml class attribute. The javascript code generating the subtitles texts did not. I added an isInterviewer key to the caption object in js_captions.xsl and then in captions.js I test for the value of the isInterviewer key to determine whether or not to add a class="interviewer" to the output element. I tried doing it all in the js_captions.xsl (to save more processing in the js loop in captions.js, but couldn't get it to go.

Any annotation that goes beyond the size of the full transcript box leads to having a scrolldown bar appearing. However, it is impossible to scroll down, the screen and annotation flicker, and it makes it impossible to read the content of the annotation.

Simplest thing was to add more bottom-padding to the detailPanel in global.css, so that's what I did.

Any title (film, book, etc.) inserted in a <title> element within the titleStmt/title element does not show on the screen (see files sngl1 & sngl2)

Temporary improvement:
Modified the code in player.xql 40 from
let $title := $movie//tei:titleStmt/tei:title/text()
to
let $title := $movie//tei:titleStmt/tei:title/text() | $movie//tei:titleStmt/tei:title/tei:title/text()

Problem is that I eventually want to style any embedded titles, and the current approach isn't going to support that. I'll have to do some research to figure out how to parse the titleStmt element rather than just grab its text.

When generating an item in the list of related videos, the relatedList code in player.xql looked for
$relatedTitle := $related//tei:title
which I changed to
$relatedTitle := $related//tei:titleStmt/tei:title
so that only the title in the titleStmt would be returned and not all the title elements (e.g. of books, productions etc.) in the utterances

The space inserted between </ref> and <ref> is automatically deleted, which results in words annotated consecutively to be run together in the output xhtml. E.g. :
http://pear.hcmc.uvic.ca:8081/francotoile21/player.xql?id=accf1 (end of
6th paragraph)

in transcript.xsl added <xsl:text> </xsl:text> at end of template for tei:ref[@type='info'] to force a space to appear after the anchor in the xhtml generated from each tei:ref element

1. ES was informed by SA that amending the names of video files after they are uploaded on the server is fine, as long as we change all references to these files elsewhere (i.e. changing all references in the corresponding xml files). Therefore, all new videos have been added to the server and are visible on http://lettuce.tapor.uvic.ca/~florevid/media/ under the following (temporary) names: cltca1 & lafca1 (Gary), eduf2 & eduf3 (Jean-Philippe), prmf6 (Valentin), cltc1, frac1 & lafc1(Elvis), vepf1 & cltf4 (Pierre), fraf3 (Maeva).

2. To add a new xml file, indicate the following in the command box: [svn add [name of file].xml]

3. ES created a document with the list of the principal codes that are used for transcriptions (i.e. italics, interviewer's intervention, etc.) for future use. Document is saved on POMME and has been uploaded to Dropbox (cf. Liste des codes de transcription pour FrancoToile).

3. Transcripts for cltca1, lafca1, eduf2, eduf3 have been created and committed to Oxygen. These files are visible on FrancoToile21. Transcript for cltc1 has been created but not added to server's database as ES is awaiting CC's permission to do so (more details were sent by email to CC)

4. Latitude and longitude details for sngl1 and sngl2 were amended to reflect the country where these two speakers come from (i.e. Mali & Burkina Faso). ES also asked Dr. Niang where the recordings took place and he confirmed that he was in Burkina Faso and not Senegal as originally entered in the xml files.

5. New requests have been forwarded to SA with regards to the Google map:
a. Change the language from English into French in video descriptions visible on Google map for French interface (i.e. "name" becomes "nom", "location" becomes "lieu", "gender" becomes "sexe")
b. Change the word "location" for "lieu" on the Search page of the French interface.
c. In the xml files, ES added a comma between the [settlement] tag and the [country] tag for both residence and nationality, so that it displays better within the video descriptions available on Google map. SA believes that the comma should be part of the code and not as a text addition to the xml file, and he will look into creating the appropriate rule.
d. It was suggested that being able to choose several topics & age brackets from the drop-down lists of the Search page could be a good idea. It would allow to be more precise when selecting videos from databse. For example, one could find all videos where someone between "10-14" and "65+", is talking about "music", "language", and "cinema". The Search function would use AND (not OR).
e. ES got confused with the [stages of life] tag that is available in the xml files. The purpose of this tag is to be discussed with CC and SA will double-check if it's being currently used on the site (for example, as part of a site Search, etc.)
f. In the "topic/thème" drop down list on Search page, all the new topics that ES added as part of the newly added videos only display in the language they were entered (i.e. French) both on the French and English interfaces. Most of these topics will be deleted anyway as they make the list too long, and not easy to read and manage. However, one question remains: should there be a need to add a new [item] tag for the topic list (for example: music/musique), how should it be entered in Oxygen so that it displays and translates correctly on both interfaces of the website? Also, would it be a good idea to have these topics classified in alphabetical order in the drop down list?

6. To be discussed with CC: what is information to be used for Google map? Should it be where the person grew up, where the person lives, or where the recording took place? ES will discuss this with CC during next meeting and notify SA accordingly.
Note 1: Currently, the information regarding "location" that is displayed on Google map is what is entered under "residence" in the xml file.
Note 2: ES wanted to check the Excel sheet that CC created and that contains some information on the interviewed people (i.e. where they live, their age, etc.), but XL documents cannot be opened on the HCMC's computer.

7. Also to be discussed at next meeting with CC:
a. the topics (les thèmes) that best describe the videos and that provide a list that is neither too long or too difficult to choose from.
b. the new videos (Jordan) to be edited and added to the site + transcripts to be done
c. create a CD with Pierre's videos
d. identify the type of subjects that would be the most needed to expand the video database
e. retrieve, if possible, missing video (Yoanna, education primaire, prmf5)

8. Next step is the creation of transcripts for all remaining new videos.

1. All transcripts have now been reviewed and committed to the server. ES asked SA to upload them on FrancoToile21.
2. ES sent an email to SA (copy to CC) with a list of all the technical problems noticed while reviewing transcripts.
3. 10 new videos have been given to SA and are to be uploaded onto the site. ES sent an email to CC with suggestions of id for videos (e.g. cltf2, etc.) Will pass on CC's decision to SA as soon as it is received.
4. One video (prmf5 - primaire France 5 - Yoanna) is still missing. Once received ES will review and update the transcript that is currently on the website.
5. Next steps are :
a. create new Oxygen files and enter transcripts for new videos (9 transcripts to be done from scratch + 1 to be entered in Oxygen)
b. upload new videos and transcripts on website
c. Receive Jordan's videos from CC, edit, transcribe and add them to the site.
d. copy Pierre's video to CD.

Following Jamie's earlier posts to this blog (here and here), I downloaded and installed ffmpeg2theora and handbrake. Not sure exactly where the installer put ffmpeg2theora as it didn't tell me, but I was able to invoke it. I installed handbrake into the applications directory.

To create the ogv file, I executed from the command line:
find path/to/mov/folder -name *.mov -exec ffmpeg2theora --videoquality 6 {} \;

To create the mp4 file, I used handbrake's GUI, set the codec to H.264, the Video Quality to Constant Quality 20, and the framerate to Same as Source. I was unable to execute the same thing from the command line.