Permalink 04:58:27 pm, by mholmes, 333 words, 8 views   English (CA)
Categories: Servers, R & D, Activity log, Documentation, Documentation; Mins. worked: 90

Building a vector tile server

Now that Open Layers fully supports vector layers, we're looking at the practicality of running a vector tile server for our projects. Starting from this docker example, I created a script which I can run on a standard Debian Stretch install to create a working tile server:


#This is to be run on a standard Debian Stretch install.

#Install core stuff
apt-get update && DEBIAN_FRONTEND=noninteractive apt-get -y install apt-transport-https curl unzip build-essential python libcairo2-dev libprotobuf-dev xvfb 

#Temporarily use a specific source for the exact nodejs version we need.
echo "deb https://deb.nodesource.com/node_4.x jessie main" >> /etc/apt/sources.list.d/nodejs.list
echo "deb-src https://deb.nodesource.com/node_4.x jessie main" >> /etc/apt/sources.list.d/nodejs.list

#Install it.
apt-get -qq update && DEBIAN_FRONTEND=noninteractive apt-get -y --allow-unauthenticated install nodejs 

#Now remove the source.
rm /etc/apt/sources.list.d/nodejs.list
apt-get clean

#Added these in order to get the npm install to run properly. 
#The problem was building canvas.
apt-get -y install libjpeg62-turbo-dev libpango1.0-dev libgif-dev g++

#Create directory for tileserver application.
mkdir -p /usr/src/app

#Get the Klokantech code for the server.
cd /usr/src/app 
curl -L https://github.com/klokantech/tileserver-gl/archive/master.zip -o master.zip
unzip master.zip 
cp -r tileserver-gl-master/* ./
rm -rf tileserver-gl-master

#Install the node stuff
npm install --production

#Set environment variable
echo NODE_ENV=\"production\" >> /etc/environment

#Create the folder for the mbtiles files (you'll need to supply these later).
mkdir /data

#In case other servers are installed and running, stop them.
systemctl stop apache2 mysql
systemctl disable apache2 mysql

echo "Now put your mbtiles files into the /data folder, and run /usr/src/app/run.sh."
#Start the tileserver on port 80.

This could form the basis for a VM-based tileserver for our projects, including the Confederation Debates; running a server for all of Canada is quite practical due to the efficiency of the vector format.


Permalink 11:36:29 am, by mholmes, 108 words, 9 views   English (CA)
Categories: R & D, Activity log, Documentation; Mins. worked: 45

CSS issue for the record

Just recording this because it took a little while to figure out:

We discovered this morning that the B and T conference site program would not print past the first page; it was as if the rest of the content was invisible to the print renderer (in all browsers). The culprit turned out to be this, in style.css:

.internal {
  position: relative;
  overflow: auto;   <<------------------------this line
  width: 100vw;
  height: 100vh;
  -webkit-overflow-scrolling: touch;

It hides anything beyond the viewport window from the print renderer. I was able to override by adding:

@media only print {
  .internal {
     overflow: visible;

I let PS know about it, since it's his stylesheet.


Permalink 12:47:46 pm, by Greg, 22 words, 13 views   English (CA)
Categories: Documentation; Mins. worked: 0

Keyman keyboards on Linux

Placeholder for info on using Keyman keyboards on Linux using KMFL framework provided by SIL. A full tutorial will be added eventually.


Permalink 02:34:53 pm, by Greg, 23 words, 15 views   English (CA)
Categories: Servers, Activity log; Mins. worked: 450

Building an Ubuntu package server - apt-mirror, reprepro, tftp

I'm building a new apt Frankenserver out of spare parts, and have re-documented the process from scratch. Notes are in the utilities repo.


Permalink 09:05:19 am, by mholmes, 77 words, 10 views   English (CA)
Categories: Servers, R & D, Activity log, Activity log, Documentation, Documentation; Mins. worked: 30

Upgrading teiJenkins java

The upgrade for Jenkins on teiJenkins was being kept back, and it turned out this was because Ubuntu 14.04 has Java 7 by default. I added a PPA for Java 8, updated the alternatives (sudo update-alternatives --config java) to point to the new one, and was then able to install Java 8. Following that, the Jenkins update went ahead. I elected to keep my existing config for Jenkins rather than overwrite. It needed a reboot for Apache to find Jenkins again.

Permalink 08:33:12 am, by mholmes, 23 words, 11 views   English (CA)
Categories: Servers, R & D, Activity log, Activity log, Documentation, Documentation; Mins. worked: 20

Extended partition on jenkins.hcmc.uvic.ca

RE provided new space to double the available drive space; followed my own instructions here to extend the partition. No problems at all.


Permalink 05:02:07 pm, by mholmes, 132 words, 13 views   English (CA)
Categories: Servers, R & D, Activity log, Activity log, Documentation, Documentation; Mins. worked: 90

How to deploy a new XAR on Jettys

Today I blew up a couple of the apps and had to restart them, through doing this the wrong way. When you have a new XAR to deploy:

  1. Use Chrom*, not FF.
  2. Connect over the internal URL on :8080.
  3. Upload the new package.
  4. If it goes wrong and you see an error message, the chances are the db is now set to read-only.
  5. If that happens, try shutting down the db from the web interface. If that works, restart it from /etc/init.d/jetty. If it fails, you may need to kill all the relevant processes on Peach before restarting.

With these big XARs, we may need to consider testing an alternative process where we uninstall the old XAR and then put the new one in the autodeploy folder before restarting eXist.


Permalink 02:08:28 pm, by mholmes, 128 words, 42 views   English (CA)
Categories: Announcements; Mins. worked: 60

Starting and stopping exist when not listening on localhost

We've hit a problem with the normal situation where we're running eXist listening on a different domain from localhost. To summarize:

If eXist is running on the default localhost:8080, I can use startup.sh and shutdown.sh to start and stop it.

If it's listening instead on another ip name, I can still start it with startup.sh, but I can't stop it with shutdown.sh or with start.jar directly. I get:

ERROR: Failed to create input stream: Unexpected end of file from server
CAUSE: Failed to create input stream: Unexpected end of file from server

Disowning the process in the terminal where it was started makes no difference. Supplying credentials also makes no difference. Waiting to see if anyone on the eXist list has any ideas.


Permalink 04:02:33 pm, by mholmes, 66 words, 16 views   English (CA)
Categories: R & D, Activity log; Mins. worked: 20

Large XAR uploads and Firefox

The Mariage XAR is large, and when I try to deploy it to a running eXist from Firefox, it dies after a couple of minutes with an anonymous "error". This must be due to some file size constraint in Firefox; logging it here, along with the workaround (which is to use Chromium instead), and if I have the chance to research the reason I'll post it.


Permalink 03:11:21 pm, by mholmes, 24 words, 57 views   English (CA)
Categories: Servers, R & D, Activity log, Activity log, Documentation; Mins. worked: 60

Rebuild of eXist template

The eXist team tagged 3.1.1, so I've rebuilt our template from that tag, tested it, and pushed it to the existDeployer folder on home1t.

:: Next Page >>


This blog is the location for all work involving software and hardware maintenance, updates, installs, etc., both routine and urgent, in the server room, the labs and the R&D rooms.


XML Feeds