The first batch of 1901 and 1911 census corrections, all 15,962 of them, went live on census.nationalarchives.ie on Thursday last and great sighs of relief were breathed all round. Well, by me anyway.
For the past two months I’ve been working my way back through the user-submitted emails, checking them against the images and separating them into saints and sinners. At the same time, along with NAI’s IT staff and developers, I was working on getting the validated corrections live, a more complex operation than you’d imagine. Because the census data is static, it makes perfect sense to have the live version as a set of indexes rather than a transactional database – no moving parts, so much more stable, as well as faster to search.
That means, in order to add or change anything, the indexes have to be rebuilt from scratch. Not impossibly complex to do (he said, not having done it himself) but not something you’d want to be doing every day either. In the tables of personal information alone, there are approximately 10 million records, each with twenty items of data. Turning all of those into a static index produces almost 200 million index entries. So carefully does it.
Those 15,962 represent all emails received between October 25 2016 and September 11 this year, the date I started. If you submitted between those dates, your correction should now be live, provided I agreed that it was accurate. If you don’t see it, have another go and make me look again. And of course I’ve made my own mistakes , slated for correction the next time round. The aim now is to have a regular monthly batch update.
In the course of working eyeball-to-eyeball with the emails it’s hard not feel I’m getting to know the submitters. Some people seem to be swept away by the urge to correct. Having found a mistake in their own family, they just can’t stop: suddenly it’s four in the morning and they’ve sent off a hundred emails. Others, by the look of their email addresses, are spending most of their work day actually correcting the census. Tut tut. And I feel for the poor soul who discovered that his ancestors had recorded their religion as Baptist and retrospectively converted them to Presbyterianism.
One enterprising crowd in east Galway seem to have got together with the aim of completely correcting every single entry for the area. Good for them. Except that part of their agreed procedure appears to have been to send each correction at least three times. Just to be sure. Thereby ensuring it takes at least three times as long for the corrections to be validated. Grrr.
Another group I can’t help empathising with are the transcribers. What a strange and wonderful place early twentieth-century Ireland must have seemed to them, a land where people had jobs as coco drivers, boot owners, professors of surging and pork rangers, where children could be sixty years older than their parents and gender-roles were so fluid you would commonly find mothers-in-law who were male labourers aged 30. It feels a shame to be erasing that parallel Ireland.
Wouldn’t we all live in a much more interesting place if Eoin MacNeill really had been the secretary of The Garlic League?