Database rebuilds…

…. you gotta love them!

I’m rebuilding a multi-million record database, as the supplier has switched data formats.
Each step is trivial: simple to do; well documented; and a complete step in their own right… but when your processing 35 years worth of data in 64 files into 24 sub-databases, this takes time.

… and then one goes wrong!
Somewhere in 10-million-odd lines of sgml is something throwing a perl script… possible a spurious Unicode character.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s