Big Data, Tank Engines, and Digital Junk Drawers

09 Jan

The other day I had to do a backup of my computer – we’d had a power spike that took out the surge protectors, my backup drive, my son’s power supply, and his main hard drive.  In 20 years, we’d never had power go out, so this was a first, and had us wanting to make sure we didn’t have to go through that again.

It was a “not fun” few days of buying new hardware, rebuilding one machine, buying UPS’s – and fixing the backup drive, but we did it, and as is often the case with these things – it got me thinking.  My computer is like a digital attic – stuff gets stored there and sometimes referenced, but honestly, often forgotten.

I thought a little more about that – and remember in one place we lived as I was growing up – there was a garage full of stuff…

I remember thinking of it as a garage full of treasures.  An old army barracks my dad owned for a while came chock full of old radios, tools, black electric fans with wire cages, a huge pile of boards that had made up the side of a couple of Northern Pacific Railways boxcars that had last carried a load of 40,000 pounds of bananas in 1929 (a little piece of paper to that effect was still tacked to one of the boards when we found it).  That ended up being two walls of my room when I was growing up,

My grampa, on the other hand, had not just a garage full, but an entire barn full of treasures – one of which was an olive drab, unused, hunk of metal, that when you looked more closely at it and did some research, was a flathead V-8 engine made by Cadillac for small tanks in World War II. (like this one).  I’m sure it was plentiful in its time – but today? It was rare, but rare doesn’t necessarily mean valuable, and being in a barn, you had to go through a lot of crap to find the treasures.  And the thing was – he’d collected so much stuff – treasures in their own time – that some of it, while still functional and serviceable, had gone completely out of date and become obsolete while it was being stored in that barn waiting to be used again.

For years after Grampa passed on, my uncle tried to get rid of that tank engine – and people kept saying how valuable it must be, but no one would take it.   Finally, he said to one interested looking fellow,

“How much will you give me for it?”

“Well, um, I don’t know….”


“What? It’s got to be worth more than that.”

“Okay, but will you pay me $50.00 for it?”

And the guy tried to back out a bit.

“A dollar? Would you pay a dollar for it?”

And of course, the fellow wouldn’t – so this extremely rare Cadillac Tank Engine wasn’t worth a dollar, because really, something is only worth as much as someone will pay for it, right?

Some time later, I remember my dad and I looking at a cluttered attic with totally different eyes.  Again, I saw treasures, relics of a bygone era, while he was sizing up how long it would take to clean the place out.  He pondered a bit, took a deep breath, and reminisced a little bit, remembering that as a kid, he’d visited an old man who had an attic like this, full of “treasures” – and the old man said to dad, “Son, it’s just stuff…”

All I saw was treasures, at the time, but he was right.

It was just stuff.

Going back to my uncle for a moment – He and I had talked about kind of a lifecycle of “stuff” – where at first  you’re willing to trade something you consider valuable for it, and initially, this “stuff” gives to you… It could be something that saves you time, or makes you money, or brings you happiness or comfort, but it gives and you get something because you have it.

Eventually it just becomes part of your life, and it’s pretty much been there as long as you can remember, but at some point, it stops giving, and the balance shifts, ever so slightly, and this what has given you so much over its lifetime begins to take.  This goes for stuff and for things, and sometimes people and relationships in your life, and it’s a signal that it’s time to move on, or let go.  Eventually, the shift is more pronounced, and just the simple act of keeping “the stuff” starts costing more money, more time, more energy, than you get out of it.  But you’re used to having it, so you hold onto it.

And it costs more.

And I kept thinking…

In fact, I took a step back, mentally, and realized as I was sitting there configuring the UPS’s I’d bought for my computers, backing up tens of thousands of photos, and I realized that in some ways, the shift, like the photography I’d learned years ago, was making the transition from analog to digital, that my computer was full of ones and zeroes, and it was costing money to keep them.

As data professionals, we talk about how important it is to keep our data safe, and the fact is, it is important, but are we keeping too much? Just like I wondered sometimes whether it was really important for my grampa to be keeping some of the things in his barn, Is it important to keep every digital picture I ever took?  If I keep them, I have to manage them, I have to make sure they’re usable, right?

Here, let me throw a digital monkey wrench into the mix.  You’ve all got digital cameras out there now, right? How do you handle it when you have upgrades of image processing software?

The reason I ask is that a number of years ago, Microsoft made a product called ‘Picture It’ – which, for its time, was pretty good, but the problem is, none of the software that came afterwards would open the files created by this product.  So now, because I have upgraded the computer and the operating system and Picture It won’t run on the new one, I have hundreds of pictures with a .mix extension that I can’t open at all unless I find a copy of Picture it 5.0.

And, apparently, our old Windows 95 box. (it’s in the basement somewhere)

That would cost me time.


A number of years ago I bought a family tree program and put a bunch of pictures in it – with all sorts of metadata in the pictures – where they were taken, and so on.  Understand these were slides and prints that had been scanned, there was no GPS data embedded in the images at all.  I couldn’t upgrade to the next version, and found that all the work I’d put into researching and getting information about the pictures that are part of my family tree – simple metadata about the pictures – was now useless – I couldn’t transfer it anywhere unless I bought the next version of the software.


That would cost me money.

And now – it brought me full circle, as I was sitting there, computers hooked into the UPS systems, backup drive slowly being filled up by backed up ones and zeroes.

It had cost me both time and money.

It had me asking a lot of questions, like, “When is it important to let something go?”  As I was sitting there – looking around, I not only realized that I had thousands of images, some of which I hadn’t seen in years, that that needed to be backed up, but also realized that my computer had turned into a digital junk drawer.

I know I keep lots of email far longer than I need to.  I have piles of CD’s I’ve forgotten about.  Heck, I have piles of floppies even – and I don’t have a machine that has a floppy drive in it anymore…


How many of you out there could raise your hand to that one?

Dragging myself away from piles of floppies, CD’s, and the two Pentium boxes I finally got rid of the other day, I find myself thinking about the stuff we do at work.

We have stuff that we have to keep for legal reasons, which means boxes have to run in isolation on outdated software, but we have to keep them that way, we can’t upgrade them.  At least that way the data is readable, and accessible. There have been situations where people got rid of tapes of very important data only to discover that they had racks and racks of tapes they couldn’t read anymore.  We keep gathering data, we keep making more databases.  They keep growing.  I know poor database design makes some of the databases I administer and manage daily get bigger – the growth chart of one of them looks like the flight path of a homesick angel, and it is seriously causing us some trouble.

At the moment, that particular app is under discussion, but the thought of wanting to keep all the data we get, in case we need it someday (words I heard growing up many times) – is a little overwhelming.

But how do we know when that someday is?

I know digital storage, like real storage, initially, is cheap – but does it count the machines that need to handle the backups? The people to maintain them? The backups themselves? The offsite storage? How much will it cost us to manage what we had, at the expense of what we have?

I don’t have all the answers yet, in fact, I’m still struggling with a lot of it myself, but this whole concept of “Big data” – it makes me wonder when, eventually, someone’s going to have the arduous task cleaning out the digital attic…


Posted by on January 9, 2013 in Uncategorized


Tags: , ,

4 responses to “Big Data, Tank Engines, and Digital Junk Drawers

  1. Ed

    July 4, 2013 at 12:18 pm

    this is what I have in mind for my own home data storage answer

    • tomroush

      July 25, 2013 at 9:50 pm

      that would be interesting, and it speaks directly to the point I’m trying to make, which is trying to figure out how to manage what I have wisely, and not hang onto stuff so much that my past swallows up my present. how would that software handle OS upgrades? how much would it cost to have the system? backups? UPS? etc… it’s easier to think of it professionally, then it’s someone else’s budget, but personally, I’m trying to figure out how to lighten the load, and I freely admit I’m not good at it yet.

  2. Gregor

    August 3, 2013 at 11:20 am

    Dang Tom, you really know how to hit the jugular. It is truly a topic that this pack rat is continually thinking about and trying to get closer to ground zero……..with the junk that is……..I know that won’t truly happen until I get to take a dirt nap……but I am trying to deal with that shift in thought to “GET RID OF IT!” Thanks.

    • tomroush

      August 3, 2013 at 10:06 pm

      Funny how lessons in the IT world translate into the real world, huh? How many cubic feet of “stuff” do we each have that never gets used? or what about the ever popular “storage lockers” – Oh, I could go on for a while on that, but first should empty my own locker. Ahh, the lessons… 🙂


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: