RSS

Tag Archives: Managing Data

Keeping the Electrons Happy


So I work as a database administrator, which is often something that confounds people who aren’t in IT… if I try to explain to them what I do, their eyes glaze over like a Krispy Kreme donut, and I realize I have to back up and introduce things in a little simpler way, so I usually start off with the sentence:

“I piss off electrons all over the world.”

And that gets them laughing, then I can tell them what I really do.

And the thing is, I work for a consulting firm, but I rarely, if ever, see the front end of the applications we run, or work on or build. I see domains, and servers, and databases.

My life at work consists of solving problems, pissing off electrons, and trying not to do the same to people.

For the most part, this is a good set of priorities to have.

As a DBA, you do your best to keep from making mistakes, right? You want your users happy, you want your electrons just slightly irritated, and you want your data to be as perfect as it can be.

It’s hard to see what all this looks like on the front end until you actually see it, and then it’s like being a doctor and seeing symptoms, and intuitively understanding what those symptoms mean.

And, surprise surprise, I have a story about that.

So some years back I had to go to the doc to go over some test results.

When I checked in, they asked all sorts of other questions, like, “Have you ever gone under another name? Have you ever lived at this address? And on and on and on…

I’d been at this place before, they already had this information in their system. There was no reason for them to be asking me these questions.

So I turned the tables, and asked them why they were asking me all these questions.

It turns out someone was in their system with my birthdate and my SSAN…

Hmmm…

So the good thing about this?

They noticed it.

The bad thing?

Well, – let me just take you through it – and see if you can figure it out…

The receptionist made a telephone call to fix the problem.

I was ushered back to see the doc, the nurse asked what medicines I was on. This was unusual since it was in their system, but she took all my records and entered them into the system. Sometime later, the doc came in and wanted to compare my records, current to past, and so on, but there was nothing of my medical records after 2007, meaning there were several years of records missing.

What do you think happened at this point? Take a guess, then keep reading.

I put two and two together, and because of the strange series of questions I’d been asked initially, I’d paid attention, and had made a note of the security guy’s name and number, and asked the doc if he wanted me to call, because, “It’s what I do”.

He, still trying to figure out what was going on with the keyboard, said,“Sure.”

I picked up my cell phone, called the number I’d written down and asked to talk to the guy whose name I’d written down below that.

His response: “Oh, I was trying to fix that and must have pushed the wrong button by mistake.”

I just let the silence hang in the air for a little bit while he realized what he’d said and who he’d said it to…

…and then I took off my patient hat, and sitting there in the doctor’s office, put on my DBA hat, cracked my knuckles a bit, and told him to let me talk to the person who was fixing the problem because by golly it was GOING to get fixed, and get fixed right then.

I was connected to the person who was fixing the issue, and explained that I was (ahem) SITTING IN THE DOCTORS OFFICE WHEN MY RECORDS DISAPPEARED, and would she kindly make them bloody well reappear.

Now.

She said she could merge the records, said it would take till the end of the day.

Have you ever had to project an air of calmness when it was the last thing you wanted to do?

Yeah… that’s where I was.

I tried to explain to her that I was still (ahem) SITTING IN THE DOCTORS OFFICE, WITH THE DOCTOR, WAITING TO GO OVER RESULTS, and would appreciate it if she could fix that long before the end of the day, like before I left the office, since I was there in the doctor’s office, and we were about to make some pretty significant decisions based on those results.

She said she’d work on it, and I gave her my cell number and told her to call me when she was done.

In a triumph of the anti-nerds, the doc got out a huge pad of paper and a marker and drew on it to show us what he remembered of the information he’d seen before it was deleted, and was most of the way through that when my phone buzzed.

It was the gal from IT who had worked on un-futzing the records.

She said it was fixed. She’d merged the records (her words).

The doc logged into the system again, and all my records were there.

Both he and my wife were impressed.

So we got those things taken care of, I went in later and found that in the results of the merge, my meds showed up twice, (once from the original, once from when the nurse recorded them after they were deleted).

So we (well, they) had to fix that.

I had a little chat with the IT folks at the hospital after that to get them to understand that there were folks out here who knew what was going on in there and what it meant.

And it needed to be fixed.

Because, I realized, as much as I tell people I just piss off electrons, those electrons mean something to someone.

And they have to be accurate.

And it got me thinking…

See, while I was pretty annoyed that the problem existed (it’s not that the whole situation wasn’t already stressful enough), it was an amazing learning experience, to step out of the role of being the patient and tell the doctor who was about to try to fix me, that he needed to let me do my work, in his office, so I could fix his problems, so he could see what he needed to see in order to fix mine.

Yeah, I had to look at that paragraph a time or two myself.

I wondered how long it would have taken if that had happened to someone else right then, because seriously, who else would have been in a position to know what had happened and what it meant?

I’m still a little baffled by it all, and I think that’s okay.

I started looking around at the projects the company I work for does (I work for Avanade, a consulting company), and it always astonishes me what all kinds of things we’re involved in – the stuff I rarely see, but affects people’s lives in ways that are big and small, from the drinks you might get on a flight across the country to buying a motorcycle to, even figuring stuff out at the doctor’s office.

And it makes me realize that I don’t want to piss off the electrons at all.

I want to keep them very, very happy.

 
1 Comment

Posted by on April 20, 2015 in Uncategorized

 

Tags: , ,

Big Data, Tank Engines, and Digital Junk Drawers


The other day I had to do a backup of my computer – we’d had a power spike that took out the surge protectors, my backup drive, my son’s power supply, and his main hard drive.  In 20 years, we’d never had power go out, so this was a first, and had us wanting to make sure we didn’t have to go through that again.

It was a “not fun” few days of buying new hardware, rebuilding one machine, buying UPS’s – and fixing the backup drive, but we did it, and as is often the case with these things – it got me thinking.  My computer is like a digital attic – stuff gets stored there and sometimes referenced, but honestly, often forgotten.

I thought a little more about that – and remember in one place we lived as I was growing up – there was a garage full of stuff…

I remember thinking of it as a garage full of treasures.  An old army barracks my dad owned for a while came chock full of old radios, tools, black electric fans with wire cages, a huge pile of boards that had made up the side of a couple of Northern Pacific Railways boxcars that had last carried a load of 40,000 pounds of bananas in 1929 (a little piece of paper to that effect was still tacked to one of the boards when we found it).  That ended up being two walls of my room when I was growing up,

My grampa, on the other hand, had not just a garage full, but an entire barn full of treasures – one of which was an olive drab, unused, hunk of metal, that when you looked more closely at it and did some research, was a flathead V-8 engine made by Cadillac for small tanks in World War II. (like this one).  I’m sure it was plentiful in its time – but today? It was rare, but rare doesn’t necessarily mean valuable, and being in a barn, you had to go through a lot of crap to find the treasures.  And the thing was – he’d collected so much stuff – treasures in their own time – that some of it, while still functional and serviceable, had gone completely out of date and become obsolete while it was being stored in that barn waiting to be used again.

For years after Grampa passed on, my uncle tried to get rid of that tank engine – and people kept saying how valuable it must be, but no one would take it.   Finally, he said to one interested looking fellow,

“How much will you give me for it?”

“Well, um, I don’t know….”

“$50.00?”

“What? It’s got to be worth more than that.”

“Okay, but will you pay me $50.00 for it?”

And the guy tried to back out a bit.

“A dollar? Would you pay a dollar for it?”

And of course, the fellow wouldn’t – so this extremely rare Cadillac Tank Engine wasn’t worth a dollar, because really, something is only worth as much as someone will pay for it, right?

Some time later, I remember my dad and I looking at a cluttered attic with totally different eyes.  Again, I saw treasures, relics of a bygone era, while he was sizing up how long it would take to clean the place out.  He pondered a bit, took a deep breath, and reminisced a little bit, remembering that as a kid, he’d visited an old man who had an attic like this, full of “treasures” – and the old man said to dad, “Son, it’s just stuff…”

All I saw was treasures, at the time, but he was right.

It was just stuff.

Going back to my uncle for a moment – He and I had talked about kind of a lifecycle of “stuff” – where at first  you’re willing to trade something you consider valuable for it, and initially, this “stuff” gives to you… It could be something that saves you time, or makes you money, or brings you happiness or comfort, but it gives and you get something because you have it.

Eventually it just becomes part of your life, and it’s pretty much been there as long as you can remember, but at some point, it stops giving, and the balance shifts, ever so slightly, and this what has given you so much over its lifetime begins to take.  This goes for stuff and for things, and sometimes people and relationships in your life, and it’s a signal that it’s time to move on, or let go.  Eventually, the shift is more pronounced, and just the simple act of keeping “the stuff” starts costing more money, more time, more energy, than you get out of it.  But you’re used to having it, so you hold onto it.

And it costs more.

And I kept thinking…

In fact, I took a step back, mentally, and realized as I was sitting there configuring the UPS’s I’d bought for my computers, backing up tens of thousands of photos, and I realized that in some ways, the shift, like the photography I’d learned years ago, was making the transition from analog to digital, that my computer was full of ones and zeroes, and it was costing money to keep them.

As data professionals, we talk about how important it is to keep our data safe, and the fact is, it is important, but are we keeping too much? Just like I wondered sometimes whether it was really important for my grampa to be keeping some of the things in his barn, Is it important to keep every digital picture I ever took?  If I keep them, I have to manage them, I have to make sure they’re usable, right?

Here, let me throw a digital monkey wrench into the mix.  You’ve all got digital cameras out there now, right? How do you handle it when you have upgrades of image processing software?

The reason I ask is that a number of years ago, Microsoft made a product called ‘Picture It’ – which, for its time, was pretty good, but the problem is, none of the software that came afterwards would open the files created by this product.  So now, because I have upgraded the computer and the operating system and Picture It won’t run on the new one, I have hundreds of pictures with a .mix extension that I can’t open at all unless I find a copy of Picture it 5.0.

And, apparently, our old Windows 95 box. (it’s in the basement somewhere)

That would cost me time.

Hmmm…

A number of years ago I bought a family tree program and put a bunch of pictures in it – with all sorts of metadata in the pictures – where they were taken, and so on.  Understand these were slides and prints that had been scanned, there was no GPS data embedded in the images at all.  I couldn’t upgrade to the next version, and found that all the work I’d put into researching and getting information about the pictures that are part of my family tree – simple metadata about the pictures – was now useless – I couldn’t transfer it anywhere unless I bought the next version of the software.

Hmmm…

That would cost me money.

And now – it brought me full circle, as I was sitting there, computers hooked into the UPS systems, backup drive slowly being filled up by backed up ones and zeroes.

It had cost me both time and money.

It had me asking a lot of questions, like, “When is it important to let something go?”  As I was sitting there – looking around, I not only realized that I had thousands of images, some of which I hadn’t seen in years, that that needed to be backed up, but also realized that my computer had turned into a digital junk drawer.

I know I keep lots of email far longer than I need to.  I have piles of CD’s I’ve forgotten about.  Heck, I have piles of floppies even – and I don’t have a machine that has a floppy drive in it anymore…

Sigh.

How many of you out there could raise your hand to that one?

Dragging myself away from piles of floppies, CD’s, and the two Pentium boxes I finally got rid of the other day, I find myself thinking about the stuff we do at work.

We have stuff that we have to keep for legal reasons, which means boxes have to run in isolation on outdated software, but we have to keep them that way, we can’t upgrade them.  At least that way the data is readable, and accessible. There have been situations where people got rid of tapes of very important data only to discover that they had racks and racks of tapes they couldn’t read anymore.  We keep gathering data, we keep making more databases.  They keep growing.  I know poor database design makes some of the databases I administer and manage daily get bigger – the growth chart of one of them looks like the flight path of a homesick angel, and it is seriously causing us some trouble.

At the moment, that particular app is under discussion, but the thought of wanting to keep all the data we get, in case we need it someday (words I heard growing up many times) – is a little overwhelming.

But how do we know when that someday is?

I know digital storage, like real storage, initially, is cheap – but does it count the machines that need to handle the backups? The people to maintain them? The backups themselves? The offsite storage? How much will it cost us to manage what we had, at the expense of what we have?

I don’t have all the answers yet, in fact, I’m still struggling with a lot of it myself, but this whole concept of “Big data” – it makes me wonder when, eventually, someone’s going to have the arduous task cleaning out the digital attic…

 
4 Comments

Posted by on January 9, 2013 in Uncategorized

 

Tags: , ,