Often the lesson is: "If it ain't broke, don't fix it."

Many of us were not looking for a new Microsoft Operating system – I certainly wasn’t. But Vista is here. However, Microsoft has changed its implementation of the CIFS protocol. Vista is incompatible with all of the third-party NASes that we have tested against, from NetGear home systems to NetApp Filers.

I can’t imagine why Microsoft would do such a thing, but a lot of people who were open to Vista have since rolled back rather than change all their NASes. As of this writing, (April 2007), I have no information from Microsoft or any of the NAS vendors concerning a solution to this problem or a timeframe for releasing one.

Amazing! I suggest we all boycott Microsoft.

Tuesday, May 01, 2007 10:02:34 AM (Eastern Daylight Time, UTC-04:00)      Comments [2]  News

Last year Compliance was everyone's hot topic. It's a year later, the noise has died down, does this mean the problem is solved? Not hardly.

We spend most of our days talking to large companies about their storage issues and strategies. Over the course of time, the subject of Compliance generally comes up. What's been done over the last year? Not much. Want to know why? There are at least two reasons for what appears to be a lack of interest in addressing compliance issues - other than in the Banking community, of course.

The first and most important issue is the lack of organization in most people's data. The mere task of figuring out where all the stuff that's supposed to subject to compliance actually is becomes a daunting task in and of itself.

The second issue is what you might expect - cost. Once you find the data you need, you have to rearchitect your systems to bring your handling of the data into compliance. And this expense gives no value to the user community. It is pure cost. If you were in charge, where would you spend your time and money? Not here.

As time goes on and systems get rebuilt, companies will come closer and closer to being in compliance. But today the average company isn't even close.

Wednesday, November 01, 2006 11:52:50 AM (Eastern Daylight Time, UTC-04:00)      Comments [0]  Management | Storage Management

What was it he said? Ah, yes... “Those who refuse to learn from the lessons of history are doomed to repeat them.” Let's look at some history. IBM created a PC with a proprietary architecture. Others created an IBM-compatible PC that was an open platform. Which one is around today? Apple created a brilliant PC device with a closed architecture and a proprietary operating system. Microsoft created an open OS platform and actively recruited developers. Which one owns the market today?

It has been clear for years (going back to the heyday of IBM) that an open platform and the courting of third-party developers wins the market. In the end, the third parties taken together have more money, get to market quicker and have more ideas than any one company could possibly have, regardless of how rich they happen to be.

Network Appliance and EMC are battling tooth and nail to dominate the storage market. Why then do they both have closed platforms and shun third-party developers? (The one exception being the Centera folks, who seem to have the right perspective.) It certainly seems to me that neither EMC nor NetApp live in a world where Santayana's Rule fails to apply. My bet is that the first of these guys who figures out that if their hardware and infrastructure underly every third-party storage application, and they actually support ISVs, they will rule the Industry. What are they waiting for... someone else to create an open platform and take the market away from them? NIH (not invented here) never wins. It has been tested for years with the same result every time.

Wednesday, October 25, 2006 9:29:47 AM (Eastern Daylight Time, UTC-04:00)      Comments [0]  Backa's Laws | Management | Storage Management

As the demand for storage grows and technology progresses, the economics of owning storage change. Not all that long ago we wanted to write as much as we could to tape, because tape was cheap and on-line storage was expensive. Now many people think that on-line storage is infinite (almost) and free (not at all, but we'll talk more about this later). In today's economics, storing your data on tape is one of the most expensive things you can do. As a result, many of the people I talk to have abandoned tape altogether for on-line archives. Not only are the on-line archives cheaper, but they are more flexible and much easier to search. But this doesn't mean you can manage them like tape...

With tape the deal was write it and forget it. Tapes in a mountain somewhere generally receive no maintenance (not that this is the right thing to do). On-line storage, on the other hand, needs maintenance. As you write more, you need to provision more. And if you don't organize it well, as you write more, specific things become harder and harder to find.

The bottom line is that this is a real paradigm shift. It is not as simple as substituting a disc for a tape. You have to manage differently as well. It's time to change your thinking as well as your media...

Friday, October 13, 2006 6:18:50 PM (Eastern Daylight Time, UTC-04:00)      Comments [0]  Storage Management

Storage is just bits on a disk, right? What's complicated about this? A lot. Storage is a surprisingly complex thing to manage.

I tell you that a volume is 95% full. What does this mean? I tell you that another volume is 70% full. What does this mean? Maybe not what you think...

A volume that is 95% full is unhealthy. There is no getting around this. The algorithms that allocate space on volumes start breaking down after 85% of the space is taken. Fragmentation begins to increase dramatically, and there is not enough free space to reorg the data in place. In other words, the volume is unhealthy. The reaction of most people to this situation is to say that this volume demands immediate attention. Seeing only 5% free space, many a wise storage manager would declare an emergency.

But suppose I also tell you that the volume's size has been stable over time. It neither grows nor shrinks by more than 1%. Now there is no immediate emergency. The volume in question is unhealthy, but not very risky. Should you apply your efforts here, or do something else?

Our other volume is 70% full. At 70%, we know this volume is healthy. But now suppose I tell you that the space used is growing by 10% to 15% a month... This volume is certain to run to be completely out of space in less than 3 months. Sounds pretty risky to me. I might put my attention here and let the other volume slide for a while.

The point of the story is that things - storage management in particular - are rarely one-dimensional. If your model for storage management is over simplified, you might make serious mistakes, or you might be constantly chasing your tail never knowing what is truly important. As you plan to manage your storage cost-effectively, you need more information than just performance and free space. If all you know is performance and free space, your only solution to any issue is add more hardware. Hardware vendors love this solution, but your senior management doesn't. Nor should you.

Tuesday, October 10, 2006 9:52:14 AM (Eastern Daylight Time, UTC-04:00)      Comments [0]  Storage Management

Many companies have dropped tape in favor of on-line archiving. This is certainly a good economic strategy and a requirement in some cases. But what's the end-game? You can storage an infinity of data on tapes and throw them in a mountain somewhere (data waste to go along with nuclear waste) at a low cost. (It's writing the tape that is expensive.) But the bits that go to the on-line archive simply require more and more storage... Who is doing the math? This is an exponential curve. Remember, for most organizations, the need for storage is doubling every 12 to 18 months (Gartner Group). This year you added 500 terabytes... Next year you don't add 500 terabytes, you add a petabyte.

How many doublings does it take before the cost of storage exceeds the company's annual revenue? I've yet to have anyone give me their plan for 5 years out. What's yours?

Tuesday, October 03, 2006 10:21:03 AM (Eastern Daylight Time, UTC-04:00)      Comments [0]  Observations | Storage Management

We've heard it over and over again. Gartner Group tells us that 25% to 40% of what's on our storage is junk - expired, unneeded, inappropriate. What are we doing about it? Mostly nothing. However, as storage expands and companies move to tiered storage, the cost just grows and grows. First we pay for it on primary storage. Then we pay to migrate it to secondary storage - and the space to keep it there. Finally we pay to move the junk to archive. So we don't just pay for it once, we pay for it 4 or 5 times over.

Given this, the value of getting rid of even a fraction of the junk isn't a few terabytes, it's a few terabytes times 4 or times 5. This is real money.

Sunday, October 01, 2006 4:51:29 PM (Eastern Daylight Time, UTC-04:00)      Comments [0]  Observations | Storage Management

Recently in London I was talking to the CIO of one of the larger Brokerage firms. He noted that they currently have 750 terabytes of storage and that he expects by this time next year to have twice as much 1.5 petabytes.

How do you backup 1 petabyte of storage? The answer is: you don’t. At least not in any conventional way… there is no technology on the market that can write a petabyte of storage to off-line media in any reasonable amount of time. Size changes everything.

Now if you’re a Global 2000 multi-national like this brokerage firm, you may be able to skip backups altogether. (Backups, not archiving) If you have a world-wide distributed database, say in London, New York, and LA, and all of London, New York, and LA have ceased to exist, you probably don’t care very much about those very safe tapes in Iron Mountain… There would be no place to restore them to.

This is a turning point in our industry. Conventional backups must now give way to on-line backups, tiered storage and archiving. Don’t go buying stock in any of the tape companies…

Tuesday, February 14, 2006 4:06:58 PM (Eastern Standard Time, UTC-05:00)      Comments [0]  Observations | Storage Management

We all probably remember the parable about the emperor who had no clothes, riding around naked while his whole kingdom pretended that he was wearing the most beautiful set of robes... Today we have about as much data security as he had clothes. Early last year Mastercard admitted that a backup tape, written in clear text, with about 2 million customer records was lost. Last month (December '05), Marriott revealed that a tape with a couple hundred thousand customer records is missing.

Who among us thinks that these are isolated, once in a life time events? Not me! My organization has lost tapes before. Humans make mistakes. You have to assume anything that gets handled by humans can be lost or damaged. And the more humans that handle it, the more likely it is to be lost or damaged.

It's time for the industry to get it. There is little possibility of real data security until all data is encrypted. Until then, we're all just pretending...

Thursday, January 12, 2006 12:12:44 PM (Eastern Standard Time, UTC-05:00)      Comments [0]  Management | Storage Management