I attended a two-hour presentation by Dr. Peter Tippett of Verizon Business's Cybertrust group at the Grant Hyatt Hotel in New York City (nice!) today.
Dr. Tippett is on tour to let the world know about the data breach investigations report that his team put together and published earlier this year. At the very least, the presentation was entertaining, but there were even some interesting bits here and there.
Dr. Tippett is a scientist.
Assume that someone says: We need to patch one per day.
In Tippett's view, that is a hypothesis and a hypothesis needs to be tested to determine its validity. These tests can be performed either by analyzing data, or by conducting a controlled experiment.
In
many cases, Tippett claims, testing a hypothesis (we need more of
product X) will show that the marginal benefits of deploying more (of
the same) technology does not outweigh the marginal costs. For example,
patching once a day instead of once a month might be much more
expensive than the costs that are averted by it. If that hypothesis is
proven to be true, patching once per month instead of once per day
would be a colossal waste of resources. The costs would not outweight
the benefits.
In an ideal risk-assessment scenario, sufficient data is available to estimate such a risk (defined as: likelihood ∙ impact) before a decision must be made, rather than in hindsight after a solution has been implemented.
Most
organization lack the body of experience to be able to compute these
risks at all, or at least in a way that is statistically significant
enough to be usable. Most organizations are unwilling (or unable) to
design and execute an experiment and draw conclusions based on the
outcome of those experiments.
These two observations are the death-blow for a formal risk management approach to information security.
Until
sufficient reliable data becomes available (at reasonable costs),
organizations will never be able to build their information security
programs based on a formal risk management approach.
Yes! I liked your post, wish I could have been there.
"Most organization lack the body of experience to be able to compute these risks at all, or at least in a way that is statistically significant enough to be usable."
Depends on what we define as "most" organizations. I think larger organizations may have quite a bit of useful prior information. SMB concerns, not so much.
"Most organizations are unwilling (or unable) to design and execute an experiment and draw conclusions based on the outcome of those experiments. "
Possibly. There is a pre-requisite of having a useful model for risk that most people simply don't have access to.