David G. Wiseman

Simmons' Laws of System Administration

             Simmons' Laws of System Administration

The Definition:

  System Administration is the combination of system support and user
  support.


The First Law of System Administration:

  Any rule can be modified by the application of power and policy.  By
  contrast, rules always are subordinate to laws.


The Network Paradox:

  System support is a subset of network support.  Network support is
  a subset of system support.


The Laws Of Unanticipated Support Cost:

  1. It will always cost more to support a thing than the vendor told you.

  2. It will usually cost more to support a thing than to buy it.

  3. Sometimes it costs 10x as much to support a thing as it did to buy it.

  4. Refusing to support something often results in the thing being unusable.

  5. Once it's installed, supporting a thing is sometimes cheaper than
     not supporting it.

  6. Before buying, make sure you're committed to support.  But see rule 1.



The Division Between System Support and User Support:

  There's a difference between system support and user support.  There
  may be overlap in the two positions; sometimes both are done by the
  same person.  But the two tasks are distinct, and sometimes have
  conflicting goals.


The Law Of Distributed Talent:

  Great system support people often make lousy user support people 
  and vice versa.


The Paradox Of Dual Abilities:

  The person good enough to do both system support and user support
  will usually be hired away by a shop where the combined tasks are
  too large for a single person.


On Complexity And Customization:

  Application-to-application differences confuse everyone, especially
  users and support staff.  Ditto UNIX-to-UNIX differences, etc.  By
  contrast, complete consistency completely stifles improvement.

  At any given site for any given application or feature, there's 
  someone who knows more about it than the support staff.  Finding
  that person is the first step to take to diagnose any given problem.

  Time to diagnose and time to fix are fix are completely unrelated.
  Sometimes one approaches zero while the other approaches infinity.
  This is especially hard to deal with when the diagnostic person and
  the fix person are not the same.

  One person's improved feature is another person's gratuitous change.

  Users want applications and systems they can customize.

  One user's customization is another user's gratuitous change.


The Laws Of The Cost Of Customization:

  The cost of customization is complexity.  The cost of complexity is
  increased difficulty in administration and user support.  The cost
  of increased difficulty in administration and user support is either
  lower quality of administration and user support, increased support
  staff, or both.  Therefore increased customization means increased cost
  or lower quality of support or both.


The Paradox Of Unused Customization:

  It doesn't matter whether customization has actually been done.  The
  mere fact that it's possible means you must check for it, thereby
  increasing the cost of problem diagnosis.


Smallwood's Law (Simmons' paraphrase):

  They're not users, they're clients.   -- Kevin Smallwood


Users Are Human:

  The user who says "Can X be done?" is usually really asking "Would
  someone please do X?".  Make sure you answer both questions.

  It's human to blame problems on outside causes.  By contrast, an
  outsider will always suspect the insider as the cause.

  The user who says "I didn't change anything" isn't always lying.
  Sometimes they're just ignorant or forgetful.

  It's more important for users to do their job than to answer the
  needs of admins.  Unless of course their job is to answer that need.


Admins Are Human:

  For every statement in "Users Are Human", change "user" to "admin"
  and vice-versa.


The "You Broke It" Principle:

  Cockpit error is the most common cause of problems.  Everybody is
  a pilot.


Support Is Overhead:

  One way of cutting costs without cutting development staff is by
  cutting overhead.  System administration and user support are overhead.

  User and system admin training are overhead.  Not having them increases
  overhead.  Go figure.


The Joy Of Being A Contract System Administrator:

  "Sure, we can do that.  Here's what it'll cost you."


His Site Isn't Your Site:

  The situation at your site doesn't make you qualified to judge the
  situation at another site, and vice-versa.

  Just because someone else's support staff does it mean your staff
  can do it. (This statement is subtler than it looks.)


The Rules of Policy and Power:

 1. System administration is whatever the boss tells the admins it is.

 2. Users will bypass admins to get the boss to tell the admins something
    different.  That's their right.

 3. Most system admins live in a policy vacuum.  This can be good or
    bad:

      Corollary 1:  Power expands to fill a vacuum.  That thing which
        expands most easily is a gas.

      Corollary 2:  Anything that quickly expanded to fill a vacuum is
        easily displaced by a solid.

      Corollary 3:  A rapidly moving solid will hurt you if you're in
        its way.

 4. The person who does your job review makes the rules.  The good
    admins always follow those rules.  See Rule 1 and the First Law.

 The Summary:
    Be careful what you do in that vacuum.  Nobody appointed you god.
    However, you can always be dis-appointed.


The Laws Of System And Network Growth:

  You can always incrementally add one more.

  Sometimes the straw breaks the camels back.  More often, the
  camel just goes slower and slower.

  The difficulty of support does not grow linearly with the size of
  the site.

  Eventually your site outstrips your methods, and you must bite the
  bullet and move to new methods.

    Corollary: Nobody bites the bullet until there's not enough time to 
      do the existing work.  At that point there's not enough time to
      make the changes.

  Adding a new kind of computer, operating system, application,
  peripheral, etc, has a much higher administrative cost than adding
  one more of what you've already got.

    Corollary 1: If you buy one, you may as well buy ten.

    Corollary 2: If you buy ten, you may as well buy eleven and keep
      one for spare parts.

Ha, ha, ha. Take me back to [ the alphabetic list ] [ the date-ordered list ].