The Jonathan Test: 12 Steps to Better DevOps

20 years after the original, this is my take on an updated "Joel Test"

Once upon a time, Joel Spolsky (co-founder of StackOverflow) wrote the Joel Test: 12 Steps to Better Code, which he describes as:

My own, highly irresponsible, sloppy test to rate the quality of a software team.

Here’s the test:

  1. Do you use source control?
  2. Can you make a build in one step?
  3. Do you make daily builds?
  4. Do you have a bug database?
  5. Do you fix bugs before writing new code?
  6. Do you have an up-to-date schedule?
  7. Do you have a spec?
  8. Do programmers have quiet working conditions?
  9. Do you use the best tools money can buy?
  10. Do you have testers?
  11. Do new candidates write code during their interview?
  12. Do you do hallway usability testing?

For a quite while, companies advertising jobs on StackOverflow Jobs could even include their self-scored “Joel Test score”. I don’t see it now, though, so I imagine that feature has been removed.

Many of the items on this list are timeless. Others not so much. In the 20+ years since this was written, the world has changed a lot, and some of these items are nearly laughable. Source control? In 2021, you may as well ask if a company has an Internet connection. Who doesn’t use source control? (Seriously, if you know someone who doesn’t use source control, let me know!)

So here’s my “highly irresponsible, sloppy test to rate the quality of a software team”, hereby dubbed The Jonathan Test:

  1. Do contributors merge their changes into mainline multiple times per day?
  2. Is all code tested thoroughly before merging to mainline?
  3. Is your project built and deployed automatically after every merge to mainline?
  4. Do you have a bug database?
  5. Do you fix bugs before writing new code?
  6. Do you have a prioritized backlog of features?
  7. Do you have a reasonably complete automated test suite?
  8. Does everyone have quiet working conditions?
  9. Do you use the best tools money can buy?
  10. Do you do hallway usability testing?
  11. Do developers control their work from start to finish, without a “hand-off” to operations, QA, or some other team?
  12. Can your developers work productively from an airplane?
Share this