It is time for me to give back.
Dealing with performance benchmarks has occupied a fair share of my life from my early days in the computer world in the mid ’80s.
In the beginning it was mostly reading, with just a bit of writing, that today I would be ashamed of, in one of the early Italian BBS “newspaper” called “Corriere Telematico“.
At the time I could have never imagined that benchmarks would have a very large role in my career to the point that for about 8 years they even defined my job title.
Now, as I my transition into a new role is almost complete, it feels like the right time to write something about benchmarks that can help many people in the industry.
I recall reading in one of the paper magazines of my early days something along the lines of “benchmarks don’t lie, but liars do use benchmarks”. I believe it was on MCmicrocomputer but I can’t bet on this.
This bleak statement about benchmarks was true 30+ years ago and it’s still true now, but we should not throw the good away together with the bad: proper benchmarks were and still are useful tools for individuals and organizations alike. It’s all about defining “proper” correctly in each context.
For a while, given the scarcity of published material on the subject, I was thinking of putting together a book, with the help of a friend of mine.
I fear I will not be able to put in all the time needed to complete it in a reasonable time frame and for this reason I decided to blog on the subject instead.
In the coming weeks (or months, I don’t know yet how this will work) I will share what I learned in many years as a source for anyone wanting to get closer to the holy grail of the “proper benchmark”.
I will be vendor and technology neutral, covering both the business and the technical sides.
Your feedback will be key in shaping how this will move forward.
In the next post I’ll share the target table of content of this series of posts.
Hi Marco! I’m glad to see you as a blogger! Added to the bookmarks!
Pingback: Performance benchmarks for the manager | marcoullasci
Don’t forget this baseline: https://www.teradata.com/Blogs/Can-We-Trust-Hadoop-Benchmarks You know this stuff in your belly. Benchmarks are outstanding tools if not misused.
I always trust Dilbert and I fully agree that misuse is the worst thing that can be done with a tool.
In my next post (coming soon) you will see that the subject “what-to-compare-with” will be part of the candidate table of content with more than one entry.
Pingback: Performance benchmarks for the operational people | marcoullasci