Do you mean this statement:
"We found no substantiation for the ``common knowledge'' that early Mach3.0-based Unix single-server implementations achieved a performance penalty of only 10% compared to bare Unix on the same hardware. For newer hardware, [9] reports penalties of about 50%." (related work chapter of "The Performance of micro-Kernel-Based Systems", http://os.inf.tu-dresden.de/pubs/sosp97/)
Yes, that is what I was talking about.
The Problem was that reviewers of the papers pointed out that Mach-based Unix-single-servers have a penalty of 10% without providing any reference to a conference paper. So we asked around, contacted people who had worked on Mach, but nobody was able to confirm the 10% penalty. Therefore we added this statement to the related work section.
I read reports with even lower than 10% penalty results.
We would have been happy to provide anyone with a copy of our test environment if anybody would have asked for it.
I am asking for it now.
And it isn't the same logic. The problem was that some people said, that Mach based Unix-Servers had only 10% performance penalty without providing us with any performance numbers or references to papers. In contrast we compared two micro kernel based implementations of Linux running on the same hardware and published the results.
For results to be valid, they need to be consistant (reproducable)
Farid said that he at some point compiled (more than once) mklinux for x86. Perhaps, would be worth doing it again, otherwise often seen claim that l4 is better microkernel, is more like rant.
Does that mean, you consider the published results as invalid? That we published numbers we didn't measure? At least the cited paper of M. Condict et al confirms our aim benchmark results.
I did not say results are invalid. All I was asking for - binaries to be able to reproduce results. If results are in fact reproducable they are valid. I have no doubts that results MAY BE valid. However, I think that not all conclusions of that paper are valid. If I get a chance to validate results, I would be happy to write full report that would include benchmark results, analisys and conclusion that I will come to.
Hope I was able to answer some of your questions.
You probably gave me complete answer, I am just having hard time understanding it. Could I today (or in a near future) get x86 mklinux binaries in order to validate your results?
Thank you, IS.