<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Michael,<br class=""><div class=""><br class=""></div><div class="">If this field ever wants to reach a certain level of maturity, it has to start obeying some</div><div class="">grown-up rules, not running around like kinder-garden kids screaming at each other : </div><div class="">“my grand’ma is smaller then your grand’ma..”</div><div class=""><br class=""></div><div class="">That how it all looks to me from the outside now (e.g. NoSQL X scales to the level of the … universe… </div><div class="">and not a bit less..! :-)</div><div class=""><br class=""></div><div class="">And building reliable benchmarks, is one of the grown-up rules of an industry — if nothing else, but to</div><div class=""> understand, in a very unclear/nascent market, what is the usage pattern for which each product has been created </div><div class="">and optimized for. </div><div class=""><br class=""></div><div class="">I agree with you, building benchmarks is very difficult, indeed.</div><div class=""><br class=""></div><div class="">That’s why you need a REAL third party.</div><div class=""><br class=""></div><div class="">That’s why all the vendors AND their customers have to cooperate, etc.</div><div class=""><br class=""></div><div class="">That’s why you need some good will and transparency.</div><div class=""><br class=""></div><div class="">I hope one day they’ll be mature enough to do that.</div><div class=""><br class=""></div><div class="">Have a great weekend,</div><div class="">Dana</div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""><div class=""><div><blockquote type="cite" class=""><div class="">On Jun 13, 2015, at 2:27 AM, Michael Kay <<a href="mailto:mike@saxonica.com" class="">mike@saxonica.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div class="">All benchmarks are biased. They are less likely to be biased by business relationships than by skills imbalances. You can’t conduct an unbiased benchmark between two products unless you have the same skill and knowledge level in both, and that’s pretty difficult to achieve.</div><div class=""><br class=""></div><div class="">Michael Kay</div><div class="">Saxonica</div><div class=""><br class=""></div><br class=""><div class=""><blockquote type="cite" class=""><div class="">On 12 Jun 2015, at 22:24, daniela florescu <<a href="mailto:dflorescu@me.com" class="">dflorescu@me.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">And this is yet another public and very honest answer when I commented that a “third party” doing a benchmark<div class="">should not, in theory, have a business relationship with ANY of the vendors. Otherwise, not credible, so waste of time.</div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">==============================================</div><div class=""><br class=""></div><div class=""><span style="color: rgb(51, 51, 51); font-family: Helvetica, Arial, sans-serif; line-height: 14px; background-color: rgb(241, 243, 245);" class="">Daniela - the fact that we are partnered with MarkLogic and Couchbase (so that we can better serve our clients who use those platforms) has no bearing on our ability to conduct benchmarks with independence.</span></div><div class=""><span style="color: rgb(51, 51, 51); font-family: Helvetica, Arial, sans-serif; line-height: 14px; background-color: rgb(241, 243, 245);" class=""><br class=""></span></div><div class=""><span style="color: rgb(51, 51, 51); font-family: Helvetica, Arial, sans-serif; line-height: 14px; background-color: rgb(241, 243, 245);" class=""><br class=""></span></div><div class=""><span style="color: rgb(51, 51, 51); font-family: Helvetica, Arial, sans-serif; line-height: 14px; background-color: rgb(241, 243, 245);" class="">==========</span></div><div class=""><span style="color: rgb(51, 51, 51); font-family: Helvetica, Arial, sans-serif; line-height: 14px; background-color: rgb(241, 243, 245);" class=""><br class=""></span></div><div class=""><span style="color: rgb(51, 51, 51); font-family: Helvetica, Arial, sans-serif; line-height: 14px; background-color: rgb(241, 243, 245);" class=""><br class=""></span></div><div class=""><span style="background-color: rgb(241, 243, 245);" class=""><font color="#333333" face="Helvetica, Arial, sans-serif" class=""><span style="line-height: 14px;" class="">I guess it’s not clear to everyone what a “third party benchmark” usually means in Computer Science :-))</span></font></span></div><div class=""><span style="background-color: rgb(241, 243, 245);" class=""><font color="#333333" face="Helvetica, Arial, sans-serif" class=""><span style="line-height: 14px;" class=""><br class=""></span></font></span></div><div class=""><span style="background-color: rgb(241, 243, 245);" class=""><font color="#333333" face="Helvetica, Arial, sans-serif" class=""><span style="line-height: 14px;" class=""><br class=""></span></font></span></div><div class=""><font color="#333333" face="Helvetica, Arial, sans-serif" class=""><span style="line-height: 14px; background-color: rgb(241, 243, 245);" class="">Have a great weekend everyone, best</span></font></div><div class=""><font color="#333333" face="Helvetica, Arial, sans-serif" class=""><span style="line-height: 14px; background-color: rgb(241, 243, 245);" class="">Dana</span></font></div></div>_______________________________________________<br class=""><a href="mailto:talk@x-query.com" class="">talk@x-query.com</a><br class=""><a href="http://x-query.com/mailman/listinfo/talk" class="">http://x-query.com/mailman/listinfo/talk</a></div></blockquote></div><br class=""></div></div></blockquote></div><br class=""></div></div></body></html>