Constructing a database benchmark (average load)

Our first new benchmark was custom written in .NET, using ADO.NET to connect to the database. The AnandTech Forums database, which is over 14GB in size at the time of the benchmark, was used as the source database. We'll dub this benchmark tool "SQL Loader" for the purposes of discussing what it does.

SQL Loader allows us to specify the following: an XML based workload file for the test, how long the test should run, and how many threads it should use with which to load the database. The XML workload file contains queries that we want executed against the database, and some random ID generator queries that populate a memory resident array with ID's to be used in conjunction with our workload queries. The purpose of using random ID's is to keep the test as real-world as possible by selecting random data. This test should give us a lot of room for growth, as the workload can be whatever we want in future tests.

Example workload:

< workload>

< !--- A SAMPLE WORKLOAD QUERY THAT RETURNS ALL THE FIELDS FROM THE PRIVATEMESSAGES TABLE RANDOMLY --->

<query>

<code>select * from privatemessages where imessageid = @pmessageid</code>

<type>read</type>

<randkey>pmessageid</randkey>

</query>

<!--- RANDOM ID GENERATOR FOR SELECTING RANDOM PRIVATE MESSAGES --->

<randomid>

<rcode>select imessageid,newid() as pmsgid from privatemessages order by pmsgid</rcode>

<name>pmessageid</name>

</randomid>

< /workload>


A screenshot of the SQL Loader

Test Information

The workload used for the test was based on every day use of the Forums, which are running FuseTalk. We took the most popular queries and put them in the workload. Functions, such as reading threads and messages, getting user information, inserting threads and messages, and reading private messages, were in the spotlight. Each iteration of the test was run for 10 minutes, with the first being from a cold boot. SQL was restarted in between each test that was run consecutively.

The importance of this test is that it is as real world as you can get; for us, the performance in this test directly influences what upgrade decisions we make for our own IT infrastructure.

Hyper Threading and The Tests AnandTech Forums Database Test Results
Comments Locked

58 Comments

View All Comments

  • skiboysteve - Tuesday, March 2, 2004 - link

    whats the deal with the slow ddr333 memory
  • Jason Clark - Tuesday, March 2, 2004 - link

    Cygni, if you have a peek at the 2 way web test we took shots of the monsters in that article..

    Cheers
  • SDA - Tuesday, March 2, 2004 - link

    Ouch. At first it doesn't look like Intel is pwnd (sure, they lose in the four-way benchmarks, but as Opteron vs. Xeon benches go this one's still pretty close)... then the cost of the Xeon is factored in, especially relative to the Opteron 24x (which is even cheaper and equally suitable for 2-way systems).

    Things might change with the FSB800 Xeons, though. The Opteron will still offer a lot more bang for the buck, but the Xeon might offer more bang then. It all depends on how well the 90nm Opterons scale, I guess.
  • Cygni - Tuesday, March 2, 2004 - link

    Very cool. So if your going 2 way for a DB, Xeon's look pretty good. I wouldnt have expected that.

    And can you guys snap some pics of the 4 way Xeon and Opteron boxes for us techno geeks that need a new wallpaper? ;)
  • Jason Clark - Tuesday, March 2, 2004 - link

    Numa was turned on.... 64Bit is just waiting on software. Although 64bit is a reality hardware wise, software still has a loooong way to go yet. We may do some 64 Bit .NET stuff at some point in the future as well.
  • SUOrangeman - Tuesday, March 2, 2004 - link

    Looks like DDR400 ECC+Reg is readily available to me as well ...

    http://www.crucial.com/store/listmodule.asp?module...

    -SUO
  • Boonesmi - Tuesday, March 2, 2004 - link

    christophergorge - ddr400 reg/ecc (ie pc3200) is very much available, i just put 2gb in a cad/cam opteron workstation a couple weeks ago
  • dweigert - Tuesday, March 2, 2004 - link

    I can't wait to see what happens when they do these again with NUMA turned on and a 64 bit OS. GamePC just released a set of astounding memory benchmarks,

    http://www.gamepc.com/labs/view_content.asp?id=opt...

    This ought to be some food for thought.
  • menads - Tuesday, March 2, 2004 - link

    To the people that said there is no DDR400 w ECC -that is pure BS! ECC/Reg DDR400 IS available for more than an year and the latest official Opteron SPEC submission of AMD is done with such memory!
  • ViRGE - Tuesday, March 2, 2004 - link

    Just a quick question for whoever knows the answer: what's the die size on the 4MB Xeon?

Log in

Don't have an account? Sign up now