What are the performance expectations for project 2?

First, note robustness and functionality are paramount. You must pass all basic tests (including test6 that tests full memory reclamation) to get any performance points at all.

We'll be using MSL 8, 16, 32; QS 8, 16, 32 (both large); NQueens 14 with 32 threads; and Fibonacci 41 with 32 threads.

For each benchmark, we'll be giving points like this:

  • 100% - good performance
  • 50% - mediocre performance
  • 0% - performance lacking

Based on the scoreboard and my own implementation(s), we'll be using the following cutoffs (in seconds):

TestGoodMediocreLackingSerial (estimated)
MSL/8<=99-30>3037
MSL/16<=77-30>3037
MSL/32<=66-30>3037
QS/8<=88-30>3036
QS/16<=66-30>3036
QS/32<=55-30>3036
NQ/32<=77-30>30124
Fib/32<=55-60>6015

Note that "Good" performance for all but Fib/32 is achievable with a single lock implementation.