What are the performance expectations for project 2?
We'll be using MSL 8, 16, 32; QS 8, 16, 32 (both large); NQueens 14 with 32 threads; and Fibonacci 41 with 32 threads.
For each benchmark, we'll be giving points like this:
- 100% - good performance
- 50% - mediocre performance
- 0% - performance lacking
Based on the scoreboard and my own implementation(s), we'll be using the following cutoffs (in seconds):
| Test | Good | Mediocre | Lacking | Serial (estimated) |
|---|---|---|---|---|
| MSL/8 | <12 | 12-30 | >30 | 48 |
| MSL/16 | <8 | 8-30 | >30 | 48 |
| MSL/32 | <6.5 | 6.5-30 | >30 | 48 |
| QS/8 | <9 | 9-30 | >30 | 39 |
| QS/16 | <6.5 | 6.5-30 | >30 | 39 |
| QS/32 | <5.5 | 5.5-30 | >30 | 39 |
| NQ/32 | <7 | 7-60 | >60 | 127 |
| Fib/32 | <4 | 4-20 | >20 | 21 |
Note that "Good" performance for all but Fib/32 and perhaps NQ/32 is achievable even with a single lock implementation.