I was thinking a poll but it seems some think that could lead to cheating. This is understandable, sadly. So maybe judges, with written guidelines on how to judge, a rubric on what qualities to look for and how much of the total score each quality makes up. How does that sound?
As for the no money bit, I really dont think it would get a good amount of participation otherwise. I think some reward would be nice and if not money than what? As for the capitalistic bit, how do you think people are encouraged to trade in this mod?
About not being able to judge a creative work on it's merits, how many awards ceremonies do we see a year for creative media. Books, movies, music, television, each of these has at least 4 or 5 major awards ceremonies every year.
Finally, as for encouraging new people to RP more perhaps a second category, best new RPer, and the person would have to have under so many threads or stories in the RP section to qualify.
Please comment on any and all of this and thanks for all the feedback so far.