Faction Reviews and Ratings.... Submit now!

[ultifd]

Hmm, I think I can at least agree on the "8" for models. Others too...definitely more powerful then magitech.
I still somehow think it is gold...probably causes I compare it to other factions.

Anyways, so we just post our reviews here? err...

[John.d.h]

Well, at this point I think we're just kinda getting a feel for the rating system and seeing how fair it is.  If somebody were to review a mod that sucked and it got a Silver, and reviewed another mod that was great and only got a Bronze, we'd see that the system was flawed and needed to be fixed.  If we get some reviews and they all seem to fall in line with what they should be, then the system works.  Personally, I think Silver is fitting for Woodsmen.  Overall, it's a good mod, and it really stands out in a couple areas, but it could still use some polish in a few areas.  Plus, it's not quite done.

[ElimiNator]

How about this, stone and wood mach with glest so I think they would be good.

Criteria for ratings:

0-5% New Models
0-5% Good Models
0-5% New Textures
0-5% Good Textures
0-5% New Animations
0-5% Good Animations
0-5% New Sounds
0-5% Good Sounds
0-5% New Music
0-5% Good Music
0-5% New Icons
0-5% Good Icons
0-10% AI
0-5% New Particles
0-5% Good Particles
0-10% Balance
0-10% Misc
=0-100% overall rating

platinum:  95 pt
Gold:       75 pt
Silver:     55 pt
Bronze:    35 pt
Stone:     25 pt
wood       0 pt

What do you think?

[wyvern]

Wow thats good and I mostly agree with your judging

[ultifd]

Hmm, I know that John. Wasn't getting the feel of it...though. I kinda do now.

[wyvern]

Will addons be judged in this because for example GW pack is a mod/addon to original magitech with an extra faction, so obviously it will rate low because many of the units won't even be new since the were already there 

[John.d.h]

How about this, stone and wood mach with glest so I think they would be good.

I don't really care that much about what we call them.

Criteria for ratings:

0-5% New Models
0-5% Good Models
0-5% New Textures
0-5% Good Textures
0-5% New Animations
0-5% Good Animations
0-5% New Sounds
0-5% Good Sounds
0-5% New Music
0-5% Good Music
0-5% New Icons
0-5% Good Icons
0-10% AI
0-5% New Particles
0-5% Good Particles
0-10% Balance
0-10% Misc
=0-100% overall rating

I like this part, and it's what I used for the Woodsmen review.  I think it worked pretty well.

platinum:  95 pt
Gold:       75 pt
Silver:     55 pt
Bronze:    35 pt
Stone:     25 pt
wood       0 pt

What do you think?

I think it's kinda hard to tell where the cutoff points for each group should be until we get some more reviews.  For example, if we get a rating for a mod that probably deserves to be Bronze, then that number would give us a general estimate of what a Bronze rating should be.  Does that make sense?

Will addons be judged in this because for example GW pack is a mod/addon to original magitech with an extra faction, so obviously it will rate low because many of the units won't even be new since the were already there 

*shrug*

[Omega]

I don't really like that system. Too many rating catigories...

Nothing wrong with the original system.

[John.d.h]

I don't really like that system. Too many rating catigories...

Nothing wrong with the original system.

You can think of it as the same 10 categories, but half the points come from originality and half come from quality.  Or do you mean too many grades (Gold, Silver, etc.)?

[ChupaReaper]

ChupaReaper, to my knowledge your mod doesn't work for anybody(mipmaps...........strange oblivious crashes......).......
Do you really want a review?

Odd, it should run fine, I've ran it on some average spec laptops even my little brothers laptop which has 512mb ram and and on board intel chipset gfx which ran slow but definitely playable.

[ElimiNator]

I think it's kinda hard to tell where the cutoff points for each group should be until we get some more reviews.  For example, if we get a rating for a mod that probably deserves to be Bronze, then that number would give us a general estimate of what a Bronze rating should be.  Does that make sense?

Yes, It will vary if we think it should.

I don't really like that system. Too many rating catigories...

Nothing wrong with the original system.

You mean like wood? I agree but every one else said they want 6 categories.

[ElimiNator]

OK, if you don't answer I will do what I want...

[Omega]

I mean, the old rating system was better. 10% for just models in general and let the rater take the rest into hand is a good idea.

To provoke others to rate, here's my rating of Roman 9.11 (might be an old version... IDK. Seems complete, so I assume so).

7% Models
8% Textures
8%  Animations
9% Sounds
10% Music
8% Icons
9% AI
7% Particles (not many of these)
8.5% Balance
8% Miscellaneous (units feel somewhat similar, but is plenty of fun)
=82.5

Assuming:

platinum:  95 pt
Gold:       75 pt
Silver:     55 pt
Bronze:    35 pt
Stone:     25 pt
wood       0 pt

Then, GOLD!

However, these ratings, as John said, should be tailored to our mods. In short, rate most of the things, some good, some bad, and then we can fit the catigories to the ratings, not the other way around.

[John.d.h]

Hmm... this is what I was worried about.

http://en.wikipedia.org/wiki/Inter-rater_reliability

If some of us doing the reviewing hold modders to high standards (like me), some hold them to looser but still reasonable standards (like Arch), and others set the bar so low a Corgi could jump over it (like Omega), then the whole system is screwed.  I mean, look at it so far.  Romans better than Woodsmen?  That can't be.  I think we need either 1.) to have the same people reviewing each mod (a "review panel", if you will) or 2.) we need consistent standards.

[wciow]

Yes, this is why we need a neutral standard to judge by. IMO reskinning or slightly altering the original magitech models does not deserve gold and would only deserve silver if the rest of the mod is excellent quality.

A recent example is Chupa's Malevolent Rising. He has obviously put in lots of work and the mod looks fantastic, but 90% of the artistic content is simply stolen from commercial games!! This would be a silver at very best.

[ChupaReaper]

Yes, this is why we need a neutral standard to judge by. IMO reskinning or slightly altering the original magitech models does not deserve gold and would only deserve silver if the rest of the mod is excellent quality.

A recent example is Chupa's Malevolent Rising. He has obviously put in lots of work and the mod looks fantastic, but 90% of the artistic content is simply stolen from commercial games!! This would be a silver at very best.

Not as high as 90%, around 60% of my first factions none-buildings units are from other games and these have gone through some retexturing, especially some of them have been completely retextured and a lot of reanimation saying as the game most of them are from uses rag dolls so the death animations are my own, same goes for the sounds, a lot of sound editing. So around half is not my work if you include all the xml balancing, the icons I've made, etc. My next faction is going to contain less commercial work too.

[ElimiNator]

How about this, stone and wood mach with glest so I think they would be good.

I don't really care that much about what we call them.

Criteria for ratings:

0-5% New Models
0-5% Good Models
0-5% New Textures
0-5% Good Textures
0-5% New Animations
0-5% Good Animations
0-5% New Sounds
0-5% Good Sounds
0-5% New Music
0-5% Good Music
0-5% New Icons
0-5% Good Icons
0-10% AI
0-5% New Particles
0-5% Good Particles
0-10% Balance
0-10% Misc
=0-100% overall rating

I like this part, and it's what I used for the Woodsmen review.  I think it worked pretty well.

platinum:  95 pt
Gold:       75 pt
Silver:     55 pt
Bronze:    35 pt
Stone:     25 pt
wood       0 pt

What do you think?

I think it's kinda hard to tell where the cutoff points for each group should be until we get some more reviews.  For example, if we get a rating for a mod that probably deserves to be Bronze, then that number would give us a general estimate of what a Bronze rating should be.  Does that make sense?

Will addons be judged in this because for example GW pack is a mod/addon to original magitech with an extra faction, so obviously it will rate low because many of the units won't even be new since the were already there 

*shrug*

I think we should use this one, and you ether give it 0 or 5. Then it leaves no room or opinions.

[John.d.h]

I think we should use this one, and you ether give it 0 or 5. Then it leaves no room or opinions.

Sure it does.  It just doesn't leave any room for being useful.

[ElimiNator]

What do you mean?

[John.d.h]

I mean it's terribly imprecise, to the point of not being helpful.

[ElimiNator]

How do you suggest fixing it?

[John.d.h]

How do you suggest fixing it?

I think we need either 1.) to have the same people reviewing each mod (a "review panel", if you will) or 2.) we need consistent standards.

[Gabbe]

I think john.d.h is the only one actually reviewing good, archmage didn`t go so hard on romans, or has lower standards, i will say that we only have john.d.h review the factions, then others can input if they think something is wrong.

[wyvern]

I think john.d.h is the only one actually reviewing good, archmage didn`t go so hard on romans, or has lower standards, i will say that we only have john.d.h review the factions, then others can input if they think something is wrong.

I second that thought, how many of you think GW-pack expansions will be platinum

[Gabbe]

I think my amazons will be a worthy candidate, though noone of you can tell, I have to push the release a bit, the sounds are awfull.