Page Index Toggle Pages: [1] 2  Send TopicPrint
Locked Topic [CLOSED] Preventing Biases (Read 8389 times)
Michael
God Member
*****
Offline


Recursion \Re*cur"sion\,
n. - See recursion.

Posts: 1003
Joined: Oct 23rd, 2001
Gender: Male
[CLOSED] Preventing Biases
Feb 16th, 2002 at 7:40pm
 
This issue is closed and resolved.
3 testers will review each mod before it is entered as "approved." Reviewers may not review mods that they themselves submitted.


Quote:
--------------------------------------------------------------------------------

Title: Re: Current Development
Post by KyleYankan on Today at 2:20pm
--------------------------------------------------------------------------------

Nice work mike!

@Mike:
The olypic thing is using an example. t's not the same of course, but they have a good diea, to use al lthe judges points added together.

How will it take 3 time longer, if everryone does it at once. I beleive chances are likely that 3 testers wil lbe on in the same 30 min period.

Also about being biased, wouldn;t it be better to eliminate it from the start? Why wait till several people have it downlaoded and installed just to re-evaluate it, and have several people un-install it?

--------------------------------------------------------------------------------

Title: Re: Current Development
Post by krikkert on Today at 2:36pm
--------------------------------------------------------------------------------

Yeah, if we start this mod testing, most people would probably uninstall if we rejected the mod, or wait until we approved to install it...

--------------------------------------------------------------------------------



I have to admit, you've got a point, Kyle. But I still don't like the idea of having to wait until three people go through each mod. It *will* take three times as long because instead of the extra people testing other mods, they'll be re-testing a mod that's already been tested.

Also, you know this is gonna wreak hell with the current database/scripting ideas, right? Just have to make everything difficult, eh? Tongue
« Last Edit: Mar 17th, 2002 at 5:19pm by Michael »  

~ Michael ~
-------------
The MikeCam
A truly wise man never plays leapfrog with a unicorn.
Back to top
IP Logged
 
Shoeb Omar
God Member
*****
Offline


Mod Writer

Posts: 5665
Location: San Diego
Joined: Jun 29th, 2001
Gender: Male
Re: Preventing Biases
Reply #1 - Feb 16th, 2002 at 7:48pm
 
all i think is that one guy should lok at scores and see if they look fair Smiley
  

YaBB SP2 BETA!
Now taking pay jobs in PHP or Perl.  Contact me for details.
Back to top
IP Logged
 
KyleYankan
Senior Member
****
Offline


The KyleYCam!

Posts: 341
Joined: Dec 25th, 2001
Gender: Male
Re: Preventing Biases
Reply #2 - Feb 16th, 2002 at 7:57pm
 
How about 2 teams?
it would go like this:

(IMMEDIATE) 1 person would test the mod when it is submitted, and if passes approval, it goes onto the next stage, and is posted for the community, with a warning on it that it is still under scrutiny.

(LATER) Have a second mod team come in and look the mod over and come up with an average score, maybe 3 or 5 people. This could take up to a day or two. The Mod will then be re-posted on a different list and removed from the IMMEDIATE list, with the new ratings...
  


//-KyleY-\\

Steal his bandwidth! He doesn't want it!
Back to top
IP Logged
 
Shoeb Omar
God Member
*****
Offline


Mod Writer

Posts: 5665
Location: San Diego
Joined: Jun 29th, 2001
Gender: Male
Re: Preventing Biases
Reply #3 - Feb 16th, 2002 at 8:07pm
 
(from a coder'spoint of view)

hell no! Shocked
  

YaBB SP2 BETA!
Now taking pay jobs in PHP or Perl.  Contact me for details.
Back to top
IP Logged
 
KyleYankan
Senior Member
****
Offline


The KyleYCam!

Posts: 341
Joined: Dec 25th, 2001
Gender: Male
Re: Preventing Biases
Reply #4 - Feb 16th, 2002 at 8:12pm
 
Couldn;t we just add another cell in mike's table and call it "Priority"? priority lvl 1, would be IMMMEDIATE has t review it, lvl 2 means LATER has to review it, and lvl 3 mean it is open for the public?
  


//-KyleY-\\

Steal his bandwidth! He doesn't want it!
Back to top
IP Logged
 
Administrator
Forum Administrator
*****
Offline


Yummm

Posts: 7
Location: Modders Rile
Joined: Oct 7th, 2014
Gender: Male
Re: Preventing Biases
Reply #5 - Feb 16th, 2002 at 9:56pm
 
hm I guess 85% of the users wouldn't get that system Undecided

Keep it as simple as possible!
  

The Administrator.
Back to top
WWW  
IP Logged
 
Christer Alexander
God Member
*****
Offline


Make my day...

Posts: 3443
Location: Lethbridge
Joined: Feb 10th, 2002
Gender: Male
Re: Preventing Biases
Reply #6 - Feb 16th, 2002 at 10:36pm
 
I remember when I first got here...went straight into Mods and downloaded what seemed to be most popular...then I found out I needed the program, but I never read anything...
  

Code
Select All
unless(0) { stab("LoonyPandora"); next; } 

Back to top
IP Logged
 
KyleYankan
Senior Member
****
Offline


The KyleYCam!

Posts: 341
Joined: Dec 25th, 2001
Gender: Male
Re: Preventing Biases
Reply #7 - Feb 16th, 2002 at 10:50pm
 
Quote:
hm I guess 85% of the users wouldn't get that system Undecided

Keep it as simple as possible!


Well, then we do something like lvl1 not be shwon to users, lvl 2 have a big BETA sign on em and the rest be however
  


//-KyleY-\\

Steal his bandwidth! He doesn't want it!
Back to top
IP Logged
 
Administrator
Forum Administrator
*****
Offline


Yummm

Posts: 7
Location: Modders Rile
Joined: Oct 7th, 2014
Gender: Male
Re: Preventing Biases
Reply #8 - Feb 16th, 2002 at 11:18pm
 
Hm I think a mod should not be tested, released, retested and rereleased.

What about giving each mod 3x all the ratings. The mod would be invisible to users as long as the not all 3 ratings are filled in. Then if there is a big difference between the ratings, the testers could sit together and discuss why they rated the mod that way or that way and come up with a compromise or something. So that in the end, only one rating is shown to the user.
  

The Administrator.
Back to top
WWW  
IP Logged
 
Shoeb Omar
God Member
*****
Offline


Mod Writer

Posts: 5665
Location: San Diego
Joined: Jun 29th, 2001
Gender: Male
Re: Preventing Biases
Reply #9 - Feb 16th, 2002 at 11:19pm
 
no offence guys but this is getting waaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaay too complicated Smiley
  

YaBB SP2 BETA!
Now taking pay jobs in PHP or Perl.  Contact me for details.
Back to top
IP Logged
 
Administrator
Forum Administrator
*****
Offline


Yummm

Posts: 7
Location: Modders Rile
Joined: Oct 7th, 2014
Gender: Male
Re: Preventing Biases
Reply #10 - Feb 16th, 2002 at 11:22pm
 
hehe it was just a suggestion Wink

If we choose the right previewers, then we won't have the problem at all Grin
  

The Administrator.
Back to top
WWW  
IP Logged
 
KyleYankan
Senior Member
****
Offline


The KyleYCam!

Posts: 341
Joined: Dec 25th, 2001
Gender: Male
Re: Preventing Biases
Reply #11 - Feb 16th, 2002 at 11:22pm
 
I like it! All oppose?
  


//-KyleY-\\

Steal his bandwidth! He doesn't want it!
Back to top
IP Logged
 
Shoeb Omar
God Member
*****
Offline


Mod Writer

Posts: 5665
Location: San Diego
Joined: Jun 29th, 2001
Gender: Male
Re: Preventing Biases
Reply #12 - Feb 16th, 2002 at 11:26pm
 
what tya like kyle?
the idea of right previewers? same here Wink
  

YaBB SP2 BETA!
Now taking pay jobs in PHP or Perl.  Contact me for details.
Back to top
IP Logged
 
Michael
God Member
*****
Offline


Recursion \Re*cur"sion\,
n. - See recursion.

Posts: 1003
Joined: Oct 23rd, 2001
Gender: Male
Re: Preventing Biases
Reply #13 - Feb 16th, 2002 at 11:29pm
 
Quote:
If we choose the right previewers, then we won't have the problem at all Grin

My thoughts exactly.

Your idea is feasible, though. Just add an extra field to the mod table. It starts at 0. Each time a mod gets reviewed, that field gets incremented and the script uses the number of reviews so far to generate an average rating (like topic rating does). On the final review, the script makes an entry in the Accepted or Rejected table, as necessary.

I think that made sense, but I'm feeling kinda crotchety, so maybe not. Tongue
  

~ Michael ~
-------------
The MikeCam
A truly wise man never plays leapfrog with a unicorn.
Back to top
IP Logged
 
KyleYankan
Senior Member
****
Offline


The KyleYCam!

Posts: 341
Joined: Dec 25th, 2001
Gender: Male
Re: Preventing Biases
Reply #14 - Feb 17th, 2002 at 12:38am
 
sry, i should of been more specific, i like micheal p's [qoute]I think a mod should not be tested, released, retested and rereleased. [/quote]

I like this, but  ithink the first release should be marked somehow, like my suggest, with a [BETA] tag or something of the nature
  


//-KyleY-\\

Steal his bandwidth! He doesn't want it!
Back to top
IP Logged
 
Page Index Toggle Pages: [1] 2 
Send TopicPrint