Author Topic: GATT Benchmarking Development forum  (Read 44238 times)

Offline Kraeoss

  • Jonin
  • ***
  • Posts: 894
  • Country: 00
  • Chakra 8
  • Referrals: 0
    • View Profile
  • CPU: Intel Core i5 2500k @ 3.3Ghz
  • GPU: HD 4870 (512mb)
  • RAM: 8GB DDR3 Corsair vengeance
  • Broadband: Blink
Re: GATT Benchmarking Development forum
« Reply #20 on: April 17, 2009, 08:21:56 AM »
i need a new monitor....
"Upgrades..." Neo, The Matrix Reloaded.

Carigamers

Re: GATT Benchmarking Development forum
« Reply #20 on: April 17, 2009, 08:21:56 AM »

Offline W1nTry

  • Administrator
  • Akatsuki
  • *****
  • Posts: 11329
  • Country: tt
  • Chakra 109
  • Referrals: 3
    • View Profile
  • CPU: Intel Core i7 3770
  • GPU: Gigabyte GTX 1070
  • RAM: 2x8GB HyperX DDR3 2166MHz
  • Broadband: FLOW
  • Steam: W1nTry
  • XBL: W1nTry
Re: GATT Benchmarking Development forum
« Reply #21 on: April 17, 2009, 09:23:34 AM »
all the vantages are run once and then pay for.

so you gonna have to use your acquire-no-jutsus

ohho...

Offline TriniXaeno

  • Administrator
  • Akatsuki
  • *****
  • Posts: 18836
  • Country: tt
  • Chakra 14
    • :ps3::wii::xbox360:
  • Referrals: 35
    • View Profile
    • http://www.carigamers.com
  • CPU: Intel Core i7-2600K
  • GPU: Geforce GTX 680 2GB
  • RAM: 16GB
  • Broadband: :flow:
  • MBL: Nexus 5x
  • PSN: TriniXaeno
  • XBL: TriniXaeno
Re: GATT Benchmarking Development forum
« Reply #22 on: April 17, 2009, 10:16:22 AM »
That won't be a problem for the Hard Core guys, I'm sure.

Offline W1nTry

  • Administrator
  • Akatsuki
  • *****
  • Posts: 11329
  • Country: tt
  • Chakra 109
  • Referrals: 3
    • View Profile
  • CPU: Intel Core i7 3770
  • GPU: Gigabyte GTX 1070
  • RAM: 2x8GB HyperX DDR3 2166MHz
  • Broadband: FLOW
  • Steam: W1nTry
  • XBL: W1nTry
Re: GATT Benchmarking Development forum
« Reply #23 on: April 17, 2009, 10:20:50 AM »
Well thing is, the 'acquisition' is simply a key. As you have the FULL application from the free download. It's the key that you pay for... I am sure almost everyone can 'acquire' the key and if not, they can ask someone who can. That aside (not that I am condoning piracy or anything like that XD). I have been using OCCT on recommendation in this very thread and I am finding it to be BOSS. I endorse this app and it's free. But not only that it has multiple stress tests in it 2xCPU, 1xGPU, 2xMemory and it also shows temperatures, CPU utilization AND it produces GRAPHS showing system readings throughout the run (temps, voltages) OCCT gets W1nTry Stamp of approval as the GATT defacto stability app!!! the only question is the level of the stress test... there's 3 settings in the Linpack run low, medium and High. I have been using Medium (50% memory) for 16 min runs. What say ye?

Offline Nephilim

  • Sannin
  • *****
  • Posts: 2698
  • Country: 00
  • Chakra 56
  • Referrals: 0
    • View Profile
  • CPU: Q94
  • GPU: 4870
  • RAM: 8GB
  • Broadband: Flow
Re: GATT Benchmarking Development forum
« Reply #24 on: April 17, 2009, 10:35:37 AM »
the new OCCT using linpak?

i used to run OCCT foir about 12 hours, if system pass i say stable.

the entire move to the linpaks was to reduce testing time. 12 hours vs about 15mins was a huge +.

if OCCT doing all that and then some i say +1 to it.

Carigamers

Re: GATT Benchmarking Development forum
« Reply #24 on: April 17, 2009, 10:35:37 AM »

Offline Kraeoss

  • Jonin
  • ***
  • Posts: 894
  • Country: 00
  • Chakra 8
  • Referrals: 0
    • View Profile
  • CPU: Intel Core i5 2500k @ 3.3Ghz
  • GPU: HD 4870 (512mb)
  • RAM: 8GB DDR3 Corsair vengeance
  • Broadband: Blink
Re: GATT Benchmarking Development forum
« Reply #25 on: April 17, 2009, 10:37:35 AM »
finally a man using de truth hehe... yea 10 min  lin pack run is enough for stability confirmation i did a 72 hr and it fared just as well
"Upgrades..." Neo, The Matrix Reloaded.

Offline W1nTry

  • Administrator
  • Akatsuki
  • *****
  • Posts: 11329
  • Country: tt
  • Chakra 109
  • Referrals: 3
    • View Profile
  • CPU: Intel Core i7 3770
  • GPU: Gigabyte GTX 1070
  • RAM: 2x8GB HyperX DDR3 2166MHz
  • Broadband: FLOW
  • Steam: W1nTry
  • XBL: W1nTry
Re: GATT Benchmarking Development forum
« Reply #26 on: April 17, 2009, 05:44:56 PM »
I've spent my share of time and effort to put this forward as an example of the results we could use:
http://www.carigamers.com/cms/forums/index.php/topic,5808.msg209816.html#msg209816

Offline Arcmanov

  • Administrator
  • Akatsuki
  • *****
  • Posts: 10642
  • Country: tt
  • Chakra 126
  • Gamer/Enthusiast
    • :n64: :gcn: :dreamcast: :xbox360: :computer:
  • Referrals: 1
    • View Profile
    • Arcmanov's rig
  • CPU: Intel Core i7 5820K @ 4.3 GHz
  • GPU: 2 x [Gigabyte] GeForce GTX 1070
  • RAM: 4 x 8GB G.Skill.TridentZ RGB DDR4-2400
  • Broadband: :flow:
  • MBL: LG V20
  • Origin ID: Arcmanov
  • PSN: Arcmanov
  • Steam: Arcmanov
  • XBL: Arcmanov
Re: GATT Benchmarking Development forum
« Reply #27 on: April 17, 2009, 06:32:59 PM »
I keep seeing the word 'validation' being thrown about.

Please elaborate on this.
Systems United Navy - Accipiens ad Astra


Offline W1nTry

  • Administrator
  • Akatsuki
  • *****
  • Posts: 11329
  • Country: tt
  • Chakra 109
  • Referrals: 3
    • View Profile
  • CPU: Intel Core i7 3770
  • GPU: Gigabyte GTX 1070
  • RAM: 2x8GB HyperX DDR3 2166MHz
  • Broadband: FLOW
  • Steam: W1nTry
  • XBL: W1nTry
Re: GATT Benchmarking Development forum
« Reply #28 on: April 17, 2009, 06:38:47 PM »
Validation refers primarly to showing screenshots that show you have the hardware you claim to have. Appended to that and still subjective is validating that the settings you are running are 'stable' and can be REPRODUCED.

Offline W1nTry

  • Administrator
  • Akatsuki
  • *****
  • Posts: 11329
  • Country: tt
  • Chakra 109
  • Referrals: 3
    • View Profile
  • CPU: Intel Core i7 3770
  • GPU: Gigabyte GTX 1070
  • RAM: 2x8GB HyperX DDR3 2166MHz
  • Broadband: FLOW
  • Steam: W1nTry
  • XBL: W1nTry
Re: GATT Benchmarking Development forum
« Reply #29 on: June 16, 2009, 03:11:59 PM »
It's come to my attention that every now and again that 3DMark scores can be close, how close? well within 100 pts. The question I pose is how much of a difference in score can be attributed to random skew? many review sites throw deviations in score out the window and as such considering we too would suffer the sme skew what should we consider reasonable skew? I suggest 100pts.

Thus should a user have a score within 100 (inclusive) pts of another it is considered a tie. And with such scenarios there would be no place about it i.e. tie for 12th means no 13th, next placing would be 14th.

What do yall think?

Also to reduce skew I suggest we introduce repeat runs at least 3.

Offline Spazosaurus

  • Dr. Herp Derpington
  • Administrator
  • Akatsuki
  • *****
  • Posts: 7685
  • Country: tt
  • Chakra 52
  • Referrals: 3
    • View Profile
    • The Awesome Company
  • CPU: i5 3470
  • GPU: GTX 780
  • RAM: 8GB Corsair
  • Broadband: Blink 2Mb + Flow 20Mb
Re: GATT Benchmarking Development forum
« Reply #30 on: June 16, 2009, 09:12:08 PM »
I move that for any two (or more) members whose score difference amounts to 99 points or less, a tie be declared between (among) said members bla bla just like w1n said.

Repeat runs at least 3? Please clarify. If you mean that members run 3 passes of 3dmark...sure, I guess, but that would not solve the problem as it still remains very possible that even after 3 runs the scores are still within 100pts of each other and can just as easily land within less than 100pts of the higher/lower ranked member.

Offline W1nTry

  • Administrator
  • Akatsuki
  • *****
  • Posts: 11329
  • Country: tt
  • Chakra 109
  • Referrals: 3
    • View Profile
  • CPU: Intel Core i7 3770
  • GPU: Gigabyte GTX 1070
  • RAM: 2x8GB HyperX DDR3 2166MHz
  • Broadband: FLOW
  • Steam: W1nTry
  • XBL: W1nTry
Re: GATT Benchmarking Development forum
« Reply #31 on: June 16, 2009, 09:44:35 PM »
Yes I meant 3 passes. Whilst it will not eliminate the 100 issue it should reduce 1 off freak scores which DO happen from time to time. It adds the idea of REPEATABLE scores. I waiting on Arc input and men like n00b and others.

Offline Nephilim

  • Sannin
  • *****
  • Posts: 2698
  • Country: 00
  • Chakra 56
  • Referrals: 0
    • View Profile
  • CPU: Q94
  • GPU: 4870
  • RAM: 8GB
  • Broadband: Flow
Re: GATT Benchmarking Development forum
« Reply #32 on: June 16, 2009, 09:55:12 PM »
3Dmark has a setting to do this automatically, so its not really an inconvenience. run a few times then take the avg.



This is under the settings option in 3Dmark06 (2nd from left, button to the bottom right)

I'm for it, if only for the purpose of statistical/scientific accuracy.
« Last Edit: June 16, 2009, 09:56:47 PM by Nephilim »

Offline Arcmanov

  • Administrator
  • Akatsuki
  • *****
  • Posts: 10642
  • Country: tt
  • Chakra 126
  • Gamer/Enthusiast
    • :n64: :gcn: :dreamcast: :xbox360: :computer:
  • Referrals: 1
    • View Profile
    • Arcmanov's rig
  • CPU: Intel Core i7 5820K @ 4.3 GHz
  • GPU: 2 x [Gigabyte] GeForce GTX 1070
  • RAM: 4 x 8GB G.Skill.TridentZ RGB DDR4-2400
  • Broadband: :flow:
  • MBL: LG V20
  • Origin ID: Arcmanov
  • PSN: Arcmanov
  • Steam: Arcmanov
  • XBL: Arcmanov
Re: GATT Benchmarking Development forum
« Reply #33 on: June 16, 2009, 10:15:54 PM »
* Concurs *

If the scores are STILL within 100 pts after 3 loops, then tie it is.

...but we running the risk of making this thing too complex now.
Systems United Navy - Accipiens ad Astra


Offline TriniXaeno

  • Administrator
  • Akatsuki
  • *****
  • Posts: 18836
  • Country: tt
  • Chakra 14
    • :ps3::wii::xbox360:
  • Referrals: 35
    • View Profile
    • http://www.carigamers.com
  • CPU: Intel Core i7-2600K
  • GPU: Geforce GTX 680 2GB
  • RAM: 16GB
  • Broadband: :flow:
  • MBL: Nexus 5x
  • PSN: TriniXaeno
  • XBL: TriniXaeno
Re: GATT Benchmarking Development forum
« Reply #34 on: June 17, 2009, 02:11:13 AM »
what arc said.

I think the complexity is best left to the hard core benchmark list. (Did that ever get off the ground btw?)

The current list is simple and sweet. If one person's rig remains higher (even by one point) after the triple run, why not give them the higher spot? Margin of error or not.

For example.

#1: Arcman Fitness Rig 2010: 45,001 3D Marks
#2: NoobgoneWild GTFO Ultra Rig: 45,000 3D Marks
#3: Redfish WSHB PC: 40,000 3D Marks

So yeah, my rig is pretty much a tie to arcs but #1 and #2 still looks a lot easier on the eyes than this:

#1: Tie!!!! Arcman Fitness Rig 2010: 45,001 3D Marks & NoobgoneWild GTFO Ultra Rig: 45,000 3D Marks
#3: Redfish WSHB PC: 40,000 3D Marks

Offline Spazosaurus

  • Dr. Herp Derpington
  • Administrator
  • Akatsuki
  • *****
  • Posts: 7685
  • Country: tt
  • Chakra 52
  • Referrals: 3
    • View Profile
    • The Awesome Company
  • CPU: i5 3470
  • GPU: GTX 780
  • RAM: 8GB Corsair
  • Broadband: Blink 2Mb + Flow 20Mb
Re: GATT Benchmarking Development forum
« Reply #35 on: June 17, 2009, 07:08:06 AM »
Just out of curiosity, what does WSHB mean?

As you put it like that Noob, you make a complelling point, but its highly unlikely that we'll have a situation like that. Even if two people have IDENTICAL hardware, it still doesnt guarantee that they would both get the same score.

Offline W1nTry

  • Administrator
  • Akatsuki
  • *****
  • Posts: 11329
  • Country: tt
  • Chakra 109
  • Referrals: 3
    • View Profile
  • CPU: Intel Core i7 3770
  • GPU: Gigabyte GTX 1070
  • RAM: 2x8GB HyperX DDR3 2166MHz
  • Broadband: FLOW
  • Steam: W1nTry
  • XBL: W1nTry
Re: GATT Benchmarking Development forum
« Reply #36 on: June 17, 2009, 07:22:56 AM »
I agree with capn. If you look at the scores now there is USUALLY a decent margin of difference between each score. So when similar (within 100) pt scores occur I think it fair to have a tie.

Offline Kraeoss

  • Jonin
  • ***
  • Posts: 894
  • Country: 00
  • Chakra 8
  • Referrals: 0
    • View Profile
  • CPU: Intel Core i5 2500k @ 3.3Ghz
  • GPU: HD 4870 (512mb)
  • RAM: 8GB DDR3 Corsair vengeance
  • Broadband: Blink
Re: GATT Benchmarking Development forum
« Reply #37 on: June 17, 2009, 10:25:47 AM »
so in other words i train hard and long on the OC track tighten belt an thing buy meh l33t parts and then if i get a score  then somebody else who is clearly behind after all the heats by say 1 pt then we tie ? that makes no sense, i say is better yuh make a top 50 instead cause to me all is fair to who passes the mark at it's highest point and if all that separates us is a 1-2-99 marks then well then be a good sport and take yuh proper place. no ties... if my system and arc system score 45000 3Dmks after 3-6 runs then that's a tie
"Upgrades..." Neo, The Matrix Reloaded.

Offline Netizen1

  • Global Moderator
  • Kage
  • *
  • Posts: 1764
  • Country: tt
  • Chakra 10
  • save de Earth, iz de only planet with chocolate!
    • :ps3: :psp:
  • Referrals: 0
    • View Profile
    • Trinidad Christian Center
  • Broadband: :flow:
  • PSN: Netizen1
  • Steam: Netizen1
Re: GATT Benchmarking Development forum
« Reply #38 on: June 17, 2009, 10:36:12 AM »
I don't think we need more than a top 20 as yet. There's not enough movement on and off the list to warrant it.

However, someone did suggest we keep a history of past performers somewhere, so we can look back a year from now and say, wow that was all my old rig was capable of?

Unfortunately, not everyone started their own Benchmark thread to keep such a history (per user)

Offline W1nTry

  • Administrator
  • Akatsuki
  • *****
  • Posts: 11329
  • Country: tt
  • Chakra 109
  • Referrals: 3
    • View Profile
  • CPU: Intel Core i7 3770
  • GPU: Gigabyte GTX 1070
  • RAM: 2x8GB HyperX DDR3 2166MHz
  • Broadband: FLOW
  • Steam: W1nTry
  • XBL: W1nTry
Re: GATT Benchmarking Development forum
« Reply #39 on: June 17, 2009, 10:36:44 AM »
You've missed the key point here kraeoss, ALL review site bar NONE allow for skew. You can run 3Dmark today for 10 passes then tomorrow not be able to reporduce that score. It may vary up, down or sideways. To begin with score SHOULD BE REPEATABLE and as such you EXPECT that the score will VARY with a certain skew (I suggested 100pts). You system SHOULD be able to repeat results within a 100pt Skew of even in a months time.

The take home here is if a man beat you by 1 pt today i'd bet you a doubles that tomorrow he could get a lower score and you'll beat him. Which makes NO SENSE. Thus this is to better validate the scores and give ppl a fair playing ground.

So far the odds are
Capn, W1n, Arc FOR
n00b, kraeoss Against.

The next question would be to put a poll to the general gatt populace once the staff can agree or disagree on this issue.

Carigamers

Re: GATT Benchmarking Development forum
« Reply #39 on: June 17, 2009, 10:36:44 AM »

 


* ShoutBox

Refresh History
  • Crimson609: yea everything cool how are you?
    August 10, 2022, 07:26:15 AM
  • Pain_Killer: Good day, what's going on with you guys? Is everything Ok?
    February 21, 2021, 05:30:10 PM
  • Crimson609: BOOM covid-19
    August 15, 2020, 01:07:30 PM
  • Shinsoo: bwda 2020 shoutboxing. omg we are in the future and in the past at the same time!
    March 03, 2020, 06:42:47 AM
  • TriniXjin: Watch Black Clover Everyone!
    February 01, 2020, 06:30:00 PM
  • Crimson609: lol
    February 01, 2020, 05:05:53 PM
  • Skitz: So fellas how we go include listing for all dem parts for pc on we profile but doh have any place for motherboard?
    January 24, 2020, 09:11:33 PM
  • Crimson609: :ph34r:
    January 20, 2019, 09:23:28 PM
  • Crimson609: Big up ya whole slef
    January 20, 2019, 09:23:17 PM
  • protomanex: Gyul like Link
    January 20, 2019, 09:23:14 PM
  • protomanex: Man like Kitana
    January 20, 2019, 09:22:39 PM
  • protomanex: Man like Chappy
    January 20, 2019, 09:21:53 PM
  • protomanex: Gyul Like Minato
    January 20, 2019, 09:21:48 PM
  • protomanex: Gyul like XJin
    January 20, 2019, 09:19:53 PM
  • protomanex: Shout out to man like Crimson
    January 20, 2019, 09:19:44 PM
  • Crimson609: shout out to gyal like Corbie Gonta
    January 20, 2019, 09:19:06 PM
  • cold_187: Why allur don't make a discord or something?
    December 03, 2018, 06:17:38 PM
  • Red Paradox: https://www.twitch.tv/flippay1985 everyday from 6:00pm
    May 29, 2018, 09:40:09 AM
  • Red Paradox: anyone play EA Sports UFC 3.. Looking for a challenge. PSN: Flippay1985 :)
    May 09, 2018, 11:00:52 PM
  • cold_187: @TriniXjin not really, I may have something they need (ssd/ram/mb etc.), hence why I also said "trade" ;)
    February 05, 2018, 10:22:14 AM

SimplePortal 2.3.3 © 2008-2010, SimplePortal