WIP Beta released BeamNG BananaBenchmark - The visual approach

Discussion in 'Utilities and programming' started by Diamondback, Apr 17, 2015.

  1. Diamondback

    Diamondback
    Expand Collapse
    Vehicle Systems Engineering
    BeamNG Team

    Joined:
    Apr 8, 2014
    Messages:
    1,712
    Disclaimer: I have started this project before I joined the BeamNG-Team and therefore the tool is my private work and has no official ties to BeamNG.


    Hello everyone,
    today I am presenting you the work of the last few weeks, a tool meant to take a little different approach to the well known Banana Benchmark of BeamNG.

    Let's start with some eye candy:

    But it doesn't stop here, benchmarks aren't all that much fun without a nice way of analyzing and comparing them:

    Now that we have seen that we can access benchmark results online, let's get to the main reason why this is actually the case:
    The Online Scoreboard.

    Last up are two less interesting screenshots, one is about a little help section with some useful hints and tricks
    and the other one shows you the settings page where you can adjust a few benchmark related things.


    Development status: Open Beta
    Source Code: https://github.com/Diamondback2010/BeamNGBananaBenchmark
    License: MIT

    Please let me know what your initial impressions are and what you think could be improved just from looking at it. :)

    Downloads:
    Installation Instructions:
    Extract the files somewhere (like your desktop) and run the BananaBench.exe file.
    If you have used a previous version of the app, make sure to remove any trace of it from the BeamNG install directory (ie. the BananaBenchmark folder your copied there)
     
    #1 Diamondback, Apr 17, 2015
    Last edited: Jul 1, 2015
  2. GTR2legend

    GTR2legend
    Expand Collapse

    Joined:
    Aug 29, 2013
    Messages:
    214
    Look's nice can't wait for it, however my CPU will properly be classified as low. :cool:
     
  3. AMDFreak2006

    AMDFreak2006
    Expand Collapse

    Joined:
    Aug 11, 2013
    Messages:
    110
    Wow, thats amazing and brilliant, especially the online-compare function!

    I have a question: Why don't the Mbeams increase linearly with the number of the vehicles?
     
  4. tdev

    tdev
    Expand Collapse
    Developer
    BeamNG Team

    Joined:
    Aug 3, 2012
    Messages:
    2,911
    Awesome! :)
     
  5. Kitteh5

    Kitteh5
    Expand Collapse

    Joined:
    Oct 24, 2012
    Messages:
    275
    I want to try it!
     
  6. Aboroath

    Aboroath
    Expand Collapse

    Joined:
    Aug 25, 2013
    Messages:
    3,798
    Nice work, looks like dev level material.:cool:
     
  7. Diamondback

    Diamondback
    Expand Collapse
    Vehicle Systems Engineering
    BeamNG Team

    Joined:
    Apr 8, 2014
    Messages:
    1,712
    I am not entirely sure myself but here's my theory:
    The beam/s go up somewhat in a linear fashion, until you run into performance issues. Have a look here:
    http://beamng.software-enkler.com/v1/displaybench.php?token=87d1cca445c258

    See the two distinct slumps at 3 and 7 vehicles? That's part of the issue from what I can see.
    As we all know BNG basically uses one thread per vehicle, so in a perfect scenario, a quadcore processor doesn't care if you are running 1, 2, 3 or 4 cars at once
    as each of them has their own thread and each of those threads is handled by one core.
    In practice this doesn't work quite out as you never have a truely idle processor, there's always some stuff going on in the background that needs CPU time.

    So perfomance wise it's more like we have a tri-core for BNG. Three vehicles are no problem, as we have 3 more or less idle cores that can be used,
    but the 4th core is already working on other things, so the 4th car doesn't get quite as much CPU time as cars 1 to 3. That's where the first drop off happens.
    Now if we are using more cars than we have cores, each core has to handle multiple cars at once. Some high performance CPUs don't need all their power for a single vehicle per core,
    so there's some power left unused. However with more cars than cores, we can use this excess power again so we are seeing a slight increase in Beam/s. Until we reach 8 vehicles,
    where one of our cores needs to handle two vehicles + the background stuff, which is usually too much.

    So all in all, it's not linear because one vehicle does not use all the power of one core, but two vehicles need too much power for a linear increase.
    I guess one could find a CPU / car combination that would translate to a much more linear increase (up until core count -1) but for comparability reasons we need to stick to proven cars. :)
     
    #7 Diamondback, Apr 18, 2015
    Last edited: May 22, 2015
    • Like Like x 1
  8. Diamondback

    Diamondback
    Expand Collapse
    Vehicle Systems Engineering
    BeamNG Team

    Joined:
    Apr 8, 2014
    Messages:
    1,712
    I have just updated the OP with a link to the source code of the project (MIT license) and a download link for the first public beta. :)

    Let me know how it goes and if something goes wrong, make sure to explain exactly what happened when and what pc specs you have.
     
    #8 Diamondback, Apr 19, 2015
    Last edited: May 14, 2015
    • Like Like x 1
  9. Narwhal

    Narwhal
    Expand Collapse

    Joined:
    Aug 4, 2013
    Messages:
    1,701
    I get this error
    c5c7fdb58b.png
    im guessing we need to place the benchmark in the steam beamng folder? i didnt see a readme so i dont know.

    ----EDIT-----
    so i put it in a folder called banana benchmark in beamng steam folder and i get this error
    7cb57a9d86.png
     
  10. Diamondback

    Diamondback
    Expand Collapse
    Vehicle Systems Engineering
    BeamNG Team

    Joined:
    Apr 8, 2014
    Messages:
    1,712
    Haha damnit I forgot the installation instructions. Wait a sec...

    - - - Updated - - -

    Done, please look at the instructions in the OP and make sure to redownload the zip file. :)
     
    #10 Diamondback, Apr 19, 2015
    Last edited: May 14, 2015
  11. apple

    apple
    Expand Collapse
    Banned

    Joined:
    Dec 21, 2014
    Messages:
    470
    iam sorry to say but i have ann 38 vor max 3 pickups on a i5 wtf i can run it at max and get 5 to 7 t sieries and stil get 60+ fps
    i have a pc for 1000 euro and i has a video card so long as ps4 so
     
  12. Diamondback

    Diamondback
    Expand Collapse
    Vehicle Systems Engineering
    BeamNG Team

    Joined:
    Apr 8, 2014
    Messages:
    1,712
    Eh what? Can you please express whatever you want to say a little bit clearer?

    Are you trying to say that you got 38 MB/s as your result with an i5 (maybe an i5 4690T @2.5Ghz?) which equals about 3 pickups and in reality you can run 5 to 7 T75 at once?
    If so, sorry, but I highly doubt this is the case. Even the i7 5930K (heavily overlocked) can run 5 T75 maximum at once. There is no way an i5 @ 2.5Ghz can come even close to that.

    But I'm sure I am missing something here, so please explain again what you talking about. :)
     
    #12 Diamondback, Apr 21, 2015
    Last edited: May 14, 2015
  13. SuperNoob05

    SuperNoob05
    Expand Collapse

    Joined:
    Jan 4, 2015
    Messages:
    1,287
    First of : What the Fuck are you trying to say?!
    Secondly : Are you 10^50 % sure that there's nothing wrong with your system and that it's not on fire?
     
  14. apple

    apple
    Expand Collapse
    Banned

    Joined:
    Dec 21, 2014
    Messages:
    470
    yes becouse the cpc is not even 6 months i have a wingforce videocard 8 gb ram

    - - - Updated - - -

    btw the benchmark said my score 38 % wtf

    - - - Updated - - -

    2015-04-21_00001.jpg
    HERE PROOF
     
  15. SHOme1289

    SHOme1289
    Expand Collapse

    Joined:
    Nov 6, 2013
    Messages:
    1,287
    proof that you have a bunch of trucks and you are at 20 fps? you said you were at 60+ fps...so no, you proved yourself wrong, very noticeably might I add.
     
  16. MultiGamerClub

    MultiGamerClub
    Expand Collapse

    Joined:
    Aug 6, 2013
    Messages:
    336
    Strange..

    I got 24-25 at the Benchmark, but still i can run 4-7 vechiles at the same time with 20-30 fps..

    My specs from the benchmark info:
    Intel(R) Core(TM) i5-4570 CPU @ 3.20 GHz, 4 Cores, 4 Threads, 8.00 GB RAM, Microsoft Windows 7 Professional Build 7601 (64-bit)
     

    Attached Files:

    • Dwm 2015-04-21 20-23-24-01.jpg
  17. Diamondback

    Diamondback
    Expand Collapse
    Vehicle Systems Engineering
    BeamNG Team

    Joined:
    Apr 8, 2014
    Messages:
    1,712
    Can you provide a link to your benchmark? The number of possible vehicles might need some tuning to fit everyone.

    - - - Updated - - -

    I see a static image of you having 20fps. Can you show us a video with all those vehicles driving at once?
    By all means, in the screenshot you could have deactivated the physics...

    Oh and the benchmark doesn't report in %...
     
  18. MultiGamerClub

    MultiGamerClub
    Expand Collapse

    Joined:
    Aug 6, 2013
    Messages:
    336
    Posted a picture below my last post.. didnt know you could ignore a picture that big..

    Just run another benchmark and i got 37-38 on the score ._.

    Picture down below.

    - - - Updated - - -

    Actually.. i just did ANOTHER benchmark.. and it went to 39.. WTF is happening.
     

    Attached Files:

    • Dwm 2015-04-21 21-03-32-71.jpg
  19. logoster

    logoster
    Expand Collapse

    Joined:
    Sep 5, 2012
    Messages:
    2,085
    i did a benchmark for all the options, so now people can see what an i5-3330 does

    and you get another cpu added to your database
     
  20. Diamondback

    Diamondback
    Expand Collapse
    Vehicle Systems Engineering
    BeamNG Team

    Joined:
    Apr 8, 2014
    Messages:
    1,712
    Not talking about pictures here, I need a link to the benchmark details :) you can get it if click on the details button below the score.
    Concerning the score, maybe energy saver mode?
     
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice