1. Stuck, Having problems with creating your mod? Let us help you: Mod Support

Performance Statistics - Feedback thread

Discussion in 'Content Creation' started by Diamondback, Jul 24, 2016.

  1. Diamondback

    Diamondback
    Expand Collapse
    Moderator
    Staff Member

    Joined:
    Apr 8, 2014
    Messages:
    1,087
    The new vehicle performance statistics in version 0.6 ("Performance" Tab in the vehicle selector) are not manually created but by an automated test.
    It needs a dedicated level and quite some time to do various tests of offroad behavior, acceleration, braking and so on.

    Please note that this is an optional step for the creators of mods, regular users won't need to do anything.

    How to generate performance statistics for your own mods:


    1) Make sure to have at least BeamNG 0.9.0.0

    2) Run BeamNG with the following args:
    Code:
    BeamNG.drive.exe -nocrashreport -console -level autotest/main.level.json -onLevelLoad_ext 'util_saveDynamicData'
    
    You can also specify a specific vehicle with -testvehicle sunburst or additionally a specific configuration of your test vehicle via -testconfig police

    3) Copy the generated info*.json files from your /Documents/BeamNG.Drive/vehicles folder back into your vehicle source files

    4) Clean up the *.json and *.touched files from the documents path if you want to rerun the test

    Here's a little video of how such a test looks like (please excuse the horrible bitrate, trying to keep the file somewhat small ;) )
    Video - Click to Play - Direct Link



    Currently we gather the following data points (listing metric only, imperial data is also available)
    • Power (including band)
    • Torque (including band)
    • Weight
    • Weight/Power ratio
    • Top speed
    • 0-100 km/h
    • 0-200 km/h
    • 0-300 km/h
    • 100-200 km/h
    • 100-0 km/h
    • Artificial "Offroad Score" that mostly works on ground clearance and overhang lengths (see first part of the video)
    Notes:
    • Acceleration tests might not work perfectly for very powerful cars with a generally bad setup (check the 200bx demon ;) )
    • Race brakes will need to have the preheat option enabled to give somewhat valid results
    For the future we'd also like to look into crash data of some sort, but it's not yet decided how exactly that will work.

    What do you think about it? Is something missing, something that you would love to see? Any problems / errors?

    Disclaimer: Please note that this is still a work in progress, trying to perfectly launch any car on the first try is quite challenging, so expect some changes in future updates.
     
    #1 Diamondback, Jul 24, 2016
    Last edited: Nov 26, 2017
    • Like Like x 13
  2. B. Tanner

    B. Tanner
    Expand Collapse

    Joined:
    Jan 20, 2015
    Messages:
    88
    Okay, for people who dont get this at first like me.
    First: This about the performance statistics of cars, which you see in vehicle selecting menu. It wont evaluate the perfomance of your pc.

    To get this gibberish working you need to create a start.bat in your gamefolder. eg: D:\Steam\steamapps\common\BeamNG.drive
    Open the texteditor of windows, paste the gibberish into it. Select "save as", select there "all files" instead of ".txt files", name it "start.bat" and save it in your gamefolder.
    Now you can double click the .bat and it will do its thing. Dont do any input, it will mess with your results.
     
  3. tdev

    tdev
    Expand Collapse
    Developer
    Staff Member

    Joined:
    Aug 3, 2012
    Messages:
    2,764
    @B.Tanner: thanks for the additional explanation :)

    Also, one more thing: to test all installed configurations, just remove the "-testvehicle something" bit
     
    • Like Like x 1
  4. NinetyNine!

    NinetyNine!
    Expand Collapse

    Joined:
    Feb 17, 2016
    Messages:
    1,349
    Where exactly are the json's located? nothing in my documents folder.

    I pasted the code into the start options in steam.

    EDIT :
    i also tried the batch method. when i open it , cmd opens and closes after like 0,1sec again. nothing happens after that

    Edit 2 :

    working now.

    forgot to remove 'BeamNG.exe' from the startoptions in steam. Thanks for all the information though!
     
    #4 NinetyNine!, Jul 24, 2016
    Last edited: Jul 25, 2016
  5. B. Tanner

    B. Tanner
    Expand Collapse

    Joined:
    Jan 20, 2015
    Messages:
    88
    I play the game without preheated engines and brakes. I recognized the perfomance test is running with the options you've chosen. idk if the difference is significant enough but it might be a good idea to tick those option back in for better comparability.
     
  6. NinetyNine!

    NinetyNine!
    Expand Collapse

    Joined:
    Feb 17, 2016
    Messages:
    1,349
    with the config testing , this is how my command looks like. but it's only spawning random configs.

    Code:
    -nocrashreport -console -level autotest.mis -lua extensions.loadModule('util/saveDynamicData') -testvehicle sunburst -testconfiguration vmcup
    where exactly do i have to place the config part to test my selected configurations only?
     
  7. Diamondback

    Diamondback
    Expand Collapse
    Moderator
    Staff Member

    Joined:
    Apr 8, 2014
    Messages:
    1,087
    It has to be -testconfig vmcup :)
     
    • Like Like x 3
  8. Spaceballs the Username

    Spaceballs the Username
    Expand Collapse

    Joined:
    Oct 13, 2015
    Messages:
    586
    Is there any way to test specific configs?

    edit: ninja'd
     
  9. NinetyNine!

    NinetyNine!
    Expand Collapse

    Joined:
    Feb 17, 2016
    Messages:
    1,349
    ah alright. thanks!
     
  10. Diamondback

    Diamondback
    Expand Collapse
    Moderator
    Staff Member

    Joined:
    Apr 8, 2014
    Messages:
    1,087
    Updated the OP a bit :)
     
    • Like Like x 1
  11. NinetyNine!

    NinetyNine!
    Expand Collapse

    Joined:
    Feb 17, 2016
    Messages:
    1,349
    one last question , (i know i'm asking a lot , but i might help others too)

    is it possible to test multiple configurations? or select the folder of the cars (so that only the mod configurations will be tested for example)?

    because it is a bit time-expensive to wait till every car finishes and type in the new config. with selecting only the cars that need to be tested , (in this case mod folder) , the game could do everything in the background without breaks.
     
    • Like Like x 1
  12. Drivver

    Drivver
    Expand Collapse

    Joined:
    May 1, 2015
    Messages:
    222
    I'd add this info, Pre-heated brakes have to be applied in performance cars, otherwise test of acceleration will be invalid, because car will launch with brakes applied due to their low thermal efficiency. Tested on Rally and Hill Climb configs.
     
    • Like Like x 1
  13. Spaceballs the Username

    Spaceballs the Username
    Expand Collapse

    Joined:
    Oct 13, 2015
    Messages:
    586
    I'd love to see a max lateral Gs test. Have the vehicle drive in a circle until it loses grip, then log the maximum G forces it encountered during the test.
    Also, downforce (front and rear) is really important to vehicle performance. Use the metric as X kg at Y km/h
     
    • Like Like x 2
  14. Diamondback

    Diamondback
    Expand Collapse
    Moderator
    Staff Member

    Joined:
    Apr 8, 2014
    Messages:
    1,087
    Lateral Gs are surprisingly complicated since you ideally need to drive in a perfectly steady circle with increasing speed. Keeping that circle with *any* car right off the bat is a very complex control logic problem. But yea, we are looking into that (especially if fixed speed + increasing wheel angle will give us results close enough)

    Downforce could be a nice one and probably not too hard to test either :)
     
  15. Djplopper

    Djplopper
    Expand Collapse

    Joined:
    Aug 31, 2013
    Messages:
    829
    i might seem dumb and stupid, but how do i let the game run with the argument?
     
  16. Diamondback

    Diamondback
    Expand Collapse
    Moderator
    Staff Member

    Joined:
    Apr 8, 2014
    Messages:
    1,087
    Unfortunately this is not possible at the moment. Feel free to edit the extension lua file to match you needs though. :)
     
  17. Spaceballs the Username

    Spaceballs the Username
    Expand Collapse

    Joined:
    Oct 13, 2015
    Messages:
    586
    Thanks for the reply!

    What if you drove to 40mph (or full throttle for 20 seconds if the vehicle is slow, like a fully loaded T-Series or mod vehicle), held the speed, then slowly turned the wheel to full lock, until lateral grip is lost?
     
  18. Diamondback

    Diamondback
    Expand Collapse
    Moderator
    Staff Member

    Joined:
    Apr 8, 2014
    Messages:
    1,087
    Yea, that's what i am describing above. It's not the same as actually keeping a steady circle physics wise, but we'll have to see if this gets us close enough to the real values to be usable. After all this whole performance thing is mostly for comparision between the cars, which makes issues in the measuring logic a bit less important.
     
  19. Spaceballs the Username

    Spaceballs the Username
    Expand Collapse

    Joined:
    Oct 13, 2015
    Messages:
    586
    I agree. as long as the tests are consistent and inclusive (e.g. you get a lot of stats from it), then comparison between cars becomes a numbers game, however false those numbers are when pertaining to real-world performance :)
     
  20. Spaceballs the Username

    Spaceballs the Username
    Expand Collapse

    Joined:
    Oct 13, 2015
    Messages:
    586
    @Diamondback what do you think of adding a CoG (center of gravity / mass) stat to the vehicle? It would be a 3 component vector with a % from center on x and z axis, and a height from axle on the y axis.

    Also higher speed brake tests would be cool too. 100-0 and 200-0 where applicable.
     
  21. needforsuv

    needforsuv
    Expand Collapse

    Joined:
    Nov 17, 2015
    Messages:
    488
    i cant seem to find the .json file also i have missing textures on the road
     
    #20 needforsuv, Jul 27, 2016
    Last edited: Jul 27, 2016
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice