Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to get the auc #7

Closed
HelloRicky123 opened this issue Nov 22, 2018 · 1 comment
Closed

How to get the auc #7

HelloRicky123 opened this issue Nov 22, 2018 · 1 comment

Comments

@HelloRicky123
Copy link

Hi Mr.Zhang,
I trained the model 30 epoches and used the code in https://github.com/bilylee/tracker_benchmark you provide to produce the result on OTB100, and I got aveCoverage and aveErrCenter. The following is my result. But I don't know how to get the auc. I saved the predicted boxes and groundtruth boxes and calculate the auc myself and get 0.62+, but I think it's a little too high. So I wanna if the code you provide can produce auc?
Thanks a lot!
All.json
{"name": "ALL", "desc": "All attributes", "tracker": "SiameseFC", "evalType": "OPE", "seqs": ["Basketball", "Biker", "Bird1", "Bird2", "BlurBody", "BlurCar1", "BlurCar2", "BlurCar3", "BlurCar4", "BlurFace", "BlurOwl", "Board", "Bolt", "Bolt2", "Box", "Boy", "Car1", "Car2", "Car24", "Car4", "CarDark", "CarScale", "ClifBar", "Coke", "Couple", "Coupon", "Crossing", "Crowds", "Dancer", "Dancer2", "David", "David2", "David3", "Deer", "Diving", "Dog", "Dog1", "Doll", "DragonBaby", "Dudek", "FaceOcc1", "FaceOcc2", "Fish", "FleetFace", "Football", "Football1", "Freeman1", "Freeman3", "Freeman4", "Girl", "Girl2", "Gym", "Human2", "Human3", "Human4-2", "Human5", "Human6", "Human7", "Human8", "Human9", "Ironman", "Jogging-1", "Jogging-2", "Jump", "Jumping", "KiteSurf", "Lemming", "Liquor", "Man", "Matrix", "Mhyang", "MotorRolling", "MountainBike", "Panda", "RedTeam", "Rubik", "Shaking", "Singer1", "Singer2", "Skater", "Skater2", "Skating1", "Skating2-1", "Skating2-2", "Skiing", "Soccer", "Subway", "Surfer", "Suv", "Sylvester", "Tiger1", "Tiger2", "Toy", "Trans", "Trellis", "Twinnings", "Vase", "Walking", "Walking2", "Woman"], "overlap": 66.20537032522891, "error": 2.833591675153366, "overlapScores": [0.5926672927432785, 0.6744523158948802, 0.4758998916413733, 0.7696486706086082, 0.6853726089480511, 0.8345670514668277, 0.844032160931591, 0.8213972449066869, 0.8405619493081518, 0.8062361033658137, 0.8204389268634588, 0.44990766176914604, 0.5834594717187838, 0.5628299575581555, 0.6798351199956547, 0.7882560429522064, 0.805657077100189, 0.866769542199004, 0.8205198622192008, 0.846973290787438, 0.8637282909664755, 0.6275478765070535, 0.5131748615738081, 0.5803322245017029, 0.7265976675636683, 0.7794657551593479, 0.739760754058129, 0.6790682336800818, 0.7631618448786447, 0.742207866456886, 0.6405737645381154, 0.7975168491398508, 0.5263560801177612, 0.7363679925157307, 0.2904404740180546, 0.46867412460127506, 0.8303155589968413, 0.752400038255508, 0.6498460887560017, 0.7986218254166496, 0.7542083477596558, 0.6784146701449878, 0.7368269421615777, 0.6891616611951438, 0.7760366223898383, 0.6501801447403859, 0.47673670854190947, 0.7006798567188974, 0.5828177138544047, 0.7290218543301457, 0.6550681776431247, 0.5288280893804834, 0.7346839910533725, 0.6836821045300154, 0.6572003238157712, 0.5220306511186218, 0.6867237389837799, 0.7921275938393707, 0.41105993190160506, 0.7373981448108902, 0.6432348524025262, 0.7242144985219909, 0.7201011901991452, 0.3321892925673771, 0.6123389674336884, 0.8006784428872289, 0.6324850519694831, 0.8158914906985878, 0.8364380255459771, 0.5259386992791598, 0.803522424177653, 0.5554464910640086, 0.7228794573578582, 0.6273276580504706, 0.6462245831256584, 0.6919191339772083, 0.7782396990217818, 0.7396258994334471, 0.4509718189024295, 0.6255163033100344, 0.6170985834230858, 0.5448690373978851, 0.44765854738988825, 0.44215251029207453, 0.5160523555364676, 0.3255587346427622, 0.7807546842787755, 0.5973884179473172, 0.8286922892630049, 0.7472081492641974, 0.5316698896855354, 0.4845309321917454, 0.5754776107639107, 0.574880852519549, 0.6305495126856653, 0.6732596158125619, 0.5628371975785968, 0.7222802154172178, 0.6133800988493966, 0.4453594267695019], "errorNum": [5.1448275862068975, 5.352112676056338, 8.480392156862745, 0.6060606060606061, 0.14970059880239522, 0.013477088948787063, 0.0, 0.0, 0.0, 0.0, 0.03169572107765452, 8.753581661891118, 9.857142857142858, 5.665529010238908, 1.8776916451335057, 0.016611295681063124, 0.0, 0.0, 0.06211180124223602, 0.0, 3.0279898218829517, 2.9365079365079367, 5.148305084745762, 2.027491408934708, 0.07142857142857142, 6.146788990825688, 0.08333333333333333, 1.1527377521613833, 0.0, 0.06666666666666667, 3.1210191082802545, 0.148975791433892, 5.515873015873016, 0.0, 8.883720930232558, 6.062992125984252, 0.0, 0.1472107438016529, 1.858407079646018, 0.7074235807860262, 0.0, 1.958128078817734, 0.14705882352941177, 2.446958981612447, 6.961325966850829, 1.891891891891892, 6.656441717791411, 0.0, 2.6148409893992937, 0.2, 1.7333333333333334, 4.445893089960887, 0.3102836879432624, 9.80565371024735, 2.39880059970015, 5.624123422159888, 1.1237373737373737, 0.0, 9.53125, 0.1639344262295082, 4.457831325301205, 0.32573289902280134, 0.19543973941368076, 9.262295081967213, 1.3418530351437699, 5.476190476190476, 3.727544910179641, 3.7851809304997133, 0.0, 5.300000000000001, 0.006711409395973154, 3.597560975609756, 0.0, 1.9500000000000002, 1.02711157455683, 1.3820731096644967, 0.0, 0.22792022792022792, 9.6448087431694, 1.0625, 2.1149425287356323, 3.65, 7.251585623678647, 5.856236786469344, 8.641975308641975, 8.316326530612244, 0.05714285714285714, 1.8882978723404256, 4.5396825396825395, 0.4684014869888476, 3.531073446327684, 4.986301369863014, 3.284132841328413, 4.274193548387097, 3.936731107205624, 1.843220338983051, 3.6162361623616235, 0.04854368932038834, 4.1, 7.051926298157454], "successRateList": [0.8595669326499507, 0.8495732291636107, 0.8434232708936849, 0.8385026946620563, 0.8311043763146222, 0.821872587672512, 0.8099617917635625, 0.796378620064285, 0.7772042551701906, 0.749087954064562, 0.7166408324846634, 0.6748470123776762, 0.6208589850543295, 0.5562877195214879, 0.4729130216766844, 0.37404198625994994, 0.2552092146084533, 0.14111520018622783, 0.05399497417744243, 0.010378141850024452, 0.0]}

@StrangerZhang
Copy link
Owner

Just caculate the mean of successRateList

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants