Code consultation #2
Comments
|
By using "-o test.csv", the program will output results on each instance to file test.csv. You can then easily compute success rates based on the runtime or solution costs in the test.csv. |
|
Thank you very much for your reply, but I don't quite understand how to
compute the success rate through the runtime or solution costs in the
test.csv file. Can you explain it in more detail? thank you!
Jiaoyang-Li ***@***.***> 于2021年7月20日周二 下午11:28写道：
… By using "-o test.csv", the program will output results on each instance
to file test.csv. You can then easily compute success rates based on the
runtime or solution costs in the test.csv.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AMBF57X7H7UCGD2MCHCN7ETTYWIZ7ANCNFSM5AVM652Q>
.
|
|
If an instance was solved successfully, the runtime would be smaller than your runtime limit and the solution cost would be positive. So you just need to count the number of instances that were solved successfully and then divide it by the total number of instances that you have tested. |
|
Can I get the number of instances that were solved successfully and the
total number of instances that I have tested in the file test.csv?
Jiaoyang-Li ***@***.***> 于2021年7月26日周一 上午12:19写道：
… If an instance was solved successfully, the runtime would be smaller than
your runtime limit and the solution cost would be positive. So you just
need to count the number of instances that were solved successfully and
then divide it by the total number of instances that you have tested.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AMBF57V2MCE7PIZ4FG3EPALTZQ2PZANCNFSM5AVM652Q>
.
|
|
Since each run of the eecbs program only runs EECBS on one instance and generates one line in test.csv, test.csv does not directly provide the numbers of successful and total instances. But these two numbers can be easily counted via a simple script (or even Excel) |
|
Thank you for your rapid explanation about the *EECBS*. I also want to
disturb you, and I would like to ask the following questions:
1. Does an instance refer to a map composed of the starting positions, goal
positions, and obstacle positions of multiple agents?
2. In the experiment, the success rate of more than 200 instances is
calculated and counted within a limited time. Does it mean that the
algorithm must calculate and count the success rate of more than 200
different maps within a limited time?
3. Is the time limit the upper limit for testing a single instance? Or is
the total time limit for testing multiple instances?
Best,
Weike
Jiaoyang-Li ***@***.***> 于2021年7月26日周一 上午9:54写道：
… Since each run of the eecbs program only runs EECBS on one instance and
generates one line in test.csv, test.csv does not directly provide the
numbers of successful and total instances. But these two numbers can be
easily counted via a simple script (or even Excel)
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AMBF57S2DGF3JUG3FOV6ZZDTZS55ZANCNFSM5AVM652Q>
.
|
|
Hi Weike,
1. An instance consists of a graph and a set of agents, each with given
start and target locations.
2. No. The map is the same. Only the numbers of the agents and their start
and goal locations are different.
3. The time limit is for a single instance.
Best,
Jiaoyang
…On Thu, Nov 18, 2021 at 6:16 AM Aceyli ***@***.***> wrote:
Thank you for your rapid explanation about the *EECBS*. I also want to
disturb you, and I would like to ask the following questions:
1. Does an instance refer to a map composed of the starting positions, goal
positions, and obstacle positions of multiple agents?
2. In the experiment, the success rate of more than 200 instances is
calculated and counted within a limited time. Does it mean that the
algorithm must calculate and count the success rate of more than 200
different maps within a limited time?
3. Is the time limit the upper limit for testing a single instance? Or is
the total time limit for testing multiple instances?
Best,
Weike
Jiaoyang-Li ***@***.***> 于2021年7月26日周一 上午9:54写道：
> Since each run of the eecbs program only runs EECBS on one instance and
> generates one line in test.csv, test.csv does not directly provide the
> numbers of successful and total instances. But these two numbers can be
> easily counted via a simple script (or even Excel)
>
> —
> You are receiving this because you authored the thread.
> Reply to this email directly, view it on GitHub
> <#2 (comment)>
<https://urldefense.com/v3/__https://github.com/Jiaoyang-Li/EECBS/issues/2*issuecomment-886313355*3E__;IyU!!LIr3w8kk_Xxm!4RmwXBoU5RV4l6JjndUtgnZLwFR8BYLDea8TBysYKDYV7ifpgZkEAQRiPYuWtTw$>
,
> or unsubscribe
> <
https://github.com/notifications/unsubscribe-auth/AMBF57S2DGF3JUG3FOV6ZZDTZS55ZANCNFSM5AVM652Q>
<https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/AMBF57S2DGF3JUG3FOV6ZZDTZS55ZANCNFSM5AVM652Q*3E__;JQ!!LIr3w8kk_Xxm!4RmwXBoU5RV4l6JjndUtgnZLwFR8BYLDea8TBysYKDYV7ifpgZkEAQRi1QdXKFU$>
> .
>
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<https://urldefense.com/v3/__https://github.com/Jiaoyang-Li/EECBS/issues/2*issuecomment-972904848__;Iw!!LIr3w8kk_Xxm!4RmwXBoU5RV4l6JjndUtgnZLwFR8BYLDea8TBysYKDYV7ifpgZkEAQRiqJzFqi8$>,
or unsubscribe
<https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/AHULK5R35FTQQ4V3JPXM6SDUMUDCHANCNFSM5AVM652Q__;!!LIr3w8kk_Xxm!4RmwXBoU5RV4l6JjndUtgnZLwFR8BYLDea8TBysYKDYV7ifpgZkEAQRib3Mu6_o$>
.
Triage notifications on the go with GitHub Mobile for iOS
<https://urldefense.com/v3/__https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675__;!!LIr3w8kk_Xxm!4RmwXBoU5RV4l6JjndUtgnZLwFR8BYLDea8TBysYKDYV7ifpgZkEAQRiIbDSt64$>
or Android
<https://urldefense.com/v3/__https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign*3Dnotification-email*26utm_medium*3Demail*26utm_source*3Dgithub__;JSUlJSU!!LIr3w8kk_Xxm!4RmwXBoU5RV4l6JjndUtgnZLwFR8BYLDea8TBysYKDYV7ifpgZkEAQRi088oO0Q$>.
|
|
Hi Jiaoyang |
|
The explanation is on the MAPF benchmark website: https://movingai.com/benchmarks/formats.html |
|
Hi Jiaoyang, please reply if possible
Actually my main doubt is that when we run the code through command line
argument that is given in you GitHub repo, the outputs are paths.txt file
and test.csv file, so in .scen file there are total 400 rows/entries , but
in paths.txt file the paths of 50 agents are shown ....so what are those
400 rows indicating in .scen file?
Best
Vinayak
…On Sat, 26 Feb, 2022, 1:50 am Jiaoyang-Li, ***@***.***> wrote:
The explanation is on the MAPF benchmark website:
https://movingai.com/benchmarks/formats.html
—
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AGLDHYHNII5TSILTAC45IDTU47QA3ANCNFSM5AVM652Q>
.
Triage notifications on the go with GitHub Mobile for iOS
<https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675>
or Android
<https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
You are receiving this because you commented.Message ID:
***@***.***>
|
|
The input command specifies the number of agents by k. Then we only take the first k rows in the scen file as the start and goal locations of the agents. So if you set k=50 in the input command, you will only get paths of 50 agents in the output files. |
|
Hi Jiaoyang, |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
How to output the success rate by running "driver.cpp" file?
The text was updated successfully, but these errors were encountered: