Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

experimental setup for exp34-epfl-soldiers tests #1

Closed
doug-leith opened this issue Sep 12, 2020 · 5 comments
Closed

experimental setup for exp34-epfl-soldiers tests #1

doug-leith opened this issue Sep 12, 2020 · 5 comments

Comments

@doug-leith
Copy link

Would it be possible to clarify the environment where the data in the exp34-epfl-soldiers tests was collected. The README mentions a train, supermarket etc but it also says "This situation simulates an SBB 2nd class train compartment.” which suggests the train data at least was not collected in an actual train. The images in the computer-vision folder also suggest this (although its not clear what these images represent). Were the tests carried out in an open space with a train carriage mocked up by arranging chairs and tables? And similarly for the other tests? Or was the data collected in an actual train, an actual supermarker, and actual club etc? Thanks.

@gannimo
Copy link
Member

gannimo commented Sep 12, 2020

Experiment 34 was conducted in the EPFL BC atrium, a 40m by 15m open space inside a large office building. The ground truth evaluation was done using a visual computing setup that mapped subjects to x/y coordinates on a grid. Such dynamic ground truth measurements are not reasonably possible in tight spaces and cumbersome to setup.

To validate these dynamic experiments we also conducted static experiments in real environments (e.g., in an actual tram) with similar results. We therefore are confident that our measurements hold up as conducted.

@pdehaye
Copy link

pdehaye commented Sep 12, 2020

This would, for instance, have been the setup mocking a train (included because not readily visible to people, who would have to download and open the zip file)

ground_train_undist

@doug-leith
Copy link
Author

Could you leave this issue open so that it remains visible on github and others can comment on it, thanks.

@doug-leith
Copy link
Author

Would it be possible to also post the measurements taken on an actual tram/train and details of the setup, rather than just asserting that they agree with the mocked up tests. Thanks.

@gannimo
Copy link
Member

gannimo commented Sep 13, 2020

Thanks for the discussion. I added a note regarding the location/setup of the experiments in the corresponding README files. As the setup of past experiments will not change and given that the details about location are now included in the setup, I don't see a need to reopen the original issue.

@doug-leith , regarding other experiments, see issue #2 opened by @pdehaye.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants