-
Notifications
You must be signed in to change notification settings - Fork 28
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How do I train my own dataset? #23
Comments
@iFimo Can you also give me some hints?
|
@dm-de thanks for the tip, but which one is the You can click on the little arrow at the end of my first post. There you will find Screenshot_1 with my Colmap output. Is this correct as it is? If it is correct, what would be the next command after i renamed the
Correct? Or does the first command have to be different?
Yes, of course, I tried it. Here - #22 (comment) |
hmmm |
fused.ply looks like dense cloud for me did you read this? more about colmap cli |
Hi, yes |
@lh-dm Thanks, yes I saw both. It was also just updated by @lfranke. @lfranke , great, well then I have the file. I tried:
But I also get the same incomplete result:
Or is that correct? At the end of the log, after it has gone through the cameras and images properly, I get the following error:
FULL LOG
What am I doing wrong? |
@iFimo I ran into the same issue as you last night. The issue is that colmap2adop is written to work in Linux. Fortunately, there is a quite easy workaround. Here is what I did on my Windows 11 machine: Requirement: Git Bash I also used the colmap2adop.sh script which you will need to edit with a text editor ahead of time (I used Notepad++) Edit colmap2adop.sh
Run the conversion script
Everything should work from there! Just a tip, pasting into Git Bash is Shift+Ins not Ctrl+V Last note, if you are going to train the data, ensure you edit the config file to find your custom data. |
Yeah!!!! thank you very much! It works with that.
Right, there had to be a 0. Very cool. Then I'll probably train a complete set tomorrow and run Coolmap on my large image set tonight. |
I am training my first model now. I should have ran one of the test datasets first. It is taking quite a while on 315 images, 9.7 million point dense cloud. I left parameters at default. Not sure if I was suppose to modify a parameter for an outside scene. |
So here's short feedback. Everything now works on Windows from training to the viewer. Many thanks again to @jonstephens85 and all the other helpers. One last question/request for @lfranke . For me too, a PLY export is crucial in order to continue using it in other software. Maybe you've already answered the question somewhere else and I missed it. Is there a rough timetable for when something like this might happen? |
This is currently a bit difficult, as our point colors/descriptors have no real RGB meaning without the neural network convolutions afterwards. It would be possible to export a ply with point descriptors and point sizes, however the network.pth would still be required to get the weights for the neural network. |
Hello, I used my own Colmap data set and converted the data format through./colmap2adop.sh [input_directory] [output_directory]. Then./build/bin/train --config configs/train_normalnet.ini trains my data, but when I look at the results, there is only one graph, which is different from the visualization of the official data set. Why? |
First of all, some feedback.
After days of trial and error, @dm-de provided the final step to compile it with a running viewer. That saved me.
Originally posted by @dm-de in #15 (comment)
And it looks really amazing. Great work, @lfranke + team!
With the “new” instructions in the readme, everything works fine.
Anyway, I have two comments:
1:
For Windows conda prompt shell, I can’t use
./build/bin/RelWithDebInfo/viewer.exe --scene_dir scenes/tt_train
.I have to use the full path, because the conda prompt shell, e.g.,
C:\Users\USERNAME\TRIPS\build\bin\RelWithDebInfo/viewer.exe --scene_dir scenes/tt_train
.The same goes for the training command.
This could be added to the readme file, as well.
2:
It’s a bit confusing to have a scene named
“train”
and the training command is also called“train”
. Maybe you could rename the whole“train” scene
to something like“locomotive”
(in the readme also). So that it is clear when it is the"train" command
and when it is the"train" scene
="locomotive" scene
.Now the training.
I've created really cool stuff with 3D Gaussian Splatting, but I'm still failing with TRIPS at the moment.
I've tried a lot and tried to write everything here, but I think reading all of this will be more confusing and time-consuming than helpful.
It starts with the "scenes" folder and the "experiments" folder. I thought the “scenes” folder was for raw training data and the “experiments” folder was for training results. However, this doesn't seem right as the viewer only needs the "scenes" folder to work.
So how do these two folders relate to each other and what is which one for?
And much more importantly:
Can someone explain step by step with commands for windows conda prompt shell what i have to do, to train with my own training data, i.e. my photos?
Please start with colmap, because I can't get a "dense_point_cloud.ply" file there, which I seem to need. I get several .ply files, but no
"dense_point_cloud.ply"
. I have COLMAP-3.9.1-windows-cuda.If you are still interested in how I tried to start the training but failed. Click here.
First of all, I tried to train the playground scene, and this seems works fine.
But I can't manage to prepare my own images correctly.
I have Colmap "COLMAP-3.9.1-windows-cuda", where I use the
“Automatic reconstruction”
. I tried a scene with 22 pictures just to understand the workflow. My scene called“audih3”
in this case.After automatic reconstruction in Colmap, I save the project to my ColmapScenes folder.
Here’s a screenshot of what I get.
PS: I work on Windows 10 (screenshot just made with Mac to see the file structure).
Screenshot_1: Colmap output.
![Screen 1](https://private-user-images.githubusercontent.com/62717097/304734363-ff239c00-132e-455c-9d27-29cd71514dfb.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjA3NjE4NzcsIm5iZiI6MTcyMDc2MTU3NywicGF0aCI6Ii82MjcxNzA5Ny8zMDQ3MzQzNjMtZmYyMzljMDAtMTMyZS00NTVjLTlkMjctMjljZDcxNTE0ZGZiLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzEyVDA1MTkzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBmOTI3NGI0MTVlZjVkMGIyOWEyODI2ODA4MDRhMWQ3ZDgyOTFjYzNmOTE2YTUxZDZlZWJiZjRiMmVmZWY5YzQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.CNsS43qBZWwE4x3NlfTkpOt48uBnY5MikdJcn2-rZm0)
I put the ColmapScenes folder in my TRIPS root (makes things easier for me).
Then I used the following commands in my TRIPS root folder:
What I am missing is the
“dense_point_cloud.ply”
in my Colmap output, the command is looking for? Shouldn´t it be there? Is it saved with another filename and do I need to rename any of the existing files?When I move on and ignore that there is no
“dense_point_cloud.ply”
, the command will create att_audih3
folder in my\Trips\scenes
and creates some data there.Screenshot_2: Created data in
![Screen 2](https://private-user-images.githubusercontent.com/62717097/304735255-6d692468-d4b6-4faf-adc6-74d9f6bd4d05.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjA3NjE4NzcsIm5iZiI6MTcyMDc2MTU3NywicGF0aCI6Ii82MjcxNzA5Ny8zMDQ3MzUyNTUtNmQ2OTI0NjgtZDRiNi00ZmFmLWFkYzYtNzRkOWY2YmQ0ZDA1LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzEyVDA1MTkzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWMzOGVjYzhkOTc2NTA4YmM5YjQ2ZjJiOGQ4YmUxYzQ1MDAzZjUxZTljMmI4YTk2NGY1NWNkYmQxZjEzOGM3ZDAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.E4mAO3nHUKpDcxoELG51VJJ512WgcE-ACwIq42ilWTQ)
scenes
folderHere’s a list, which files I would expect, and which were created.
(
source: https://github.com/lfranke/TRIPS/blob/main/scenes/README.md
)Why is there no
"point_cloud.ply"
and no"poses.txt"
? Will this be created, when I have the"dense_point_cloud.ply"
in my ColmapScenes folder?When I again ignore the missing files, do I then have to use:
Will this create a
"point_cloud.bin"
out of my"point_cloud.ply"
like it is in the pre-trained models?If everything is correct, I should then be able to execute the final command:
Am I correct?
Where are my mistakes?
I would be very thankful if someone could explain the training in detail.
The text was updated successfully, but these errors were encountered: