Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add self supervised depth completion. #711

Conversation

heyyxd
Copy link
Contributor

@heyyxd heyyxd commented Jan 8, 2024

No description provided.

Copy link
Collaborator

@wenmengzhou wenmengzhou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@@ -0,0 +1,34 @@
calib_time: 09-Jan-2012 13:57:47
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this file should be added to model directory rather than code library, even though this is data releated, which probably on fit for kitti dataset?

Tasks.self_supervised_depth_completion, module_name=Models.self_supervised_depth_completion)
class SelfSupervisedDepthCompletion(TorchModel):
"""SelfSupervisedDepthCompletion Class"""
def __init__(self, model_dir: str, *args, **kwargs):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

model is expected to be a subclass of TorchModel which should have init func to initiate the network of model, and call function which implements the forward process of the model. it seems this model implementation is more like a trainer

model_dir = inputs['model_dir']
source_dir = inputs['source_dir']
self.model.run(model_dir, source_dir)
return {OutputKeys.OUTPUT: 'Done'}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

image
as declared in outputs.py, the output of this pipeline should be an image with a key called 'output_image'


@PIPELINES.register_module(
Tasks.self_supervised_depth_completion, module_name=Pipelines.self_supervised_depth_completion)
class SelfSupervisedDepthCompletionPipeline(Pipeline):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"output": {
"type": "object",
"properties": {
"output": {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the key str and type should be the same as declared in outputs.py

@heyyxd heyyxd force-pushed the feature/add_self_supervised_depth_completion branch from 7730714 to 756a87a Compare January 25, 2024 07:38
@wenmengzhou wenmengzhou merged commit 158d72b into modelscope:master Feb 22, 2024
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants