Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tensorflow #7470

Merged
merged 192 commits into from Oct 5, 2020
Merged

Tensorflow #7470

merged 192 commits into from Oct 5, 2020

Conversation

nohayassin
Copy link
Contributor

Adding Tensorflow wrapper.
Track on: DSO-15262

@ev-mp ev-mp mentioned this pull request Oct 4, 2020
@nohayassin nohayassin changed the base branch from master to development October 4, 2020 11:08
Copy link
Collaborator

@ev-mp ev-mp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well done - several cosmetic fixes

feed_dict={image_tensor: image_expanded})
```

Finally we will assign random persistent color to each detection class and draw a bounding box around the object. We filter out low confidence predictions using `score` output.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Finally,

verts = np.asanyarray(points.get_vertices()).view(np.float32).reshape(-1, W, 3) # xyz
```

This allows us to query XYZ coordinates of each detected object and to seperate individual coordinates (in meters):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

separate


## Part 3 - Deploying TensorFlow model using OpenCV

While TensorFlow is convinient to install and use, it is not as convinient as OpenCV. OpenCV is ported to most platforms and is well optimised for various types of CPUs. It also comes with built-in DNN module capable of loading and using TensorFlow models without having TensorFlow (or its dependencies) installed.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

convenient

Unet offers significant advantages compared to classic autoencoder architecture, improving edge fidelity (see image below).

![foxdemo](images/Unet.PNG)
###### The image is taken from the article reffered above.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

referred

very good at detecting more and more features, the first few layers of a convolution network capture a very small semantic information and lower level
features, as you go down these features become larger and larger, but when we throw away information the CNN
knows only approximate location about where those features are.
When we upsample we get the lost information back (by the concatination process)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

concatenation

#### Data Augmentation
To help the neural network learning image features we decide to crop input images into tiles of 128x128 pixels.

Each ground truth image has a corressponding depth and infrared image. Given that, the dataset is augmented as following:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

corresponding

wrappers/tensorflow/README.md Outdated Show resolved Hide resolved
wrappers/tensorflow/README.md Outdated Show resolved Hide resolved
wrappers/tensorflow/README.md Outdated Show resolved Hide resolved
wrappers/tensorflow/README.md Outdated Show resolved Hide resolved
Copy link
Collaborator

@ev-mp ev-mp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well done!

@ev-mp ev-mp merged commit 86967a1 into IntelRealSense:development Oct 5, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants