Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 17 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -52,6 +52,23 @@ print("Number of tokens:", len(id2vec))
* [3467e9ca-ec11-444a-ba27-9fa55f5ee6c1](/id2vec/3467e9ca-ec11-444a-ba27-9fa55f5ee6c1.md)
* <default> [92609e70-f79c-46b5-8419-55726e873cfc](/id2vec/92609e70-f79c-46b5-8419-55726e873cfc.md)

## id_splitter_nn

Weights of the BiLSTM network to split source code identifiers.

Example:

```python
from sourced.ml.models.id_splitter import IdentifierSplitterNN
import modelforge.backends
id_splitter = IdentifierSplitterNN().load("522bdd11-d1fa-49dd-9e51-87c529283418", backend=modelforge.backends.create_backend())
id_splitter.split(identifiers)
```

1 model:

- <default> [522bdd11-d1fa-49dd-9e51-87c529283418](/id_splitter_nn/522bdd11-d1fa-49dd-9e51-87c529283418.md)

## topics
Topic modeling of Git repositories. All tokens are identifiers extracted from repositories and seen as indicators for topics. They are used to infer the topic(s) of repositories.

Expand Down
25 changes: 25 additions & 0 deletions id_splitter_nn/522bdd11-d1fa-49dd-9e51-87c529283418.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
# id_splitter_nn

Model that contains source code identifier splitter BiLSTM weights.

Example:

```python
from sourced.ml.models.id_splitter import IdentifierSplitterNN
import modelforge.backends
id_splitter = IdentifierSplitterNN().load("522bdd11-d1fa-49dd-9e51-87c529283418", backend=modelforge.backends.create_backend())
id_splitter.split(identifiers)
```

### References

- [Splitting source code identifiers using Bidirectional LSTM Recurrent Neural Network](https://arxiv.org/pdf/1805.11651.pdf)

| | |
| :------- | :------------------------------------------------------------------------------------------------------------------------- |
| ID | 522bdd11-d1fa-49dd-9e51-87c529283418 |
| Uploaded | 2019-04-12 10:59:58 |
| Version | 1.0.0 |
| File | https://storage.googleapis.com/models.cdn.sourced.tech/models%2Fid_splitter_nn%2F522bdd11-d1fa-49dd-9e51-87c529283418.asdf |
| Size | 8.7 MB |
| License | [O](D) |
Loading