Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 1.1.0 #584

Merged
merged 145 commits into from
Dec 14, 2021
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
145 commits
Select commit Hold shift + click to select a range
2b2567f
Add more comments on the code.
CraigMiloRogers Oct 19, 2021
5e7f038
The primary output file is not necessarily standard output.
CraigMiloRogers Oct 19, 2021
2b3a885
Lifting strings with language filtering.
CraigMiloRogers Oct 20, 2021
65779b6
Add prioritized language processing.
CraigMiloRogers Oct 21, 2021
cc03db2
Merge remote-tracking branch 'origin/issue/511/add-labels-language-fi…
CraigMiloRogers Oct 25, 2021
6cef641
Merge branch 'issue/532/count-records' into dev
CraigMiloRogers Oct 25, 2021
6bf2399
remove table linker index to another notebook
saggu Oct 27, 2021
11caa03
move table linker to anothernotebook
saggu Oct 27, 2021
55239a5
add notebook for table-linker
saggu Oct 27, 2021
e6f2db1
add required files
saggu Oct 27, 2021
4028faf
cleanup notebooks
saggu Oct 27, 2021
0b460db
Add 'cls.' to access class members.
CraigMiloRogers Oct 29, 2021
50908d9
Use the corrected version of mgzip.
CraigMiloRogers Oct 29, 2021
180224d
must end with blank line
Oct 31, 2021
70fa687
Merge branch 'dev' of https://github.com/usc-isi-i2/kgtk into dev
Oct 31, 2021
693cbbf
fix input path, don't move outputs
Oct 31, 2021
591a2a7
Document SQLITE_TMPDIR environment variable
chalypso Nov 1, 2021
e1e9531
Merge branch 'dev' of https://github.com/usc-isi-i2/kgtk into dev
Nov 1, 2021
78ca13e
Implement len and substring.
CraigMiloRogers Nov 1, 2021
a400906
Merge remote-tracking branch 'origin/issue/560/substring' into dev
CraigMiloRogers Nov 1, 2021
deeccfb
Support alternating --old/--new options.
CraigMiloRogers Nov 2, 2021
a6d5245
Fix --show-options.
CraigMiloRogers Nov 2, 2021
0e4c2c1
Optionally rename columns when reordering them. All columns must be …
CraigMiloRogers Nov 2, 2021
28187c5
Add --overwrite.
CraigMiloRogers Nov 2, 2021
599aa68
Improve the exception handling.
CraigMiloRogers Nov 2, 2021
14cbc6f
set multiprocessing method to fork
saggu Nov 2, 2021
3ffe15f
mac specific defaults
saggu Nov 2, 2021
01757bd
Merge branch 'dev' of https://github.com/usc-isi-i2/kgtk into dev
saggu Nov 2, 2021
f92ea08
add notebook to import wikidata
saggu Nov 2, 2021
f46d35a
python version
saggu Nov 2, 2021
61a9823
en labels only, add note to import all languages
saggu Nov 3, 2021
1913bce
fix typo
saggu Nov 3, 2021
697fde5
Fix the default value of --overwrite due to cut-and-paste error.
CraigMiloRogers Nov 3, 2021
6317562
Add files via upload
GrantXie Nov 4, 2021
841badf
Auto-configure temp dir to better support large data imports
chalypso Nov 4, 2021
6a66c51
Updated doc for temp directory handling
chalypso Nov 4, 2021
885cab8
Added short forms for graph cache options
chalypso Nov 4, 2021
e408e18
Support "stdin" as an implicit name for inputs from stdin
chalypso Nov 5, 2021
fd938e2
Fix documentation for inputs from stdin
chalypso Nov 5, 2021
af1d866
Implement read-only processing
chalypso Nov 5, 2021
4adb8b8
Support new read-only processing
chalypso Nov 5, 2021
2edbe6d
Support new read-only processing
chalypso Nov 5, 2021
0c01093
Document read-only processing
chalypso Nov 5, 2021
abf030b
Enhance substring with --to-string.
CraigMiloRogers Nov 5, 2021
9dc2848
Merge branch 'dev' of github.com:usc-isi-i2/kgtk into dev
CraigMiloRogers Nov 5, 2021
ef61922
Create community-detection
GrantXie Nov 9, 2021
9383f87
Update community-detection
GrantXie Nov 9, 2021
0c3b6b0
Update community-detection
GrantXie Nov 9, 2021
9e83301
Update community-detection
GrantXie Nov 9, 2021
aa83cdc
Update community-detection
GrantXie Nov 9, 2021
010dc5a
Create community-detection
GrantXie Nov 9, 2021
3601663
Update community-detection
GrantXie Nov 9, 2021
263b635
Update community-detection
GrantXie Nov 9, 2021
64e5523
Update community-detection
GrantXie Nov 9, 2021
6aca843
Update community-detection
GrantXie Nov 9, 2021
66e5da0
Update community-detection
GrantXie Nov 9, 2021
4287522
Update community-detection
GrantXie Nov 9, 2021
2e87c5c
Update community-detection
GrantXie Nov 9, 2021
ba56b7c
Create community-detection.md
GrantXie Nov 9, 2021
968e194
Delete community-detection
GrantXie Nov 9, 2021
91e43b7
Update community-detection.md
GrantXie Nov 9, 2021
beff58a
Added shortest distance for breadth first search
GrantXie Nov 9, 2021
04c863d
Fixed a bug in blockmodel
GrantXie Nov 9, 2021
c76b864
Refactor calc for improved understandability, extensibility, and effi…
CraigMiloRogers Nov 10, 2021
1d93189
Implement group-by calculations.
CraigMiloRogers Nov 10, 2021
81994b4
Give more control over the group-by output record.
CraigMiloRogers Nov 10, 2021
b207eb4
Correct argument checks on several 2-arg operations. Add several num…
CraigMiloRogers Nov 10, 2021
2b9a9c7
Need anothe rlevel of parens in validating argument combinations.
CraigMiloRogers Nov 10, 2021
edf7167
Make --into optional if --filter is supplied for operators producing …
CraigMiloRogers Nov 11, 2021
3976ac9
Recognize .csv files based on extension.
CraigMiloRogers Nov 11, 2021
bd4247b
Add files via upload
GrantXie Nov 11, 2021
52a4667
modernalize, clean
saggu Nov 12, 2021
657a9da
Merge branch 'dev' of https://github.com/usc-isi-i2/kgtk into dev
saggu Nov 12, 2021
a987ef9
Fix in documentation
dgarijo Nov 12, 2021
40b0c05
COnfigure for home workstation.
CraigMiloRogers Nov 15, 2021
bfc0a8a
Merge branch 'dev' of github.com:usc-isi-i2/kgtk into dev
CraigMiloRogers Nov 15, 2021
8ad614d
Fix detection of compressed CSV files.
CraigMiloRogers Nov 15, 2021
e1cfe4c
Document CSV input file processing.
CraigMiloRogers Nov 15, 2021
8ea81b6
Show an example of reading a CSV file.
CraigMiloRogers Nov 15, 2021
ee363d8
Added distance and dist-col-name options
GrantXie Nov 16, 2021
50a6239
Accept strings as well as Paths.
CraigMiloRogers Nov 16, 2021
fbe959d
Implement kgtk --mode.
CraigMiloRogers Nov 16, 2021
00647c8
Fix improper indentation.
CraigMiloRogers Nov 17, 2021
13b25f3
Add --write-namespaces.
CraigMiloRogers Nov 17, 2021
744f49b
Add an example for --write-namespaces=FALSE.
CraigMiloRogers Nov 17, 2021
04f2c99
Fix indentation problem.
CraigMiloRogers Nov 17, 2021
a61cc00
Add an upper case enum list.
CraigMiloRogers Nov 17, 2021
faee472
Use the default mode.
CraigMiloRogers Nov 17, 2021
08c3b92
Merge branch 'dev' of github.com:usc-isi-i2/kgtk into dev
CraigMiloRogers Nov 17, 2021
3edcad2
Improved parallel pipeline segments.
CraigMiloRogers Nov 17, 2021
18ab6bb
Do not close standard output.
CraigMiloRogers Nov 18, 2021
04bb89c
Implement parallel pipes.
CraigMiloRogers Nov 18, 2021
f39d099
Fix bug in --progress-debug.
CraigMiloRogers Nov 18, 2021
d4f4cc7
Document the interaction between --props and --inverted-props.
CraigMiloRogers Nov 18, 2021
c0edb7b
Try harder to terminate pipelines.
CraigMiloRogers Nov 18, 2021
5019515
Merge.
CraigMiloRogers Nov 18, 2021
66ddf1c
Implement --overwrite more efficiently. Impoement --overwrite for su…
CraigMiloRogers Nov 18, 2021
b16dc0f
Fix editing error.
CraigMiloRogers Nov 19, 2021
0fa465c
Add some string manipulation functions.
CraigMiloRogers Nov 19, 2021
2272bd8
Add parsers for dates, strings, and numbers.
CraigMiloRogers Nov 19, 2021
6d8a871
Remove inneeded item.
CraigMiloRogers Nov 19, 2021
089f449
Add a fast path for date extraction.
CraigMiloRogers Nov 19, 2021
49e645e
Change --default-mode to --kgtkmode to avoid conflict. Use /. instea…
CraigMiloRogers Nov 19, 2021
c5ae263
use configure KGTK
saggu Nov 22, 2021
6cf5371
Merge pull request #1 from usc-isi-i2/dev
GrantXie Nov 23, 2021
8ef1af2
Added a distance column (with options)
GrantXie Nov 23, 2021
589bb3f
Create CONTRIBUTING.md
dgarijo Nov 23, 2021
10ebe3b
Add files via upload
GrantXie Nov 23, 2021
5fba113
Merge pull request #580 from GrantXie/dev
CraigMiloRogers Nov 23, 2021
76c9c42
Delete community-detection.py
GrantXie Nov 23, 2021
4436e9f
Delete community-detection.md
GrantXie Nov 23, 2021
9650885
Merge branch 'dev' into dev_2
GrantXie Nov 23, 2021
eaa7c41
Merge pull request #581 from GrantXie/dev_2
CraigMiloRogers Nov 30, 2021
dfb90ca
Fix typo in error message.
CraigMiloRogers Dec 1, 2021
482865c
Refactored query option normalization to enable reuse in API
chalypso Dec 4, 2021
2b8cff1
New query definition option that supports shell-style command syntax
chalypso Dec 4, 2021
bb77011
update build table linker command
saggu Dec 6, 2021
322cda6
update python version
saggu Dec 6, 2021
eda87da
Merge branch 'dev' of https://github.com/usc-isi-i2/kgtk into dev
saggu Dec 6, 2021
a45b457
recommended python version is 3.9
saggu Dec 6, 2021
ca91eea
update python and kgtk version
saggu Dec 6, 2021
31914fe
update release version
saggu Dec 6, 2021
3590b41
fix broken link
saggu Dec 6, 2021
8ed7cff
change python recommendation to 3.9
saggu Dec 6, 2021
ec83800
add link to docker installation
saggu Dec 6, 2021
675b9f8
add languages filter
saggu Dec 7, 2021
c8a0038
Merge branch 'dev' of https://github.com/usc-isi-i2/kgtk into dev
saggu Dec 7, 2021
db07930
Summarize lists.
CraigMiloRogers Dec 7, 2021
8f24378
Fix a typo in a comment. Note places where quanties might be support…
CraigMiloRogers Dec 7, 2021
38b5682
Merge pull request #2 from usc-isi-i2/dev
GrantXie Dec 7, 2021
be641a7
Add files via upload
GrantXie Dec 7, 2021
97538e8
Add files via upload
GrantXie Dec 7, 2021
8f925d9
Merge pull request #586 from GrantXie/dev_1
CraigMiloRogers Dec 7, 2021
7a178c0
Use continue to reduce indentation. Support quantities for abs_op.
CraigMiloRogers Dec 8, 2021
34a6384
Support quantities in --do minus.
CraigMiloRogers Dec 8, 2021
1d2f74b
Document an inconsistency in combining numbers and quantities.
CraigMiloRogers Dec 8, 2021
dc49e48
Extract dates.
CraigMiloRogers Dec 10, 2021
53e8ca7
Add class methods to assist in converting Python bools to/from KGTK b…
CraigMiloRogers Dec 10, 2021
c2cd525
Add a convenience method for writing KGTK from Python values.
CraigMiloRogers Dec 10, 2021
d84629b
Add helper routines for building KGTK date_and_times and location_coo…
CraigMiloRogers Dec 11, 2021
d4ecd7b
Improve the format-driven KGTK writer.
CraigMiloRogers Dec 11, 2021
681f378
Make the format optional. Detect excess values.
CraigMiloRogers Dec 11, 2021
07fdb8d
Fix typo.
CraigMiloRogers Dec 11, 2021
ef764ae
Fix typos.
CraigMiloRogers Dec 11, 2021
f418493
remove docker lite
saggu Dec 14, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
# How to contribute to the Knowledge Graph Toolkit

Third-party contributions are welcome to keep improving KGTK and support
additional features. In order to include new contributions, please follow
the guidelines below.

## Before you start
Please check the open issues related to your contribution, as your contribution
may be under discussion.

## Making changes

* Create a new branch with the new feature or bug you are addressing. Please try
to keep features modular.
* Clone the `dev` branch, as it is the most updated one in the repository.
* Make commits of logical and atomic units.
* Do pull requests **only** against the `dev` branch. Please avoid working directly
on the `main` branch.
* Specify which issues does your pull request address.
8 changes: 6 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ Next, execute the following steps to install the latest stable release
of KGTK:

```bash
conda create -n kgtk-env python=3.8
conda create -n kgtk-env python=3.9
conda activate kgtk-env
conda install -c conda-forge graph-tool
conda install -c conda-forge jupyterlab
Expand All @@ -49,7 +49,11 @@ python -m spacy download en_core_web_sm
Please see our [installation document](/docs/install.md) for more details. If
you encounter problems with your installation, or are interested in a detailed
explanation of these commands, [read more about the installation procedure
here](KGTK-Installation-Procedure-Details.md).
here](docs/KGTK-Installation-Procedure-Details.md).

### Installing KGTK with Docker

Please refer to [this document](docs/install-with-docker.md) for installing KGTK with Docker

## Getting started

Expand Down
29 changes: 0 additions & 29 deletions docker/lite/Dockerfile

This file was deleted.

37 changes: 0 additions & 37 deletions docker/lite/readme.md

This file was deleted.

18 changes: 9 additions & 9 deletions docs/KGTK-Installation-Procedure-Details.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ Here is the standard set of steps to install KGTK and the
KGTK Jupyter Notebooks:

```
conda create -n kgtk-env python=3.8
conda create -n kgtk-env python=3.9
conda activate kgtk-env
conda install -c conda-forge graph-tool
conda install -c conda-forge jupyterlab
Expand All @@ -25,12 +25,12 @@ cd kgtk-notebooks
The following sections discuss the details behind the installation
steps.

### We Recommend Python 3.8
### We Recommend Python 3.9

Some of KGTK's features require Python 3.8 or later. As of 12-Oct-2021, Python
Some of KGTK's features require Python 3.9 or later. As of 12-Oct-2021, Python
version 3.8, 3.9, and 3.10 are available. We currently develop and test using
Python 3.8, and are not routinely checking for compatibility with later versions
of Python. At the present time, we recommend running KGTK on Python 3.8.
Python 3.9, and are not routinely checking for compatibility with later versions
of Python. At the present time, we recommend running KGTK on Python 3.9.

This is not to say that KGTK will fail to run on a later version of
Python. However, the removal of deprecated features, or unxpected
Expand All @@ -42,7 +42,7 @@ the KGTK team.
### We Recommand a Virtual Environment

Some of KGTK's advanced commands depend upon Graph-tool. Installing Graph-tool
is problematic using Python 3.8 outside of a virtual environment. Thus: **the
is problematic using Python 3.9 outside of a virtual environment. Thus: **the
advised installation path is by using a virtual environment**,
such as [Mamba](https://github.com/mamba-org/mamba#readme)
or [Conda](https://docs.conda.io/en/latest/).
Expand All @@ -69,7 +69,7 @@ different name, substituting it where `kgtk-env` appears in
these and following commands:

```bash
conda create -n kgtk-env python=3.8
conda create -n kgtk-env python=3.9
```

## Activate Your Conda Environment
Expand Down Expand Up @@ -133,11 +133,11 @@ pip --no-cache install -U kgtk

> You may sometimes need to install a specific release of KGTK, such as
a prerelease that incorporates the latest changes. For example,
if you need to install KGTK release `0.8.6b0`, use the following
if you need to install KGTK release `1.1.0`, use the following
`pip` command instead of the `pip` command shown above:

```bash
pip --no-cache install kgtk==0.8.6b0
pip --no-cache install kgtk==1.1.0
```

## Download the English Model of SpaCY
Expand Down
Loading