Skip to content
This repository has been archived by the owner on Feb 21, 2024. It is now read-only.

index sync creates data files for slice counts of (all?) databases #137

Closed
travisturner opened this issue Nov 3, 2016 · 2 comments
Closed

Comments

@travisturner
Copy link
Member

Steps to recreate:

Against a completely empty Pilosa instance, run the following:

curl -X POST "http://127.0.0.1:15000/query?db=wideDB" -d 'SetBit(id=10, frame="foo", profileID=1)'
curl -X POST "http://127.0.0.1:15000/query?db=wideDB" -d 'SetBit(id=10, frame="foo", profileID=10000000)'
curl -X POST "http://127.0.0.1:15000/query?db=narrowDB" -d 'SetBit(id=20, frame="foo", profileID=1)'
curl -X POST "http://127.0.0.1:15000/query?db=narrowDB" -d 'SetBit(id=20, frame="foo", profileID=1300000)'

This creates two databases.
wideDB contains data in slices 0 and 9
narrowDB contains data in slices 0 and 1

The data file tree looks like this:

├── narrowDB
│   ├── data
│   └── foo
│       ├── 0
│       ├── 0.cache
│       ├── 1
│       ├── 1.cache
│       └── data
└── wideDB
    ├── data
    └── foo
        ├── 0
        ├── 0.cache
        ├── 9
        ├── 9.cache
        └── data

After index sync runs, the data file tree looks like this:

├── narrowDB
│   ├── data
│   └── foo
│       ├── 0
│       ├── 0.cache
│       ├── 1
│       ├── 1.cache
│       ├── 2
│       ├── 3
│       ├── 4
│       ├── 5
│       ├── 6
│       ├── 7
│       ├── 8
│       ├── 9
│       └── data
└── wideDB
    ├── data
    └── foo
        ├── 0
        ├── 0.cache
        ├── 1
        ├── 2
        ├── 3
        ├── 4
        ├── 5
        ├── 6
        ├── 7
        ├── 8
        ├── 9
        ├── 9.cache
        └── data

Notice that narrowDB now contains 10 slices, even though only wideDB should contain 10 slices.

@travisturner travisturner self-assigned this Nov 17, 2016
@travisturner
Copy link
Member Author

This will get resolved with the db-specific MaxSlice code that I'm working on.

@travisturner
Copy link
Member Author

This is addressed by #152

tgruben pushed a commit to tgruben/pilosa that referenced this issue Sep 4, 2019
Automatically deduce the CSV LineDeserializer
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant