Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Table discovery through metadata #41

Closed
wants to merge 2 commits into from
Closed

Conversation

bertfrees
Copy link
Member

@bertfrees bertfrees commented Feb 10, 2015

In todo:Including metadata in table headers (EDIT: can now be found here) I propose a table header format that can contain metadata about the table, for two use cases:

  • table discovery
  • metadata for user interfaces and localization

This issue addresses the first use case only.

To do:

  • basic feature parsing and match algorithm
  • key and value normalization
  • give features that are defined first in a query more weight
  • support "!" for marking important features
  • special handling of "locale"
  • special handling of "min-grade" etc.
  • fuzzy matching
  • decide on standard field names and add metadata to tables

Related:

@bertfrees bertfrees self-assigned this Feb 4, 2015
@bertfrees bertfrees added this to the 2.8.0 milestone Feb 4, 2015
@bertfrees
Copy link
Member Author

bertfrees commented Feb 5, 2015

Initial design proposal (EDIT: can now be found here)

Some more thinking needs to be put in it, for example the "language" field should have more weight than the "country" field. One solution is to give fields that are defined first more weight.

Instead of a comma separated list of directories, lou_indexTables now
accepts an array of table names which are resolved to files.

If lou_indexTables has not been called before lou_findTable,
LOUIS_TABLEPATH will be indexed instead of simply failing.
@bertfrees
Copy link
Member Author

I will merge this basic implementation in the hope people will start using it and I will get more feedback that way.

@bertfrees
Copy link
Member Author

We should announce this as beta because the API is subject to change (maybe add a comment in liblouis.h as well?)

@egli
Copy link
Member

egli commented May 22, 2015

good idea

bertfrees added a commit that referenced this pull request May 22, 2015
@bertfrees
Copy link
Member Author

Rebased and merged. Will keep this issue open for a while though.

@egli egli modified the milestones: 2.6.4, 2.6.3 Jun 1, 2015
@egli egli modified the milestones: 2.6.4, 2.6.5 Aug 31, 2015
@egli egli modified the milestones: 2.6.6, 2.6.5 Dec 1, 2015
@egli egli modified the milestones: 2.6.6, 3.1 Jun 9, 2016
@bertfrees bertfrees closed this Jul 1, 2016
@bertfrees bertfrees deleted the bfrees_table_find branch July 1, 2016 09:41
@bertfrees
Copy link
Member Author

  • decide on standard field names and add metadata to tables

This is a start: https://github.com/liblouis/liblouis/wiki/Table-discovery-based-on-table-metadata#standard-metadata-tags.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants