Skip to content

Commit

Permalink
BibAuthorID: major update
Browse files Browse the repository at this point in the history 
* Multiprocessing in Daemon

    * Made Daemon multi processing ready
    * Fixed: Name removal issue in queue population
    * Surname regexp updates
    * Introduced hack for last names w/ len < 2. These will
      now be matched differently, since it would load too many names
      into the cluster.
    * Caching introduced to speed up the pid update
      process. Bibref/Bibrec pair will be cached in VA entity
    * dbquery update to withstand multiprocessing db access
    * dbquery update to offer distinct feature to close db connection

* Feature updates and bugfixes

    * Allows to configure bibauthorid to focus on one certain collections or all
    * Full unicode support
    * Support for Python module unidecode to auto-transliterate
      utf-8 encoded names.
    * Fix date conversion error for 0 date descriptions
    * Firefighting entries that are too long for the colum size.
      Truncation in effect accordingly.
    * Fix queue.remove incompatibility
    * Fix string partition on lastname only cases
    * Besides limiting to certain collections, now it's
      also possible to exclude collections entirely.
      HEPNames exclusion has been hard-coded so far and
      with new collections to disregard, this got moved
      in another, earlier, stage of the algorithm with
      new config options.
    * Save the session, save the world!!
    * ArXiv login procedures and welcome page
    * cmp arxiv user role defined
    * Rewritten UI from scratch
    * Various backend fixes
    * Rewritten internal authorization system
    * Claim/attribute others papers
    * RT ticketing support and management
    * ArXiv export according to RFC
    * Fixed relative vs. absolute imports ( fixes #465 )
    * New indexes in tables for more efficient queries
    * Make some config parameters user-modifiable ( fixes #468 )
        - Personid parameters are now in invenio.conf
	    - Standalone mode checking not to fail imports
	    - Pythonic arrays from csv in config file using convert_conf_option

* UI updates and redesigns

    * Dictionaries to configure button and link texts
    * Extended Access and permission control
    * arXiv export
    * Indexing authorids requires to determine the ID
      of a given author on a given record. A function has
      been added to make this request possible.
    * The indexing function gets imported by search engine.
      Removed search engine imports from header and moved to
      function calls.
    * Person search with canonical names/ids
    * Unfortunately, the session blob field is limited
      to 64K of data. Due to the bibref list in paper listings,
      this could be exceeded in collaboration papers. Fixed.
    * Bibauthorid: Counter-act "too many connections"
      Upon updating personid from algorithm, it may
      happen that the sql connection count quota
      was exceeded when threads ended too fast.
      Introduced a new method in dbquery to force
      connections to close.
    * Tought new canonical name/id to diverse functions to accept is as an ID
    * Optional browser cache killer
      Adds a switch to optionally kill the browser's cache
      using the killer on the person page leads to unneccesssary
      longer loading times.
    * Config switches to enable/disable parts of the UI
    * Removed JSON import dependency ( fixes #512 )
    * I18n for user-facing strings ( fixes #467 )
    * Guest, User and Operator views for each "Claim Your Paper",
      "Choose Her Papers", "Person Manager"
    * New Icon Set
    * New Styles
    * jQuery 1.5 compatible
    * Enriched Demo Personas ( fixes #469 )

Co-authored-by: Carli Samuele <samuele.carli@cern.ch>
  • Loading branch information
@WohthaN @tiborsimko
2 people authored and tiborsimko committed Mar 18, 2011
1 parent b1fba86 commit 0b3e811
Show file tree
Hide file tree
Showing 47 changed files with 6,188 additions and 2,392 deletions.
26 changes: 13 additions & 13 deletions Makefile.am
View file
Expand Up @@ -143,19 +143,19 @@ install-jquery-plugins: install-jquery-plugins
(cd ${prefix}/var/www/js && \
wget http://jqueryjs.googlecode.com/files/jquery-1.3.1.min.js && \
mv jquery-1.3.1.min.js jquery.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/jquery-1.4.4.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/ui/minified/jquery.effects.core.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/ui/minified/jquery.effects.highlight.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/ui/minified/jquery.ui.widget.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/ui/minified/jquery.ui.tabs.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/ui/minified/jquery.ui.slider.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/ui/minified/jquery.ui.sortable.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/ui/minified/jquery.ui.button.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/ui/minified/jquery.ui.dialog.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/ui/minified/jquery.ui.mouse.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/ui/minified/jquery.ui.draggable.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/ui/minified/jquery.ui.position.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.7/ui/minified/jquery.ui.resizable.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.10/jquery-1.4.4.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.10/ui/minified/jquery.effects.core.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.10/ui/minified/jquery.effects.highlight.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.10/ui/minified/jquery.ui.widget.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.10/ui/minified/jquery.ui.tabs.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.7.3/ui/minified/ui.slider.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.7.3/ui/minified/ui.sortable.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.10/ui/minified/jquery.ui.button.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.10/ui/minified/jquery.ui.dialog.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.10/ui/minified/jquery.ui.mouse.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.10/ui/minified/jquery.ui.draggable.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.10/ui/minified/jquery.ui.position.min.js && \
wget http://jquery-ui.googlecode.com/svn/tags/1.8.10/ui/minified/jquery.ui.resizable.min.js && \
wget http://www.appelsiini.net/download/jquery.jeditable.mini.js && \
wget http://github.com/malsup/form/raw/master/jquery.form.js --no-check-certificate && \
wget http://jquery-multifile-plugin.googlecode.com/svn/trunk/jquery.MultiFile.pack.js && \
Expand Down
59 changes: 59 additions & 0 deletions config/invenio.conf
View file
Expand Up @@ -1228,6 +1228,65 @@ CFG_BIBMATCH_QUERY_TEMPLATES = {
'title-author' : '[title] [author]',
'reportnumber' : 'reportnumber:[reportnumber]'
}

######################################
## Part 21: BibAuthorID parameters ##
######################################

# CFG_BIBAUTHORID_MAX_PROCESSES is the max number of processes
# that may be spawned by the disambiguation algorithm
CFG_BIBAUTHORID_MAX_PROCESSES = 4

# CFG_BIBAUTHORID_PERSONID_SQL_MAX_THREADS is the max number of threads
# to parallelize sql queries during personID tables updates
CFG_BIBAUTHORID_PERSONID_SQL_MAX_THREADS = 4

# CFG_BIBAUTHORID_PERSONID_MIN_P_FROM_BCTKD_RA is the minimum confidence needed
# when backtracking automatically disambiguated authors to persons.
# Values in [0,1]
CFG_BIBAUTHORID_PERSONID_MIN_P_FROM_BCTKD_RA = 0.5

# CFG_BIBAUTHORID_PERSONID_MIN_P_FROM_NEW_RA is the threshold for
# the confidence in a paper by the disambiguation algorithm to have it
# automatically connected to a personID. Papers below the thresholds are
# left disconnected from persons if not already connected in other ways.
# values in [0,1]
CFG_BIBAUTHORID_PERSONID_MIN_P_FROM_NEW_RA = 0.5

# CFG_BIBAUTHORID_PERSONID_MAX_COMP_LIST_MIN_TRSH minimum threshold for
# disambiguated authors and persons: if less compatible than this the update
# process will create a new person to associate to the found disambiguated author.
CFG_BIBAUTHORID_PERSONID_MAX_COMP_LIST_MIN_TRSH = 0.5

# CFG_BIBAUTHORID_PERSONID_MAX_COMP_LIST_MIN_TRSH_P_N is a fallback mechanism
# to force a merge if a certain percentage of papers is compatible no matter
# what the confidences on the automatically disambiguated author looks like
CFG_BIBAUTHORID_PERSONID_MAX_COMP_LIST_MIN_TRSH_P_N = 0.5

# CFG_BIBAUTHORID_EXTERNAL_CLAIMED_RECORDS_KEY defines the user info
# keys for externally claimed records in an remote-login scenario--e.g. from arXiv.org
# e.g. "external_arxivids" for arXiv SSO
CFG_BIBAUTHORID_EXTERNAL_CLAIMED_RECORDS_KEY =

# CFG_BIBAUTHORID_ATTACH_VA_TO_MULTIPLE_RAS determines if the authorid
# algorithm is allowed to attach a virtual author to multiple
# real authors in the last run of the orphan processing.
# Comma separated list of values.
CFG_BIBAUTHORID_ATTACH_VA_TO_MULTIPLE_RAS = False

# CFG_BIBAUTHORID_AID_ENABLED
# Globally enable AuthorID Interfaces.
# If False: No guest, user or operator will have access to the system.
CFG_BIBAUTHORID_ENABLED = True

# CFG_BIBAUTHORID_AID_ON_AUTHORPAGES
# Enable AuthorID information on the author pages.
CFG_BIBAUTHORID_ON_AUTHORPAGES = True

# CFG_BIBAUTHORID_AUTHOR_TICKET_ADMIN_EMAIL defines the eMail address
# all ticket requests concerning authors will be sent to.
CFG_BIBAUTHORID_AUTHOR_TICKET_ADMIN_EMAIL = info@invenio-software.org

##########################
## THAT's ALL, FOLKS! ##
##########################
63 changes: 37 additions & 26 deletions modules/bibauthorid/lib/bibauthorid.js
View file
Expand Up @@ -26,10 +26,10 @@ $(document).ready(function() {
$('.more-' + x).toggle();
var toggleimg = $this.find('img').attr('src');

if (toggleimg == '../img/plus-9x9.png') {
$this.find('img').attr({src:'../img/minus-9x9.png'});
if (toggleimg == '../img/aid_plus_16.png') {
$this.find('img').attr({src:'../img/aid_minus_16.png'});
} else {
$this.find('img').attr({src:'../img/plus-9x9.png'});
$this.find('img').attr({src:'../img/aid_plus_16.png'});
}
return false;
});
Expand All @@ -55,17 +55,23 @@ $(document).ready(function() {
}

// Initialize DataTable
oTable = $('.paperstable').dataTable({
$('.paperstable').dataTable({
"bJQueryUI": true,
"sPaginationType": "full_numbers",
"aoColumns": [
{ "bSortable": false,
"sWidth": "" },
{ "bSortable": false,
"sWidth": "" },
{ "sWidth": "" },
{ "sWidth": "120px" },
{ "sWidth": "320px" }
]
],
"aLengthMenu": [75],
'iDisplayLength': 75,
"fnDrawCallback": function() {
$('.dataTables_length').css('display','none');
}
});

$('.reviewstable').dataTable({
Expand All @@ -78,7 +84,12 @@ $(document).ready(function() {
"sWidth": "" },
{ "bSortable": false,
"sWidth": "120px" }
]
],
"aLengthMenu": [50],
'iDisplayLength': 50,
"fnDrawCallback": function() {
$('.dataTables_length').css('display','none');
}
});


Expand Down Expand Up @@ -121,7 +132,7 @@ $(document).ready(function() {
return false;
});

update_action_links();
// update_action_links();

});

Expand All @@ -134,7 +145,7 @@ function confirm_bibref(claimid) {
$('#bibref'+cid).load('/person/status', { 'pid': $('span[id^=pid]').attr('id').substring(3),
'bibref': claimid,
'action': 'confirm_status' } );
update_action_links();
// update_action_links();
}


Expand All @@ -146,7 +157,7 @@ function repeal_bibref(claimid) {
$('#bibref'+cid).load('/person/status', { 'pid': $('span[id^=pid]').attr('id').substring(3),
'bibref': claimid,
'action': 'repeal_status' } );
update_action_links();
// update_action_links();
}


Expand All @@ -157,7 +168,7 @@ function reset_bibref(claimid) {
$('#bibref'+cid).load('/person/status', { 'pid': $('span[id^=pid]').attr('id').substring(3),
'bibref': claimid,
'action': 'reset_status' } );
update_action_links();
// update_action_links();
}


Expand All @@ -175,7 +186,7 @@ function action_request(claimid, action) {
buttons: {
Ok: function() {
$( this ).dialog( "close" );
update_action_links();
// update_action_links();
}
}
});
Expand All @@ -195,11 +206,11 @@ function action_request(claimid, action) {
}

$( this ).dialog( "close" );
update_action_links();
// update_action_links();
},
Cancel: function() {
$( this ).dialog( "close" );
update_action_links();
// update_action_links();
}
}
});
Expand All @@ -212,9 +223,9 @@ function action_request(claimid, action) {
} else if (action == "reset") {
reset_bibref(claimid);
}
update_action_links();
// update_action_links();
} else {
update_action_links();
// update_action_links();
}

} else {
Expand Down Expand Up @@ -246,14 +257,14 @@ function processJson(data) {
}


function update_action_links() {
// Alter claim links in the DOM (ensures following the non-destructive JS paradigm)
$('div[id^=bibref]').each(function() {
var claimid = $(this).attr('id').substring(6);
var cid = claimid.replace(/\,/g, "\\," );
var cid = cid.replace(/\:/g, "\\:");
$("#bibref"+ cid +" > #aid_status_details > #aid_confirm").attr("href", "javascript:action_request('"+ claimid +"', 'confirm')");
$("#bibref"+ cid +" > #aid_status_details > #aid_reset").attr("href", "javascript:action_request('"+ claimid +"', 'reset')");
$("#bibref"+ cid +" > #aid_status_details > #aid_repeal").attr("href", "javascript:action_request('"+ claimid +"', 'repeal')");
});
}
//function update_action_links() {
// // Alter claim links in the DOM (ensures following the non-destructive JS paradigm)
// $('div[id^=bibref]').each(function() {
// var claimid = $(this).attr('id').substring(6);
// var cid = claimid.replace(/\,/g, "\\," );
// var cid = cid.replace(/\:/g, "\\:");
// $("#bibref"+ cid +" > #aid_status_details > #aid_confirm").attr("href", "javascript:action_request('"+ claimid +"', 'confirm')");
// $("#bibref"+ cid +" > #aid_status_details > #aid_reset").attr("href", "javascript:action_request('"+ claimid +"', 'reset')");
// $("#bibref"+ cid +" > #aid_status_details > #aid_repeal").attr("href", "javascript:action_request('"+ claimid +"', 'repeal')");
// });
//}

0 comments on commit 0b3e811

Please sign in to comment.