Dev Meeting Notes

Adrià Mercader edited this page Feb 24, 2016 · 48 revisions
Clone this wiki locally

Everyone is welcome, just add an item to the pad if you want something raised.


Meeting 2016-02-23

Chair: Notes:

Pull Requests (XX open)

Issues (XX open)

  • #1234 - Resolution

General questions:

  • Item (name)

Meeting 2016-02-18

Chair: Notes:

Pull Requests (XX open)

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2016-02-16

Chair: Notes:

Pull Requests (XX open)

  • 2352 WIP

Issues (XX open)

  • #2878 - remove db simple-dump-json, recommend ckanapi

General questions:

  • LF doodle (wardi)

Meeting 2016-02-11

https://hangouts.google.com/hangouts/_/okfn.org/ckan-meeting-2 Chair: David Notes:

Pull Requests (XX open)

  • #2872 Sergey to review.
  • #2867 Adria.

Issues (XX open)

  • #2871 Assign to zharktas ...

General questions:

  • Supporting the core tech team from APAC (Steven De Costa, starl3n)
  • update on cleaning up GitHub issues/PRs (starl3n) - ross still doing it
  • packaging and release for 2.6 (starl3n)

    Shane, Yan, Sergey & Greg to look at in next week or so

  • Begging emails (ross)

  • Responding to Assoc (ross).
  • Allow LD team to be assigned to tickets (like morty). Sergey = smotornyuk || Yan = Engerrs Invites sent.
  • open.canada.ca support for ckan (wardi)
  • linux foundation cio willing to discuss help setting up ckan under linux foundation with some of their resource
    • have paid-for resources - advertising, legal, running conferences, etc
    • easier for people to donate money to it -> DR to draft doc and work with Ian & Steven on getting initial feedback from steering committee and organization meeting with Linux Foundation

Meeting 2016-02-09

Chair: Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #1234 - Resolution

General questions:

  • keeping core devs working on ckan (wardi)
  • agpl enforcement (wardi)

Meeting 2016-02-04

Chair: Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #1234 - Resolution

General questions:

  • Item (name)

Meeting 2016-02-02

Chair: Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #1234 - Resolution

General questions:

  • Item (name)

Meeting 2016-01-28

Chair: Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #1234 - Resolution

General questions:

  • Item (name)

Meeting 2016-01-26

Chair: Notes:

Pull Requests (XX open)

  • #2839 - accepted, amercader will announce

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2016-01-21

Chair: wardi Notes: wardi

Pull Requests (XX open)

  • #2835 - brook
  • #2840 - wardi
  • #2839 - discuss at next meeting

Issues (XX open)

  • #1234 - Resolution

General questions:

  • Item (name)

Meeting 2016-01-19

Chair: Notes:

Pull Requests (XX open)

  • #2831 - wardi
  • #2835 - need to remove magic from h
  • #2836 - amercader

Issues (XX open)

  • 2838

    • Need to ensure unique email addresses

    • Email validation when registering (user as pending, resend the validation email, ...)

    • Don't breaking existing instances where email address may be in multiple accounts.

    Implement in an extension (even a core one) to not complicate core code

    • User extras,

    • IUserForm

    Core

  • 2837

General questions:

Meeting 2015-01-14

Chair: Notes:

Pull Requests (XX open)

  • #2834 - amercader
  • #2831 - 404 on package controller only instead
  • #2830 - wardi
  • #2829

Issues (XX open)

  • #2832 - wardi

General questions:

  • Broken extensions when used with master aka new_authz in extensions.

    add a sepaate Python package ckantoolkit

  • Close message: https://gist.github.com/rossjones/4e441f65e9bac78b1eca is ok i.e. not too harsh?

  • Announcements: dropping Python 2.6, min Postgres 9.1
  • Release support policy: Version | Release Date ---------+------------- CKAN 2.5 | December 2015 CKAN 2.4 | July 2015 CKAN 2.3 | March 2015 CKAN 2.2 | February 2014 CKAN 2.1 | August 2013 CKAN 2.0 | May 2013

Potential approaches to support date limits:

  1. Date based: each release is supported for X months or Y years after the its release date
  2. Number of supported releases: we support the last stable release plus the previous Z ones

Other projects:

https://www.djangoproject.com/download/#supported-versions https://docs.djangoproject.com/en/dev/internals/release-process/#supported-versions

Meeting 2015-01-12

Chair: rossjones Notes:

Pull Requests (XX open)

  • #2829 - WIP
  • #2828 - WIP

Issues (XX open)

  • #2827 - amercader

General questions:

  • Ticket Gardening (ross)
    • Close old tickets.
    • Use easy/hard labels on Good-for-contribution.

Meeting 2015-01-07

Chair: amercader Notes: wardi

Pull Requests (XX open)

  • #2825, #2824 - wardi
  • #2821 - wardi
  • #2801, #2817 - amercader
  • #2818 - rossjones
  • #2815 - rossjones
  • #1926 - amercader
  • #2610 - brook
  • #2800, #2798 - amercader
  • #2796 - merged

Issues (XX open)

  • #2826 - amercader
  • #2822 - rossjones
  • #2807 ... 2813 - bugs related to demo site. good for contribution?
  • #2806 - good for contribution
  • #2805 - rossjones
  • #2804 - rossjones
  • #2803 - amercader
  • #2799 - amercader
  • #2797 - good for contribution
  • #2794 - vitor (good for contribution)
  • #2793 - amercader
  • #2792 - good for contribution
  • #2790 - move to ideas?

General questions:

  • docker and data.gov (wardi)

Meeting 2015-12-15

Chair: Ross Notes: Tom

Pull Requests (XX open)

  • #2788 - Ross merged

Issues (XX open)

  • #2787 - wardi
  • #2786 - ross
  • #2784 - placeholder for ross PR

General questions: * (dread) Release Thursday. Outstanding issues?

    https://github.com/ckan/ckan/issues/2758

* (wardi) https://gitlab.com/ckan/ckan-security/merge_requests/2

* docs? 

* test? - wardi to do

* patch releases

* test debian packages(ross)

http://packaging.ckan.org.s3-eu-west-1.amazonaws.com//build/python-ckan_2.5.0-trustybeta1_amd64.deb

http://packaging.ckan.org.s3-eu-west-1.amazonaws.com//build/python-ckan_2.5.0-precisebeta1_amd64.deb

BETA Packages are fine on trusty and precise (ross).


* general testing of beta.ckan.org

* (ross) The member table, db relations in general (i.e. owner_org).
  * Also split up orgs and groups? (no, just wishful thinking)
* (dread) Florian has requested we allow bavarian translation. I'm concerned it could open the floodgates to other obscure ones, filling up the language drop-down with, when they are added more for politics rather than necessarily helping understanding. His arguments:


Re Bavarian - I'm serious about offering a translation to further CKAN's multilingual diversity, and there are serious movements in Bavaria to preserve this language and our rich culture. However, this is an offer, not an agenda.


Arguments against:

- CKAN will still be usable to Bavarian users without a Bavarian translation, as all of them speak German (although with a funny accent). The same however goes for Catalan and Basque - most Catalan/Basque speakers will understand Spanish, although I recognize due to historical/political tensions, Catalan and Basque speakers will be offended by Spanish-only translations more than Bavarian speakers by High German.


Arguments pro:

- Bavarian is in the list of languages supported by Transifex, it's a legitimate language/locale.

- Bavarian, Austrian and some Swiss-german dialects have Bajuvarian as their linguistic root and form their own language group - all other German dialects come from Middle German and are actual dialects.

- Other languages (en, pt, es) have their own CKAN Transifex localisations too.

- I'm happy to contribute the translation


I'll leave the decision up to you - would be great if you could pitch this to the tech meeting, and I'd be glad tocontribute another bit of linguistic diversity to CKAN if there's no perceived risk involved.
  • (amercader) flask update

Meeting 2015-12-10

Chair: amercader Notes: wardi

Pull Requests (XX open)

  • #2783 - brook
  • #2465 - wardi
  • #2779 - amercader
  • #2777 - amercader

Issues (XX open)

  • #2781 - wardi
  • #2780 - good for contribution
  • #

General questions:

Meeting 2015-12-08

Chair: David Notes: Tom

Pull Requests (XX open)

2774 - Ross to investigate

Issues (XX open)

2773 - Have asked reporter for more info

2772 - Adria to write note

2771 - Have asked reporter for PR

General questions:

  • (amercader) OK Resources for next year: Flask

    • yes / no

    • if yes: rough plan

    Open Knowledge have funding for development on CKAN from a European project. What should the money be spent on? Roughly 50 days worth of work available.

    • Moving to flask is probably too large a goal for 50 days but can do parts of it

    • controllers

    • routing

    • middleware

    • g & c

    • want emphasis on ckan backwards compatibility rather than flask conventions

    https://github.com/ckan/ckan/compare/flask-poc

    • try deleting pylons, write a shim pylons to provide everything

    • put config into plugins.toolkit

    • minimize breakages as possible, but some extensions / extension points will break

    • therefore this will be ckan 2.x, but it can be discussed

Meeting 2015-12-03

Chair: Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2015-12-01

Chair: Notes:

Pull Requests (XX open)

  • #2764 - merged
  • #2757 - amercader

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2015-11-26

Chair: Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • none

General questions:

  • Item (name)

Meeting 2015-11-24

Chair: amercader Notes: wardi

Pull Requests (XX open)

  • #2752 - dread
  • #2753 - merge? might need to change to a safer encoding if this fails on utf-8 in the future
  • #2751 - wardi
  • #2750 - remove noise instead
  • #2749 - amercader
  • #2748 - wardi
  • #2747 - merged

Issues (XX open)

  • #2754 - amercader
  • #2745 - amercader
  • #2744 - wardi

General questions:

Meeting 2015-11-19

Chair: dread Notes: wardi

Pull Requests (XX open)

  • #2743 - dread
  • #2742 - amercader
  • #2739 - wardi
  • #

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2015-11-17

Chair: dread Notes:

Pull Requests (XX open)

  • 1651 - trusty support:

    python-ckan_2.3_amd64.deb >> python-ckan_2.3-precise_amd64.deb

    python-ckan_2.3-trusty_amd64.deb

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2015-11-12

Chair: dread Notes:

Pull Requests (53 open)

  • #2729 - wardi

Issues (284 open)

  • #2728 - joet

General questions:

  • Item (name)

Meeting 2015-11-10

Chair: Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2015-11-05

Chair: amercader Notes:

Pull Requests (XX open)

  • none

Issues (XX open)

  • #2724 amercader
  • #2723 amercader
  • #2722 amercader
  • #2721 amercader

General questions:

Meeting 2015-11-03

Chair: Notes:

Pull Requests (XX open)

  • no new PRs #2570 (fixes #2564 and #2562)
  • RQ discussion

Issues (XX open)

General questions:

Meeting 2015-10-29

Chair: Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2015-10-27

Chair: Notes:

Pull Requests (XX open)

  • #2711 - dread
  • #2710 - wardi
  • #2708 - merged
  • #2707 - wardi
  • #2705 - amercader

Issues (XX open)

  • no new issues

General questions:

Meeting 2015-10-22

Chair: amercader Notes:

Pull Requests (XX open)

  • #2703 - CircleCI merged
  • #2696 - amercader
  • #2234 - wardi

wardi to make 2.5 milestone

Issues (XX open)

  • #2702 -
  • #2697 - wardi to comment
  • #2693 - closed

General questions:

  • Item (name)

Dcat harvester tests: https://github.com/ckan/ckanext-dcat/blob/master/ckanext/dcat/tests/test_harvester.py

Meeting 2015-10-20

Chair: Notes:

Pull Requests (XX open)

  • #1234 - Resolution

2234

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2015-10-15

Chair: amercader Notes:

Pull Requests (XX open)

  • #2589 - merged
  • #2685 - ross
  • #2684 - amercader
  • #2682 - joet
  • #2561 - amercader

Issues (XX open)

  • #2668 - dread
  • #2667 - dread
  • #2686 - ross
  • #2683 - amercader

General questions:

  • Anyone using Sentry on CKAN? (amercader)
  • Travis (ross)
  • (joel) New Jersey went with CKAN - launched this week. Pittsburgh will be CKAN too.
  • Dat/CKAN (joel)

    • Dat now funded by US Open Data
    • Joel chatting with Karissa McKelvey - a core dev at Dat
    • Dat:
      • designed for big datasets
      • allows different versions of a dataset
        • distributed / not one is canonical
        • collaboration on data
      • and download via diffs
    • Karissa has high level design (Google) doc for a ckan extension (https://docs.google.com/document/d/1bYUpQZ_DC7gfr5_DHXv6JK-DvhfFqNP5FKNyl3caIUg/edit#heading=h.fogh5512yqun )

      Can't open, says to ask for permission :( Have emailed Joel.  here too, have requested access
      
      • register a ckan dataset
      • possibility of funding from USOD
  • DGU datastore (dread/ross)

    • written a separate datastore, with API web interface and wrapper around postgres

      • not per-resource

      • not inside CKAN executable

      • no private datasets

    • also working on improved ETL

    • needs a name
  • Q about funding work across several orgs

Meeting 2015-10-13

Chair: amercader Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #2679 - joet

General questions:

  • Item (name)

Meeting 2015-10-08

Chair: Notes:

Pull Requests (XX open)

  • #2675 - rossjones
  • #2672 - merged
  • #2671 - wardi

Issues (XX open)

  • #2678 - amercader
  • #2676 -

General questions:

  • Joel will be here Tue/Thu next week to discuss the dat integration

Meeting 2015-10-06

Chair: dread Notes: ross

Pull Requests (XX open)

  • #2668 - required for i18n of data on edit form. Currently possible before_view, want before_edit too. Ian to update PR with comments.

Issues (XX open)

  • #2664 dread to dig out DGU hack for resource id changes.
  • #2660 rating to be removed

General questions:

Meeting 2015-10-01

Chair: Notes: wardi

Pull Requests (XX open)

  • #2668 - bring up at next next meeting
  • #2663 - joet

Issues (XX open)

  • #2667 - joet
  • #2664 - wardi
  • #2657 - joet

General questions:

  • Item (name)

Meeting 2015-09-29

Chair: amercader Notes: wardi

Pull Requests (XX open)

  • 1234 - Resolution

  • 2647 - export password hashes (wardi)

    • set api key as separate PR? (no, still going to include in this PR) (changed mind again, will make separate PR)
    • include_apikey, include_email as separate PR

Issues (XX open)

  • #2655 - amercader

General questions:

  • Ubuntu 14.04 (amercader)

    • tests CI - explore circleci

    • packages

  • Upgrade postgres/postgis (dread)

Meeting 2015-09-24

Chair: dread Notes: wardi

Pull Requests (XX open)

  • #2654 - dread
  • #2653 - dread

Issues (XX open)

  • #2652 - dread

General questions:

Meeting 2015-09-22

Chair: Notes:

Pull Requests (XX open)

  • #2647 export password hash - joet (to be reviewed by another dev too)
  • #2639 - wardi

Issues (XX open)

  • #2649 - wardi
  • #2650 - wardi
  • #2651 - wardi

General questions:

Meeting 2015-09-17 - Thursday

Chair: Notes:

Pull Requests (XX open)

  • 2647 - wip, and more discussion needed
  • 2646 - brook
  • 2644 - merged
  • 2638 - ian
  • 2613 - joet

Issues (XX open)

  • no new

General questions:

Meeting 2015-09-15

Chair: Notes:

Pull Requests (XX open)

  • #2638 -
  • #2461 -
  • #2643 -
  • #2641 -
  • #2640 -
  • #2639 -
  • #2624 -
  • #2635 -
  • #2629 -

Issues (XX open)

  • #2636
  • #2632

General questions:

Meeting 2015-09-10

Chair: dread Notes: ross

Pull Requests (XX open) No pull requests today!

  • #2625 - package relationships fix We have no UI, but there are legacy tests. Filipe asked if he might consider contributing his UI code.

Issues (XX open)

  • #1234 - Resolution

General questions:

-- package_create inside package_create (ian) -anyone ever used angular js with ckan? (joe) any examples? = https://github.com/okfn/ckan.js ?

****************** NOTE: For next meeting, yanik would like to join the meeting - please check if yanik is on IRC.

Meeting 2015-09-08

Chair: Ian Notes:Ross

Pull Requests (XX open)

  • #2623 - ross
  • #2622 - ian (to fix code too)
  • #3570 - wait for 8.4 to be deprecated
  • #2620 - merged
  • #2617 - ian
  • #2616 - ross
  • #2414 - adria

Issues (XX open)

  • #

General questions:

Meeting 2015-09-03

Chair: Notes:

Pull Requests (XX open)

Issues (XX open)

General questions:

http://demo.ckan.org/dataset/history/afghanistan-election-data

Meeting 2015-09-01

Chair: dread Notes: wardi

Pull Requests (XX open)

  • #2606 history controller removal - dread
  • #2607 optional related items icon - to ask ross

Issues (XX open)

  • #2605 (pr 2606) - dread
  • #2604 upload ux issue - suggest restoring file label + remove button, good for contribution
  • #2603 - wardi
  • #2602 - revisit on thursday
  • #2601 - revisit on thursday

General questions:

Meeting 2015-08-25

Chair: Notes:

Pull Requests (XX open)

  • #2599 - wardi
  • #2598 - amercader
  • #2596 - brook
  • #2595 - wardi

Issues (XX open)

  • #2597 - brook
  • #2594 - amercader
  • #2592 - wardi
  • #2591 - amercader
  • #2590 - brook
  • #2589 - good for contribution, amercader
  • #2588 - amercader

General questions:

  • patch release (amercader)
  • Multilingual / fluent (amercader)
  • security pr (wardi)

title": { "en": "Books", "fr": "Livres" }


Backwards compatible API version

"title": "Books" // <-- Or "Livres", depending on ckan.default_locale "title_lang": { "en": "Books", "fr": "Livres" },


New API version wardi +1 amercader -1

title": { "en": "Books" }

Meeting 2015-08-20

Chair: Notes:

Pull Requests (XX open)

  • #2554 - dread
  • #2587 - amercader
  • #2585 - amercader

Issues (XX open)

  • #1234 - Resolution

General questions:

  • Item (name)

Meeting 2015-08-18

Chair: Notes:

Pull Requests (XX open)

Issues (XX open)

  • #2581 - wardi
  • #2578 - wardi
  • #2577 - amercader
  • #2575 - amercader
  • #2574 - amercader

General questions:

  • fluent approach

-csrf

1)

Regenerate API Key

2)

Regenerate API Key

Meeting 2015-08-13

Chair: Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2015-08-11

Chair: Notes:

Pull Requests (XX open)

  • #2570 - a new command required, more code to be removed
  • #2572 - amercader
  • #2571 - IDataPusher plugin is looking good

Issues (XX open)

  • #1234 - Resolution

General questions - https://github.com/ckan/datapusher/issues/78

  - sec issues, https://gitlab.com/ckan/ckan-security

https://docs.python.org/2/library/imghdr.html

- patch release (amercader) - plan, assign

https://github.com/ckan/ckan/pull/2553

https://github.com/ckan/ckan/issues/2554

Meeting 2015-08-04

Postponed

Meeting 2015-07-30

Chair: dread Notes: brook

Pull Requests (XX open)

  • #2563 - wardi

Issues (XX open)

  • #2566 - dread
  • #2564 - dread (may require #2562)

General questions:

Meeting 2015-07-28

Chair: Notes:

Pull Requests (XX open)

  • #2560 - ckanext-dcat vs core rdf template - dread

Issues (XX open)

  • #2559 - amercader
  • #2557 - amercader
  • #2556 - wardi
  • #2555 - dread

General questions:

Meeting 2015-07-23

Chair: dread Notes: wardi

Pull Requests (67 open)

  • #2553 - wrong format detected for tsv, dread
  • #2551 - amercader
  • #2505 - wardi
  • #2548 - joet
  • ..lots of new functional tests from brook and joet
  • #1105 (wardi)

Issues (266 open)

  • #2554 - amercader
  • #2551 - amercader
  • #2550 - good for contributin

General questions:

Meeting 2015-07-21

Chair: adria Notes: dave

Pull Requests (60 open)

  • none

Issues (XX open)

  • #2540 - adria

General questions:

  • Security email https://gitlab.com/ckan/ckan-security/issues/12
  • Release status

    • changelog - dread in progress

    • cherry-pick bugfixs

    • testing - debian adria, dread to test on beta.ckan.org

    • translations - date passed, adria pulled

    • patch releases - adria testing packages

    • blog post, docs etc - dread

Meeting 2015-07-16

Chair: Notes:

Pull Requests (XX open)

  • #2536 - release documentation changes, (dread)
  • #2535 - joet
  • #2534 -joet

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2015-07-14

Chair: amercader Notes: ward

Pull Requests (XX open)

  • #2510 - amercader
  • #2519 - for 2.4,

Issues (XX open)

  • #2532 - amercader
  • #

General questions:

Meeting 2015-07-09

Chair: joet Notes: brook

Pull Requests (XX open)

  • #2529 - joet
  • #2526 - wardi

Issues (XX open)

General questions:

  • Release - any bugs seen or ones to merge into release?
  • cert

Meeting 2015-07-07

Chair: joet Notes: wardi

Pull Requests (XX open)

  • #2522 - wardi
  • #2521 - joet
  • #2519 - brook
  • #2518 - joet
  • #2517 - joet
  • #2515 - merged by joet
  • #2510 - brook to add docs and remove from WIP

Issues (XX open)

  • #2524 - joet
  • #2514 - wardi to remove old versions on docs when requested
  • #2514 - brook

General questions:

  • Item (name)

Meeting 2015-07-02

Chair: wardi Notes: joet

Pull Requests (63 open)

  • #2510 - iuploader, 2 interafces one for resource uploads one for general file uploads. Downloads can be handleded in IResourcecontroller. wardi - Only allows one plugin of this type, how does this work with dataset types? what happens when you switch plugin types? marked as WIP
  • #2512 - needs to be backported to 2.4.0 (dread)
  • #2494 - can we just have someinline javascript to fix the dates? Only occurs in the harvest view that only a sysadmin will see. wardi, seems more complicated than it's worth to store in sessions

Issues (265 open)

General questions:

Meeting 2015-06-30

Chair: joet Notes: wardi

Pull Requests (XX open)

  • #2505 - wip
  • #2508 - wardi
  • #2505 - joet
  • #2500 - stats extension cleanup, joet
  • #2510 - IUploader

Issues (XX open)

  • #2511 - joet
  • #2501 - good for contribution

General questions:

Meeting 2015-06-25

Chair: amercader Notes:

Pull Requests (XX open)

  • #2485, WIP to merge with licenses in db

Issues (XX open)

  • #2494 - timezone setting for users/sites
  • #2493 - amercader
  • #2492 - dread
  • resource date field issue "Fields in Additional Info is not updated" thread update resource.last_modified on upload

General questions:

  • Cloud storage (https://github.com/ckan/ideas-and-roadmap/issues/141) (amercader)

    • Direct upload/download ?

    • Private resources 2 interface to integrate with providers's security:

      1. get DL token url for redirect for people allowed to download

      2. set file public/private when state changes in ckan

Meeting 2015-06-23

Chair: Joe Notes: wardi

Pull Requests (XX open)

Issues (XX open)

  • #2490 - recline w/ special chars- brook
  • #2484 - amercader
  • #2480 - amercader
  • #2479 - dread

General questions:

Meeting 2015-06-18

Chair: joet Notes: wardi

Pull Requests (XX open)

  • #2461 - ITranslations - wardi
  • #2477 - joet
  • #2470 - requirements.txt changes, link to ssl issue, lots of people having problems with requests - joet
  • #2461 - wardi
  • #2468 - amercader

Issues (XX open)

  • #2478 - dread
  • #2476 - joet
  • #2475 - joet
  • #2474 - joet to ask for PR, good for contribution
  • #2473 - good for contribution
  • #2472 - add the already entered option to the dropdown, good for contribution.

General questions:

Meeting 2015-06-16

Chair: amercader Notes:

Pull Requests (XX open)

  • #2467 - multilingual schema, comment on schema version matching ckan version not necessary - amercader 24
  • #2460 - wardi

Issues (XX open)

  • #2466 - amercader
  • #2464 - amercader
  • #2463 - dup of messytables, bug 2420

General questions:

23/6 Week 1: Feature freeze {{ 2h }} - Branch release 2.4, update version number - Extract translations, upload to Transifex, announce [1] - Build frontend [2] > Build package 2.4-beta1 [3] > Request testing (package or source install)

From this moment on any changes on the release branch need to be first merged into master and cherry-pick into the release branch. Only bug fixes and docs should be cherry-picked. Unless really necessary no changes that modify the translated strings should be merged. At the same time it would be good to get as many stuff backported to previous release branches as possible, depending on time [4] {{ 2-4h per week per dev }}

30/6 Week 2 - Build frontend [2] > Build package 2.4-beta2 [3] > Request testing (package or source install) - If the branch has changed! {{ 1h }} - Now's a good time to start updating the changelog [5] {{ 3h }}

Keep cherry-picking fixes and docs It's good to test that supported extensions are working against the new release branch. Spatial, harvest, etc are configured to run tests against master so they should be fine. It's worth adding a new Travis condition with the new release branch, eg [6] {{ 1-3h per week per dev }}

7/7 Week 3: A week before release - Build frontend [2] > Build package 2.4-beta3 [3] > Request testing (package or source install) - If the branch has changed! [[1 - Pull translations from Transifex and update the release branch [7] - Announce that release is happening next week on ckan-announce - Changelog should be finished by now

Keep cherry-picking fixes and docs (the closer to release date, the more straight-forward and critical they need to be) {{ 1-3h per week per dev }}

14/7 Release day (or day before) [8] {{ 6h }} - Finalize Changelog - Final frontend build - Update version number, tag - Build final package, upload to http://packaging.ckan.org/ - Upload to pypi - Enable docs on Read the Docs - Announce - Party

[1] http://docs.ckan.org/en/latest/contributing/release-process.html#doing-a-beta-release (Section 6.a-h) [2] paster front-end-build [3] https://github.com/ckan/ckan-packaging [4] https://github.com/ckan/ckan/labels/Backport%20pending [5] https://gist.github.com/amercader/4ec55774b9a625e815bf [6] https://github.com/ckan/ckanext-harvest/blob/master/.travis.yml#L4:L7 [7] http://docs.ckan.org/en/latest/contributing/release-process.html#doing-a-beta-release (Section 6.l) [8] http://docs.ckan.org/en/latest/contributing/release-process.html#doing-a-proper-release

Meeting 2015-06-11

Chair: amercader Notes: wardi

Pull Requests (58 open)

  • #1234 - Resolution
  • #2461 - translations with ITranslations, order important, add config setting for extra i18n dirs like extra_public_paths and templates settings
  • #2209 - packages included with tag_show/vocabulary_show - Ian to finish this off hopefully befoew 2.4

Issues (261 open)

  • none

General questions:

  • (wardi) taxonomy editing, scheming the datastore; look at recline editable table

Meeting 2015-06-09

Chair: Ian Notes: adria

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2015-06-04

Chair: dread Notes: wardi

Pull Requests (XX open)

  • #2457 - show all orgs not just ones we're admin for in user dashboard, all present happy with default behaviour change - brook
  • #2455 - api sandbox - extension or core? - wardi to try

Issues (XX open)

  • #2456 - dread

General questions:

Meeting 2015-06-02

Chair: amercader Notes:

Pull Requests (63 open)

  • #2452 - licenses in db, amercader
  • #2453 - wardi
  • #2450 - brook
  • #2449 - amercader
  • #2429 - dread

Issues (XX open)

  • #2451 - wardi
  • #2454 - amercader

General questions:

  • schemaless solr with repeating and multilingual fields (wardi)
  • CKANCon wrap-up (wardi)

    https://pad.okfn.org/p/ckancon

    planning for next ckancon, adjacent to a pycon? sooner than next IODC in Madrid

  • Link Digital new extensions http://datashades.com/introducing-ckan-galleries-for-images-and-video/ ? (Maybe Alex can talk about this a little, but we'd like to create a screencast to demo it a little later...)

  • ckan 2.4 (wardi)

    • docs cover the mechanics on release

    • also merging, cherry-picking, testing

    also try package install & patch releases & mounted on non-root url

    • do patch releases during next 2 weeks

    • then branch for 2.4 and spend 3 weeks getting that out

    • everybody with beta/preprod environments should book some time to test under real world conditions

    • Adria to check with OKF for resource (Sander)

Meeting 2015-05-26

Chair: amercader Notes: wardi

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #2444 - amercader
  • #2440 - how do we install reqs? wardi

General questions:

  • Item (name)

Meeting 2015-05-21

Chair: wardi Notes: wardi

Pull Requests (XX open)

  • none

Issues (XX open)

  • #2439 - amercader
  • #2438 - wardi
  • #2437 - brook

General questions:

  • Item (name)

Meeting 2015-05-19

Chair: amercader Notes: wardi

Pull Requests (57 open)

Issues (XX open)

  • #2435 - amercader
  • #2430 - joet

General questions:

  • p.implements - inherit=True by default? (amercader)

    • the problem is that if we add a new method in an existing ckan interface then an old extension will break

    • joe not keen on it - java interface would not come with default methods

    • ian suggests we just document in the changelog to deal with the interfacenew method

    • dread warns about extensions taking advantage of this won't work with older ckans

    • ian suggests ckan should check to see if the function is defined in the extension, so you avoid the breakage, like he did for idatasetform

  • excel spreadsheet, sheet 3 is default, we should default to sheet 1 and after that allow people to specify the sheet they want somehow. https://github.com/ckan/datapusher/issues/71 (joet) - support multiple sheets?

    • joet and wardi want interface for interactive uploading of spreadsheets (it's nice to dream)
    • amercader says users just want a simple interface
  • package_purge adding to actions like group_purge and organization_purge (wardi)
    • package_delete should munge the name, undelete should unmunge? - wardi to make an issue for discussion
    • sysadmin only?
  • ckancon

Meeting 2015-05-14

Chair: joet Notes: wardi

Pull Requests (54 open)

  • #2428 - merged
  • #2427 - joet to merge, tell to go look at ckan-docker
  • #2420 to be fixed in messytables, update requirements instead (datapusher ones)

Issues (249 open)

  • nope

General questions:

Meeting 2015-05-12

Chair: amercader Notes: wardi

Pull Requests (53 open)

  • #2420 - some people use utf-8 boms send patch to messytables? brook
  • #2417 - joet

Issues (249 open)

  • #2426 - IMapper.before_save() not working? datapusher may be using it - dread
  • #2418 - celery command requires use of postgres - dread to comment use the redis command line client for celery/redis

General questions:

Meeting 2015-05-05

Chair: David Notes: Adria

Pull Requests (XX open)

  • #2431 - brook

Issues (XX open)

  • #1234 - Resolution
  • #

General questions:

Meeting 2015-04-28

Chair: amercader Notes: wardi

Pull Requests (XX open)

  • #2407 - recpatcha 2.0 - controversial? support both versions? - amercader

Issues (XX open)

  • #2405 - ckanext-multilingual bug - amercader

General questions:

  • ckancon update (wardi)
  • ckanext-dcat work (RDF generation) https://github.com/ckan/ckanext-dcat/pull/28

    • Replace core rdf templates?

    • ...sidetracked into index based pagination and celery for queues

  • pan-european data portal (dread)

    • ckan ftw; drupal; data quality; comtella(?) proprietary geo vis; Eric? meet to discuss reuse ckancon? paris? wardi needs contact info (or dread may invite?)

Meeting 2015-04-23

Chair: amercader Notes:joet

Pull Requests (XX open)

  • #2379 - password reset keys, should be backported.

Issues (XX open)

  • #2404 - suspect they are not using datastore/datapusher and previewing using resource_proxy amecader to suggest they use the datastore instead.
  • #2403 - we can support translations in javascript - maybe not in recline.

General questions:

  • introduce: Isaac. Greg.
  • ckancon2015 (wardi)
    • for travel funding need estimate of amount and justification (presenting something?) asap
  • dcat-ap (dread) - time series items should be distributions or datasets http://data.gov.uk/dataset/highways_agency_planned_roadworks

             - several strong opinions in favour of distributions
    
         - standard way to find metadata API
         - sparql endpoint
         http://datahub.io/dataset/europeana-sparql
    

Meeting 2015-04-21

Chair: amercarder Notes: joet

Pull Requests (XX open)

  • #2393 - amercarder asked davidread to add a test wchih has been done(amercader)
  • #1903 - are we ok with removing the database tables if they're not used? General agreement that we're happy for them to go, but unsure if it is safe to do so. Needs a indepth review. (amercader)

Issues (XX open)

  • #2402 - sounds good, pull request please
  • #2401 - (joet)
  • #2399 - this page existed? not by design (brook)
  • #2398 - new end points for atom feeds which are wrappers around package_search, which should be better than the old feeds based off the revisions. Might need some tests to ensure they are working (wardi)
  • #2395 - needs to check whether this is the case (amecader)
  • #2394 - wardi: if you change your user name at the same time someone else changes their username to your name, are you logged in as them? (does your cookie with the previous username remain valid?) Is this failing on an auth check with hilarious results? (asking dread to investigate some more).

General questions:

  • Add new tag to github repo that tracks latest version of each branch. Extension currently install a specific version in their travis-build.sh which is unlikely to change. If we had a new tag 2.3-latest or something +1 for branch name then extensions wouldn't have to worry about updating their travis builds. (joet) joet will create branches.
    • ckancon2015 rough schedule: (wardi)
      • 1 hour ckan intro/demo; changes over the last year
      • 8x 15 minute talks on various features + extensions
      • lunch
      • ckan unconference hangouts on air? funding for core devs to come?

Meeting 2015-04-14

Chair: amercader Notes: wardi

Pull Requests (54 open)

  • #2393 - dread to add a small test to check that the un customized edit still works
  • #2391 - joet to review
  • #2388 - amercader

Issues (XX open)

  • #2392 - 3stage/2stage bug - wardi
  • #2390 - mailing list please - amercader
  • #2389 - brook

General questions:

Meeting 2015-04-09

Chair: joet Notes: wardi

Pull Requests (XX open)

  • #2382 - joet
  • #2200 - joet
  • #1952 - wardi
  • #2380 - wardi
  • #2209 - joet reassigned

Issues (XX open)

  • no new issues

General questions:

  • Review CKAN-security posts (amercader) https://gitlab.com/ckan/ckan-security/issues/
  • circleci (wardi) circleci awesome. wardi might work on support soon. fast tests! ssh access! docker!
  • ckanext-pages maintainer, joet will review pr and if happy agrees denisz could maintain ckanext-pages

Meeting 2015-04-07

Chair: amercader Notes: wardi

Pull Requests (XX open)

  • #2384 - joet
  • #2380 - wip, change to normal param instead of context param

Issues (XX open)

  • #2387 amercader
  • #2386 joet
  • #2385 wardi
  • #2382 wardi
  • #

General questions:

Meeting 2015-04-02

Chair: joet Notes: wardi

Pull Requests (XX open)

  • #2375 - merged
  • #2378 - wardi to respond to add helper instead of option to package_show

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2015-03-31

Chair: Ian Notes: Adrià

Pull Requests (XX open)

  • 2371 show only datasets of type dataset on user_show by default -

    Ian: we shouldn't get datasets with user_show at all, different default dataset type, maybe users want other some other core datasets

    better to handle this at the IDatasetForm level, a method that says "I don't want to show up in dataset listings"

    maybe it can be used to also filter records on the main dataset search page

  • 2367- merged

  • #2363 - extensions can add tabs to /ckan-admin - amercader to have a look

Issues (XX open)

General questions:

Meeting 2015-03-26

Chair: amercader Notes: wardi

Pull Requests (54 open)

  • #2361 - joet
  • #1105 - joet

Issues (237 open) https://github.com/ckan/datapusher/issues

  • #1234 - Resolution

General questions:

  • Item (name)

Meeting 2015-03-24

Chair: amercader Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2015-03-19

Chair: joet Notes: wardi

Pull Requests (57 open)

Issues (236 open)

  • #2356 - paster create views unauthorized issue, joet

General questions:

  • https://github.com/ckan/ckan/pull/2354, wardi
  • Release schedule (dread) - suggest every 3 months. Possible? Wanted? Review release process?

    Coolio, so let's ship 2.4 on 4 June. 2.5 on 4 Sept and then 3.0 on 4 Dec. Then 3.1, 3.2, 3.3 and 4.0 on a similar schedule in 2016.

    • frequent releases ARE useful
    • backports - be ruthless and just support current and previous releases
    • Steve mentioned getting marketing materials for upcoming releases
    • Steve mentions cost of upgrade - need to apply in advance
    • Individual membership (in lieu of paying CKAN Association) is to do with contribution to releases
    • discuss more with adria
    • what are the overheads/process of translation? Most of us want to want to have more frequent releases but need to hear more about the process from amercader.
    • going through the changelog, is this time consuming? could we have the reviewer of PRs adding a line to the changelog? http://docs.ckan.org/en/latest/contributing/release-process.html
  • docker: what's the deal? ckan-docker, images on docker hub? can they all coexist? (amercader)

    • wardi - there is left-over stuff in the repo that need to be fixed and generate an official ckan image, so that datacats, ckan-docker and others can be based on that. get it automatically generated on each commit. wardi to look into that.
    • discuss again when adria is here

Meeting 2015-03-17

Chair: dread Notes: wardi

Pull Requests (56 open)

  • #2352 - make our solr use faster (and use a maintined lib) - amercader
  • #2340 - revision_id on resource update issue - amercader
  • #2337 - wardi
  • #2238 - amercader

Issues (234 open)

  • #2351 - brook
  • #2350 - dread
  • #2347 - amercader
  • #2346 - joet
  • #2345 - wardi
  • #2344 - dread

General questions:

Meeting 2015-03-05

Chair: amercader Notes: wardi

Pull Requests (XX open)

Pull Requests (XX open)

  • #2330 - add id to form for easier testing, possible issue with id conflict, agreement that adding ids to forms makes sense - brook
  • #2327 - amercader
  • #2326 - maybe for 2.3.1 - amercader Issues (XX open)
  • #2328 - yes, PR please, wardi https://github.com/ckan/datapusher/pulls
  • #44 - suggest user customize their own configuration
  • #34 - suggest user customize their own configuration https://github.com/ckan/datapusher/issues
  • #67 - propose datastore_last_updated resource extra - amercader
  • #63 - joet
  • #62 - support req?
  • #60 - good for contribution General questions:
  • #2325 - amercader and joet concerned about api breakage for core fields
  • #2323 - no objections
  • https://gitlab.com/ckan/ckan-security

    • Please create your user

    • Review issues

    https://gitlab.com/ckan/ckan-security/issues

  • examples of custom user type in an extension? (brook)

  • nigelb - I'd like to propose upgrading our JS libs on master. It's running really old versions and plugin authors needing to bundle their own versions is just painful, especially for jquery and the likes. (if this wasn't decided already)

Meeting 2015-02-27

Only Joe, Greg and Adrià on the call New issues To discuss deferred until Tuesday Greg tells us about http://catalogue.data.gov.bc.ca, they are using uwsgi + nginx and are really happy. They are happy to share their configuration.

Meeting 2015-02-24

Chair: Adria Notes: George

Pull Requests (XX open)

  • #1234 - Resolution
  • #2311 - assigned to Adria (WIP)
  • #2297 - assigned to Joe
  • #2316 - Matthew to continue work on this - marked as WIP for the moment
  • #2315 - Matthew to change PR to just fixing the docs
  • #2314 - Assigned to Adria

Discuss:

https://github.com/ckan/ckan/pull/2234

Issues (XX open)

  • #1234 - Resolution
  • #2317 - Adria to reply to say - yes go ahead and submit pr
  • #2309 - Adria
  • #2307 - Adria confirmed this one - assigned to Ian
  • #2306 - no reproducing case. Joe assigned General questions:
  • nigelb - I'd like to propose upgrading our JS libs on master. It's running really old versions and plugin authors needing to bundle their own versions is just painful, especially for jquery and the likes.
  • joet - (discuss) when calling actions from extensions use 'get_action('package_show')(data_dict=data_dict). get_action will autopopulate the context with default values so you don't need to. This will allow us to rejig context (eventually). Additionally if we get people to explicity specify data_dict, we could perhaps expand the parameters in the future and use it as **kwargs. Shall I add this recommendation to the 'writing extension' docs?
  • joet - (discuss) if you are writing any models in the extension classmethods of models should be YourModel.your_method(cls, ..., session=model.Session). So that we pass the session from the context of the action function instead of using model.Session directly in the models.
  • matt: Relating to: https://github.com/ckan/ideas-and-roadmap/issues/7 - I am doing some work on view persistance and wanted to get some feedback on what the framework for improvements is - where to extend, are there any goals for core CKAN, etc. ### Meeting 2015-02-19 Chair: amercader Notes: joet

Pull Requests (XX open)

  • #2303 joe
  • #2302 amercader
  • #2296 not sure about adding extra field to resource view table, do we want it stored on another table with a list of resource views, with a button only accessible to sysadmins to 'make featured'? Is there an easy way of implementing of this and easy for user to use? Good luck dennis :p adria: do not use the model in controllers, should use action function to get a list of resource views. Change the name of 'featured' maybe word is too overloaded, also don't like additional field on tables as this feels wrong generally. brook: What is the best way to define the interface of 'what resource views are selected to be featured?'. Perhaps provide example layout to show the how to add a resource view to the homepage layout, but not actually include it. Which ever resource view people want to show is really site specific. Providing user with the tools to select a resource view is more useful than having a thing in core that lets them use the resource view on the table. assigned to wardi Issues (XX open)
  • #2304- agreed (good for contribution unless it's super simple)
  • #2297 - recline, (amercader will force it onto someone later)
  • #2294 - auth only handled by cookie, not way to invalidate on the server once a user has logged out. If someone could get a hold of that session cookie they could pretend to be that user. Couple of new things in 2.3 which help. Can we invalidate the session on the server side? The amount of work to fix this isn't really justified in comparison to updating the docs and letting people know what the repoze.who settings are (brook) General questions:
  • wtf paster db init in travis build why does the travis god only hate me? (joet) no, travis hates us all
  • PRs in extensions (amercader)

  • GSOC - probably not realistic for this year, we can keep the current stuff done and make it planning for next year

    Meeting 2015-02-17

    Chair: adria Notes: brook

Pull Requests (XX open)

Issues (XX open)

General questions:

  • AM 2.3 retrospective - adria requests participation in retrospective
  • DR http://docs.ckan.org/en/latest/api/index.html#making-an-api-request - add ckanapi example? suggest python - ckanapi & urllib2, or other - curl. DR to create an issue and contribute
  • AM private repo - various options discussed, adria to investigate further
  • 2.3 - give one more week for translations and final testing. then another week for freeze. so release in 2 weeks. ### Meeting 2015-02-12 Chair: Adria Notes: Joe

Pull Requests (XX open)

  • #1234 - Resolution Issues (XX open)
  • #1234 - Resolution General questions:
  • private repo ### Meeting 2015-02-10 Chair: dread Notes: wardi

Pull Requests (XX open)

  • #2273 - do not provide email by default - wardi
  • #2270 - move pdf view to separate extension - dread
  • #2262 - memory issues, responses held longer than needed, needs more testing, ask alice if it fixes problem - wardi Issues (XX open)
  • #2277 - dread
  • #2276 - point to ckan docker repo - dread
  • #2272 - fix docs - morty
  • #2271 - good for contribution - amercader
  • #2260 - redirect on login issue, check for open redirect - amercader General questions:
  • 2.3 release (dread). the stuff left is on the label 2.3. Last big one: #2204. And some docs. ### Meeting 2015-02-05 Chair: Ian Notes: Brook

Pull Requests (XX open)

  • #2268 assigned to Ian
  • #2266 assigned to Joe Issues (XX open)
  • #2267 assigned to brook
  • #2264 assigned to adrià
  • #2263 assigned to ian General questions:
  • Item (name) ### Meeting 2015-02-03 Chair: adria Notes: george

Pull Requests (60 open)

  • #1234 - Resolution #2256 - assigned to Adria #2257 - assigned to Brook #2258 - assigned to Joe Issues (222 open)
  • #1234 - Resolution #2261 - Assigned to Ian but will need to be discussed further #2260 - Assigned to Adria but George may follow up on it #2255 - Assigned to Adria General questions:
  • None ### Meeting 2015-01-29 Chair: adria Notes: wardi

Pull Requests (63 open)

  • #2254 - wardi
  • #2253 - adria
  • #2250 - adria
  • #2245 - david
  • #2247 - david
  • #2246 - david
  • #2248 - allow removing owner_orgs form datasets and allow changing orgs from the form - david
  • #2244 - adria Issues (223 open)
  • #2252 - adria
  • #2249 - self-signed certs and requests, can use environment var - ross General questions:
  • Item (name)

Meeting 2015-01-27

Chair: ian Notes: adria

Pull Requests (XX open)

  • #2243 - docs, direct import in action (sean)
  • #2242 - small resource view fixes (joe)
  • #2231 - pfd viewer (amercader)
  • #2235 - ross
  • #2227 - wardi
  • #2229 - autocomplete encoding (amercader)
  • #2221 - rename old test folder (wardi)
  • #2214 - harmonize grop_show, group_list output (wardi)
  • #2209 - joe

Issues (XX open)

  • #2240 - revision id not set when updating an extra: revision_id referst to the extra wardi to suggest using metadata_modified
  • #2239: wardi: problems with bigints? ross to keep an eye
  • #2238 - amercader
  • #2234 - ross
  • #2232 - connection pool, -dread to look at it
  • #2230 - amercader
  • #2228 - wardi
  • #2224 - amercader

General questions:

  • Datapusher (ross).
  • Thoughts on release testing: involving the community, provide a script, etc (amercader)

    • general support for this

    • am says

  • Release 2.3 (dread)

Meeting 2015-01-20

No-one else turned up - just dread

Meeting 2015-01-15

Chair: adria Notes: ian

Pull Requests (47 open)

  • #2221 - test/legacy? - ian
  • #2217 - david
  • # Issues (215 open)
  • #2218 - brook
  • #2216 - david
  • # 2211 - ian to comment General questions:
  • reported memory leak issue: threads hold on to the memory they used for the last request they handled, so memory usage may expand up do (request size) * (num threads) may be possible to force deallocation, but would be simpler to reduce threads and rows returned (joe) ### Meeting 2015-01-13 Chair: adria Notes: ian

Pull Requests (54 open)

  • #2209 - WIP, tests need fixing
  • #2207 - adria
  • #2208 - adria
  • #2206 - joe
  • #2190 - ross
  • #2200 - ross
  • #2198 - ian
  • #2191 - joe Issues ( open)
  • #2210 - ross, maybe add return_id_only too?
  • #2205 - adria, docs
  • #2204 - adria, custom filter for choosing resources to add resource views
  • #2203 - ross
  • #2201 - david
  • #2197 - brook
  • #2196 - ross, duplicate n3 issue
  • #2193 - adria, upgrade bundled PDF.js
  • #2189 - joe
  • #2188 - ross
  • #2184 - brook, ask for pr
  • #2186 - ross General questions:
  • Item (name)
  • https://github.com/ckan/ckanext-pages/pull/17 WYSIWYG editor for ckanext-pages, joe to review ### Meeting 2015-01-08 Deferred, only two developers present Chair: Notes:

Pull Requests (52 open)

Pull Requests (XX open)

  • #1852 - reviewed by ian, joe to do second review
  • #2182 - sean
  • #2181 - ian
  • #2179 - ross
  • #2176 - ian
  • #2174 - sean Issues (XX open)
  • #2184 - factory boy issue, upgrade? remove factory boy?
  • #2164 - change default permissions - david
  • #2161 - multilingual solr schema needs update - ross
  • #2158 - ian
  • #2156 - will comment that this change may be a lot of work
  • #2155 - nigel General questions:
  • https://github.com/ckan/ideas-and-roadmap/issues/118 (Ross)
  • 2.3 update? (Ross)
  • ckan service provider (George) Apologies... I’ve not made it to a meeting for a little while due to some work-related circumstances but I expect to be back very soon
  • ckan extension team? ********************************************************************* 2014 ### Meeting 2014-12-18 Chair: amercader Notes: wardi

Pull Requests (47 open)

Issues (198 open)

General questions:

  • 2.3 udpate https://trello.com/b/bdVlMo18/ckan-2-3-release
  • turn off packages in tag_show too (now that user_show's default has changed)?
  • "this dataset has changed since you edited it" ### Meeting 2014-12-16 Chair: David Read Notes: ian

Pull Requests (XX open)

Pull Requests (XX open)

  • #2137 - adria (brook to review)
  • #2139 - adria
  • #2135 - ian
  • #2134 - ian
  • #2129 - adria Issues (XX open)
  • #2040 - to discuss with brook (assigned to brook)
  • #2138 - adria
  • #2131 & 2130 - ross General questions:
  • Angelos summarises ckan extensions for metadata schemas

    • integrate with pycsw, more closely than on data.gov

    • allows defining different metadata schemas using zope interface

    • raster and vector store, integration with Geoserver and Rasdaman

    • pipeline: support for mapserver, tiling (mapbox), analytics, ...

    • extended workflow

    Michail speaks more about the metadata schemas support:

    • model class that represents a schema

    • maps ckan validation/conversion to zope ones

Meeting 2014-12-09

Chair: Ian Notes: George

Pull Requests (XX open)

  • #1234 - Resolution
  • #2118 - assigned to Ian
  • #2117 - assigned to Ross
  • #2119 - assigned to Ian
  • #2118 - new fix for something reported a while back. Assigned to Ian
  • #2101 - Brook says it's ready for review - assigned to Ian
  • #1951 - assigned to Ian

Detailed discussion around #1852 - Better handling of default resource views https://github.com/ckan/ckan/pull/1852

  • Adria says it's ready to start reviewing
  • Ian will review but would like input from others

Issues (XX open)

  • #1234 - Resolution
  • #2126 - assigned to Ian
  • #2125 - assigne to Ian
  • #2124 - assigned to brook
  • #2120 - Adria

General questions:

Meeting 2014-12-04

Chair: dread Notes: ian

Pull Requests (52 open)

  • #2115 - stats plugin fix - dread
  • #2098 - bad error message - ian
  • #2114 - mis-aligned nav element css fix - adria
  • #2113 - manifest missing a file - adria
  • https://github.com/ckan/ckan/pull/1557 - ian

Issues (192 open)

  • #2111 - org_autocomplete? - ian
  • #2110 - add licenses doesn't work as docs say - dread
  • #2109 - need to be able to reproduce - ian
  • #1779 - vdm fix/backport issue, dread is on it

General questions: - ssl: https://github.com/ckan/ckan/issues/1773

Meeting 2014-12-2

Chair: adria Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #1234 - Resolution

General questions:

  • (dread) Harvester improvements:
  • (ross)
    • https://github.com/ckan/ideas-and-roadmap/issues/16 (User extras) - would it go in if someone did this pre 2.3?
      • use resourceextra-style json field (rather than packageextra)
    • What is outstanding for 2.3 that really needs to be fixed?
      • in resourceviews adria is making progress, still to do cli stuff
      • amercader to review issues & PRs flagged 2.3
      • security issue fixes (but can be done post branch)
    • The master.ckan.org memory leak.
  • (joe) will the real package_show please stand up (in extensions) or "can I get a specific version of an action function if multiple plugins override the action" CAll it directly
  • wardi thursday meeting time change?
  • (George) CSV Validation discussed csvlint.io, messytables

Meeting 2014-11-25

Chair: david Notes: George

Pull Requests (XX open)

  • #1234 - Resolution

2093 - Ian assigns himself

2092 - assigned to David

2088 - assigned to David (work in progress)

2086 - David

2083 - will revisit next meeting

2084 - David

2079 - Sean

2077 - Sean

2041 - Joe

2058 - Joe

2034 - Ross

2065 - David

1105 - unassigned - Ross to check on

Issues (XX open)

  • #1234 - Resolution #2091 - David #2090 - Good for contribution #2089 - Ross #2087 - David #2085 - assigned to Ian #2082 - Ian #2081 - will be moved to Datapusher #2080 - Ross #2078 - Adria #2074 - moved to Ideas/Roadmap #2072 - David

General questions:

  • Item (name) Any interest in major changes for CKAN 2.3? (David)
  • discussions around Flask and Django (mostly Django)
    • implications for ORM
    • flask would be easier, Django would be a rewrite

Meeting 2014-11-20

Chair: adria Notes: ian

Pull Requests (54 open)

  • #2073 - celery related failure on multiple test runs, adria
  • #2071 - old rating code, move to models?
  • #2066 - david
  • #2069 - adria
  • #2067 - (merged)
  • #2064 - adria
  • #2065 - david
  • #2062 - david
  • #2060 - adria
  • 2059 - adria

  • PRs ian would like considered for 2.3: #2034, #2003

Issues (187 open)

  • #2057 - long file names/datapusher issue, good for contribution

General questions:

Meeting 2014-11-18

Chair: joe Notes: adrià

Pull Requests (51 open)

  • #2055 - david
  • #2052 - depends on #2050 - adrià
  • #2051 - need more clarity, points to 2.2.1
  • #2049 - won't merge, we won't remove the call> update #1557 - adrià
  • #2041 - keep dashes. make it idemptwhatever

Issues (XX open)

  • #2053 - nice diagram from wardi
  • ross' avatar is too pale

Discuss:

General questions:

  • Item (name)

Meeting 2014-11-13

Chair: ian Notes: dread

Pull Requests (XX open)

  • #2034 don't need to look at as sean is looking at it
  • #2048 assigned to adria
  • #2047 assigned to joe
  • #2045 assigned to ian
  • #2041 WIP

Issues (XX open)

  • #2046 joe

General questions:

  • Removing moderated edits https://github.com/ckan/ckan/pull/2006 (dread) yes Ian will review, but will only be merged after the 2.3 branch, discuss next meeting with adria
  • Secure cookie default (repoze.who) (Brook) https://github.com/ckan/ckan/issues/1942 Ian is keen that the http-only flag can be set by default (although the https only
  • Welcome Greg Lawrence - Victoria, BC Canada. about to launch production site. interested in geospatial stuff, CSW.

Meeting 2014-11-11

Chair: ian Notes: george

Pull Requests (XX open)

2034 - Ian still working on... Sean to review

2035 - Ian will review

2041 - Will remain unassigned. Anyone should add comment to issue if they have any. Will discuss again on thursday

1905 - Task failing. Assigned to Adria and he will comment on how to fix test failure

Issues (XX open)

2044 - Adria to look at

2043 - will move to ideas repos

2042 - to be marked as good for contribution

2039 - ideas and repos

2040 - will wait for pull request for this

2037 - leave assigned to Adria

General questions: - https://github.com/ckan/ckanapi-exporter (seanh) Sean demoed CKAN API exporter. Ian mentioned that he's working on something related that tries to tackle the lossless json<->csv conversion: https://github.com/wardi/jsonsquared

Meeting 2014-11-06

Chair: Adria Notes:

Pull Requests (XX open)

  • #1234 - Resolution

Issues (XX open)

  • #1234 - Resolution

General questions:

Meeting 2014-11-04

Chair: dread Notes: adrià

Pull Requests (49 open)

  • #1763 - brook
  • #2028 - brook
  • #2027 - ross
  • #2015 - adrià

Issues (191 open)

General questions:

  • Welcome George Sattler - working on Australia portals

Meeting 2014-10-30

Chair: adria Notes: ian

Pull Requests (50 open)

  • #2024 - adria
  • #2023 - adria
  • #2021 [wip] assigned to ross
  • #2016 - sean
  • #2015 - change default to not expire
  • #2010 - adria

Issues (197 open)

  • #2017 - joe
  • #2012 - ross
  • #2011 - adria
  • #2008 - ian
  • #2007 - ross assigned, adria to offer assist

General questions:

  • ideas #77

Meeting 2014-10-28

Chair: sean Notes: ian

Update - RP

Pull Requests (46 open)

Issues (192 open)

  • #2001 - ross
  • #1997 - sean

General questions:

Meeting 2014-10-23

Chair: adria Notes: ian

Pull Requests (46 open)

Today is probably better to use this link: https://github.com/ckan/ckan/pulls?q=is%3Aopen+is%3Apr+no%3Aassignee+no%3Amilestone

  • #1992 - merged
  • #1991 - ian will suggest moving docker development to ckan/docker and email lists
  • #1672 - ian likes trivial fixes
  • #1396 - adria to merge
  • #912 - joe
  • #832 - sean

Issues (190 open)

  • (no new issues)

General questions:

Meeting 2014-10-21

Chair: Sean Notes: dread

Pull Requests (44 open)

  • 655 john
  • 1987 sean
  • 1985 dread
  • 1983 amercader

Issues (244 open)

  • 1988 sean
  • 1982 amercader

General questions:

  • (Brook) Coding standards query - refering to issue numbers from PR commits when no issue exists (http://docs.ckan.org/en/latest/contributing/commit-messages.html#writing-commit-messages)
    • create an issue
    • suggest use 'hub' to convert an issue to a PR
    • toby has a script
    • general discussion about commit messages with the issue number VS writing a good message. decided to stick with issue number AND encourage good message
  • (Adam) Do we change ckan-dev to not allow html email / strip images (in sigs, in-line)
    • adam concerned about easyness of replying, it is a messy thing to do
    • others think it is helpful for lowest ability users to be able to send a screenshot - that might be all you get
    • general feeling to discourage but not disallow

Meeting 2014-10-16

Chair: adria Notes:

Pull Requests (40 open)

  • #1234 - Resolution

Issues (254 open)

  • #1980 - adria to respond
  • #1979 - ian to respond

General questions:

Meeting 2014-10-14

Chair: adria Notes: ian

Pull Requests (41 open)

  • #1978 - joe to review today
  • #1974 - sean
  • #1967 - ian
  • #1973 - sean
  • #1972 - sean
  • #1971 - ian
  • #1968 - adria

Issues (254 open)

  • #1977 - sean to request contribuition from reporter
  • #1976 - we should crash earlier if the necessary config setting is missing, sean
  • #1970 - ian
  • #1969 - vitor
  • #1966 - ian

General questions:

Meeting 2014-10-09

Chair: ian Notes: Dread

Pull Requests (36 open)

  • #1965 - ian
  • #1962 - joe

Issues (249 open)

  • #1963 - vitor
  • #1964 - vitor
  • #1961 - joe
  • #1959 - sean

General questions:

Meeting 2014-10-07

Chair: David Notes: Adrià

Pull Requests (36 open)

  • #1958 - Brook's first! sean
  • #1956 - Improve ckanext templates, joe to look into it
  • #1817

Issues (XX open)

  • #1957 - Docker, Ian to look into it

General questions:

  • Patch releases, announce tomorrow, out next Wed, please test http://beta.ckan.org/ (amercader)
  • wardi: docker docs
    • Is someone working on Docker? If so share your comments
    • sean: flag it as beta things missing: run tests, install extensions, upgrade your site, paster commands, working as a dev environment sean: can we have a single dcoker setup for dev and prod? wardi thinks they will look quite different what problem is docker solving? - one-line deployment? better development environment? easier mulittenant hosting? reliable testing?
  • (dread) http://www.shippable.com/ - Travis replacement using Docker

  • (joe) python 2.7/drop postgres 8.4? or were we all in agreement on irc?

    • drop python 2.6?
    • RH6 supports 2.6 until 2020. RH7 has py2.7 & pg9.
    • better to drop postgres 8.x - amercader implications for the datastore - datastore runs in 'legacy' mode - you can't run sql queries. some workarounds in pg8. perhaps start using http://pythonhosted.org/six/ ?

Meeting 2014-10-02

Chair: Joe Notes:

Pull Requests (41 open)

  • #1234 - Resolution

Issues (245 open)

  • #1234 - Resolution

General questions:

Meeting 2014-09-30

Chair: adria Notes: ross

[Pull Requests]

  • #1914 rebuild search indexes after tracking update - joet is on the case.
  • #1953 Don't require a page reload to expand the catalog search filter options [johnm]
    • Like it in principle. JohnM will feedback on JS, wardi to feedback on python.
  • #1952 Add dependencies needed by python requests for SNI support
    • Ross to go back and suggest doc change instead.
  • #1951 Make placeholder images https enabled.
    • Looks ok
  • # 1948 Backport #291 into 2.0.5 release [adria looking]
  • #1947 Fix sphinx html build [joet]

[Issues]

  • #1954 datastore_search_sql with authorization should show private datasets.[ross to feedback on auth problems]
  • #1803 Get DataStore and DataPusher working in the Docker install
    • Redirect to mailing list

[Other]

  • Release schedule. We don't know when, need guidance from CKAN Assoc on where the resourcing Dev Team Preference is for more frequent point releases and fixed date major releases.

General questions:

  • release schedule 2.3 still lots of work to finish

Meeting 2014-09-25

Chair: adria Notes: ian

Pull Requests (40 open)

  • #1947 - spurious travis error?

Issues (XX open)

  • #1948 - this option should already exist, ian
  • #1946 - sean

General questions:

Meeting 2014-09-23

Chair: amercader Notes: joet

Pull Requests (XX open)

  • #1936 - adria to fix tests and assign to sean
  • #1938 - homepage fix - assigned to adria

Issues (XX open)

  • #1944 -

General questions:

  • Security audit, related issues

Meeting 2014-09-18

Chair: adria Notes: ian

Pull Requests (40 open)

  • #1935 - responsive master, may cause some theme breakage, adria
  • #1661 - turn off openid by defailt, adria
  • concerns about supporting gunicorn in 2.3

Issues (237 open)

  • #1934 - org in package dictize image url wrong, maybe fixed on master? adria

General questions:

  • Sean: What shall we do with the stats plugin? delete it? enabled by default but not linked in templates. adria will look at hiding datasets appropriately

Meeting 2014-09-16

Chair: adria Notes: ian

Pull Requests:

  • #1873 - adria
  • #1929 - ian
  • #1913, #1925 - joe (no sql injections, thanks)
  • #1924 - adria
  • #1878 - adria

Issues:

  • #1933 - ian
  • #1932 - adria
  • #1930 - sean
  • #1927 - joe to suggest requestor submit fix

General Qquestions:

  • Sean: What shall we do with the stats plugin?

Meeting 2014-09-11

Chair: adria Notes: ian

Pull Requests (37 open)

  • #1921 - call package_show from resource_show - joe
  • #1682 - assigned back to nigel
  • #1920 - adria
  • #1919 - adria
  • #1911 - joe

Issues (XX open)

  • #1917 - sean
  • #1914, #1913 - good for contribution, sean
  • #1907 - joe
  • #1768 regression in featured org on homepages

General questions:

  • ian - idataserform customize resource view?

Meeting 2014-09-09

Chair: Sean Notes: Dread

Pull Requests (36 open)

  • 1881 Sean
  • 1886 Dread
  • 1911 Ian
  • 1908 sean

Issues (236 open)

  • 1915 Ian to reply saying won't do it
  • 1914/1913 encourage PR
  • 1912 Ian encourage PR
  • 1910 Sean to say he's confused
  • 1907 general encouragement

General questions:

  • dread - Harvesting - show provenance, not editing, general rewrite - complicated queues, unclear state machine,
  • joe - suggest putting alias verb_noun_schemas as noun_verb_schema? (e.g. dataset_show_schema) - sounds good
  • sean - ckanext-qa https://github.com/datagovuk/ckanext-qa (you need ckanext-archiver & ckanext-report too)
  • ian - ckanext-fluent https://github.com/open-data/ckanext-fluent is a factoring out of ian's multilingual code, useful for the average multilingual CKAN site. Allows (nearly all) dataset fields to have values in multiple languages. Make it core?

Meeting 2014-09-04

Chair: Notes:

Pull Requests (35 open)

  • #1612 ian already assigned

Issues (230 open)

  • #1905 - resource names would be a nice thing to have indexed, good for contribution, joe assigned
  • #1904 - ian

General questions:

  • organization_update removes all members if you do not pass 'users'. Can we remove the mis-feature? I don't care if it's backwards incompatible, no one should be using it for user management.. - Should change so that explicitly sending an empty list removes the users, not providing it doesn't change the users.
    • wardi IValidators/IConverters, do we really need both? wardi feels like it's silly to have both. scheming will need to do both https://github.com/open-data/ckanext-fluent/blob/master/ckantext/fluent/converters.py#L34-L95 . wardi would just get rid of converters and keep only validators. Needs more discussion
    • nigel: reimplement datapusher in the datastore extension with celery+redis? ian to create idea ticket
    • sean: disable stats extension on new installs
    • thursday meetings half an hour later?

Meeting 2014-09-02

Chair: joe Notes: ian

Pull Requests (XX open)

  • no new PRs

Issues (XX open)

  • #1903 - authz remove, +1 from joe and ian

General questions:

Meeting 2014-08-28

Chair: adria Notes: nigelb

Pull Requests (37 open)

  • #1899 - assigned to sean
  • #1900 - assigned to sean
  • #1898 - assigned to adria
  • #1894 - assigned to joe
  • #1443 - almost there, only 20 errors or so that needs fixing. assigned to nigel.

Issues (228 open)

  • #1902 - will asign to sean at next meeting
  • #1901 - assigned to nigel
  • #1896 - closed

General questions:

  • wardi IValidators/IConverters, do we really need both? wardi feels like it's silly to have both. scheming will need to do both. wardi would just get rid of converters and keep only validators. Needs more discussion
  • add to ideas from steering group? - https://docs.google.com/a/okfn.org/document/d/1B3NXewTdgCa1uwK6n0f9dHSKTJyzh27NTmzSmLzVEFk/edit
  • Hello NuCivic folks! Looking to see where NuCivic can help. Any help in ckanext-drupal7 would be very helpful. Recline is also a good place to help. Harvester is also good target since it uses API v2 and not API v3. There's also Good For Contribution bugs.

https://github.com/ckan/ideas-and-roadmap

Meeting 2014-08-26

Chair: adria Notes: nigel

Pull Requests (35 open)

  • #1894 - sean to take a look. weird test failure
  • #348 - adria will supervise
  • #1895 - ian will review
  • #1893 - nigel to review

Issues (227 open) ZAARO (new) BUGS

General questions:

  • nigelb - Inviting DKAN folks. Let's open a conversation to fix issues in the time that they will be donating to the association. How does the hours thing work? We'll talk to Aaron and others whe they attend a meeting. We could potentially use the time to work on Recline or resource views which is less python and would be overall helpful to both sides. We'll wait until they can confirm what bits can help both CKAN and DKAN. Nigel to coordinate.
  • nigelb old PR with broken tests - https://github.com/ckan/ckan/pull/1707
  • ian - scheming support branch - ian has things to add to the plugin toolkit - separate branch for it? adria says yes
  • dread - model tables setup on start-up. Use a paster command instead of running it every time the extension is loaded automatically. Automatic makes it easier for users. Documentation on how to use the db extension.
  • sean - blog extension from sweden - c.f. ckanext-pages
  • rgrp - informal meeting with streering meeting. Will report about the meeting soon. We need a high-level technical roadmap, no commitment to time, but an idea of what we want to build for feedback from people and see if people want to work on it. Members who sign up could commit to those issues. Ideas from steering group - https://docs.google.com/a/okfn.org/document/d/1B3NXewTdgCa1uwK6n0f9dHSKTJyzh27NTmzSmLzVEFk/edit .Github does not provide the high-level overview. Link item to github ideas repo.
    • How does in-kind time work? Will they deicde or will tech team decide. It will be a mix with members because it would easier if it was aligned with their interest.
    • To what extend does tech team decide on priority for items on this list? Tech team would have a good input in that regard. In terms of features, users would have more knowledge about features, while tech team would have more knowledge of tech debt. The roadmap will need to be a mix of both.
    • Actions from team - Edit/comment on the list in the document
    • Description is too brief and items on there would need full description elsewere, preferably ideas repo. This isn't about implementing something, but about facilitating discussion.
    • Initial steering group will have data.gov, data.gc.ca, data.gov.uk, and Open Knowlege (shh)
    • We need to decide on what needs to go into this list at the next meeting or on Tuesday

Meeting 2014-08-21

Chair: Notes: ian

Pull Requests (34 open)

  • #1891 - nigel already replied
  • #348 - .n3 support old pr back from the dead, adria assigned

Issues (XX open)

  • #1892 - wardi
  • #1890 - joe
  • #1889 - nigel

General questions:

  • ckan install stories
  • ckan performance moaning

Meeting 2014-08-19

Chair: adria Notes: ian

Pull Requests (x open)

  • #1888 - improvement to tracking update command, sean to take a look
  • #1885 - fix org image src link - adria volunteered

Issues (x open)

General questions:

Meeting 2014-08-14

Pull Requests (30 open)

  • #1883 - adria
  • #1882 - joe
  • #1795 - (adria). Wardi had planned more, but there is enough currently to review in a single pull request. Change datasetform now rendered as a snippet, was previously done in the controller. Added deprecatred_lazy_renderer used for old forms/templates in Genshi, allows tests to pass will also jinja2 templates that override package_edit form from controller. Code that prevented access to c object in snippets have been removed as it was implemented confusingly (which we should be avoiding anyway)

Issues (226 open) no new issues!

Apologies: Sean (Singapore)

General questions: https://github.com/ckan/planetckan

We (OKF) talked about wanting a developer blog where devs can post about features etc.
Instead of a blog, why not a "planet" site that pulls in posts from feeds?
Then devs can post to their own blogs, and also get it on the planet automatically..
Also it can be a CKAN thing not an OKF thing.
We can add lots of people and orgs from the community.
Theme it properly, put it at planet.ckan.org, put link in ckan.org header.
We would need a few more blogs for it to get started I think -- too few on there currently.
Also people may want to add CKAN-specific tag or category feeds instead of their main blog feeds.
What do people think?
Sounds good
might need some curation - needs filter by a tag (e.g 'ckan').

Meeting 2014-08-12

Chair: Adria Notes: ian

Pull Requests (28 open)

  • #1879 - joe to review, backport planned
  • #1443 - adria
  • #1841 - WIP
  • #1877 - adria to merge
  • #1817 - waiting for vdm release
  • #1861 - ckan express will be a good test of gunicorn in prod, will wait for results of further testing
  • #1682 - ian, for backporting too

Issues (227 open)

  • #1878 - joe needs a number
  • #1876 - adria
  • #1874 - resource last updated used by archiver extension, adria

General questions:

  • security mailing list (dread) - adria suggests we just continue with the ckan committers list
  • multilingual fields (wardi) - storing languages as a json blob { 'en': blah, 'fr:blah }. Plans to use multilingual solr schema as a guide.
    • need to link to the right place for security reports

Meeting 2014-08-07

Chair: joet Notes: Dave

Pull Requests (XX open)

  • no needed assignment

Issues (XX open)

  • #1874
  • #182

General questions:

Meeting 2014-08-05

Chair: David Notes: Joe

Pull Requests (29 open)

  • #1234 - Resolution
  • #1871 - (Joe)
  • #1682 - (wardi)
  • #1861 - wardi - is gunicorn generally better?(wardi)

Issues (221 open)

  • #1234 - Resolution
  • #1870 - (vitor)
  • #1868 - (joe)
  • #1866 - (sean)
  • #1865 - (dread)

General questions:

Meeting 2014-07-31

[Pull Requests (29 open)]https://github.com/ckan/ckan/pulls?q=is%3Aopen+is%3Apr+sort%3Aupdated-desc]

  • #1861 - We'll add comments. We can't drop Apache. Need to support both.

[Issues (221 open)](https://github.com/ckan/ckan/issues?q=is%3Aopen+is%3Aissue]

General questions:

  • Fanstatic's resource.config. Needs docs. Nigel or Sean to pick up the issue.
  • Datastore SQL search security issue
  • Help on api calls
    • Link to html docs. Cons: We can break the links.
    • help_show action returning the docstring.
  • Updated https://github.com/ckan/ckanext-repo

Meeting 2014-07-29

Chair
Sean
Notes
nigelb

[Pull Requests (33 open)[https://github.com/ckan/ckan/pulls?q=is%3Aopen+is%3Apr+sort%3Aupdated-desc]

  • #1828 - Assigned to davidread
  • #1819 - Sean to pick it up tentatively. Waiting for Adria.
  • #1696 - Assigned to Nigel
  • #1657 - Joe to close
  • #1600 - Assigned to Ross

[Issues (220 open)](https://github.com/ckan/ckan/issues?q=is%3Aopen+is%3Aissue

  • No new issues!

General questions:

  • dread: ckanext-qa and ckanext-archiver - can we merge in the DGU branch and call it v2. The problem is the OKF version in github/ckan uses the awful TaskStatus and now data.gov have started using it, issuing pull requests and as a community we shouldn't care for two forks. add in a tag for v1. agreed.
  • nigel: can we shift ckanext-googleanalytics to deprecated and make the DGU fork the main one? It has support for the new google oauth API, which our version doesn't. Mark old one as deprecated. DGU need to add in the templates for ckan 2.
  • datapusher pull requests! . Nigel to figure out time for working on datapusher
  • CKAN Association - Nigel to ping adam.

Meeting 2014-07-24

Chair: Vitor Notes: Nigel

Pull Requests (38 open)

  • #1714 - dread to review
  • #1792 - not blocked, but still WIP, vitor talk to adria
  • #1701 - already assigned to joet. dateutil assumes mm/dd/yyyy if ambigous. It may bite someone in the future.

Issues (260 open)

  • #1858 - assigned to nigel
  • #1857 - good for contribution
  • #1856 - vitor to take a look
  • #1852 - currently the defaultview is hard-coded and needs changing. vitor and adria working on it.
  • #1849 - vitor to ping johnmartin/sam

General questions:

  • Datapusher/ckan-service-provider issues/pull requests (nigelb) - agreed to discuss at next dev meeting
  • full-text search on non-textual fields (vitor) - can't filter for time/year. Only text. vitor will talk to adria.

Meeting 2014-07-15

(no meeting, everyone off at ckancon. kindly and wardi chatted about what's been happening the past few months)

Meeting 2014-07-10

Chair joe Notes ian

Pull Requests (42 open)

  • #1837 - adria
  • #1836 - adria
  • #1792 - depends on resource views, mess of branches to discuss in berlin
  • #1830 - joe already assigned, not blocked review please (pretty please?)

Issues (260 open)

  • #1838 - vitor to work on, to talk in general questions

General questions:

  • allow full text search on specific columns (#1838), related to #1792
  • make sure datastore user is different than main ckan db user in docs
  • (dread) Tag Extras https://github.com/ckan/ideas-and-roadmap/issues/68 - look at using json filter index
  • (dread) DataPusher notification triggered on before_commit - suggest change to after commit

Meeting 2014-07-08

Chair adria Notes ian

Pull Requests ( open)

  • #1828 env variables for config settings, wip seanh
  • #1792 wip resource views, to revisit when vitor is at meeting
  • #1836 exception logging middleware, can we set inherit=True as a default to avoid future interface change breakage? add a prettier error message? adria to investigate
  • #1732 tests written by submitter - wardi to review
  • #1826 sphinx test - nigel
  • #1591 ongoing translation discussions - adria
  • #1830 multiple datastore values - assigned to joe

Issues ( open)

  • #1835 docker-test-environment, wardi
  • #1834 ?
  • #1833 wardi assigned
  • #1822 IPackageController docs incomplete, let's remove the deprecated methods, nigel assigned
  • #1829 ongoing lessc discussion, lesspyc doesn't work for our less files; let's keep using the ppa

General questions:

* CKAN command? (Sean added this but can't make the dev meeting today)
  Really needed to make running commands in the docker container easier.
  Also needed so we can template both the dev/prod and test config files.
  How to implement it?
      (See       Sean's thoughts at the bottom)
  • Any topic that the tech team wants to raise at CKANCon [ckon!] with the community? https://docs.google.com/a/okfn.org/document/d/12Oj5n1POukUW6Kl7oFRIAXYAAGivExNtOEylD7Dvo5g/edit Sean's thoughts:

    Rewrite cli.py with docopt. Don't want to duplicate any of the UI code   that defines the commands, sub-commands, options and docstrings.
    Delete all this and re-write it with docopt. But the code that  actually  carries out the commands - just keep it as-is but have it  called by our
    

    new docopt stuff. Most of the non-CKAN paster commands aren't needed, but we will still need paster serve and paster post at least. For these, re-implement their UIs and docs in docopt, duplicating the UI stuff, just wrap them and call paster. paster make-config to be completely replaced by a new ckan make-config that just renders a Jinja2 template, accepting settings from env vars, and can be used to render both the dev/prod config file and the test one. The ckan executable to be installed as a script or console command or whatever in setup.py, so it ends up in the bin dir of the virtualenv. As soon as you activate a virtualenv, you get that CKAN instance's ckan command on your PATH. For the package install, we can make it symlink the ckan_default virtualenv's ckan executable onto the system-wide path so you don't even need to activate the virtualenv. For the source install we can add a command to make the same symlink. So by default you'll get the default CKAN instance's ckan command, but if you have multiple instances installed and activate one of their virtualenvs then you will get that ckan command. For docker we'll use CMD or ENTRY_POINT in the Dockerfile so you can just do docker run serve or maybe docker run ckan serve without typing the full path.

Meeting 2014-07-03

Chair ian Notes ?

Pull Requests ( open)

  • #1814 - nigelb
  • #1591 - amercader already speaking to them
  • #1826 - joet
  • #1697 - package patch - discussion continued. wardi arguing with himself. Preferring simpler method wip
  • #1827 - is a fix for 1720 that is already assigned to nigel
  • #1824 - related to 1826? joet
  • #1799 - amercader
  • #1819 - do we want to allow patch releases of requirements to be automatically updated? Disucssion has a while back, where requirements were pinned
  • #1530 - passlib - amercader will try to do a 2nd review

Issues ( open)

  • #1830 - vitor
  • #1829 - Do we want to move away from nodejs and use a python implementation? - nigelb
  • #1822 - Already marked as good for contribution - possible backwards incompatilibity issue if they are relying on dataset reprensentation in api v2
  • #1821 - wardi
  • #1820 - joet - probably broken for many other unicode characters?
  • #1816 - amercader

General questions:

* CKAN command? (Sean added this but can't make the dev meeting today)
  Really needed to make running commands in the docker container easier.
  Also needed so we can template both the dev/prod and test config files.
  How to implement it?

  Sean's thoughts:

  Rewrite cli.py with docopt. Don't want to duplicate any of the UI code that defines the commands, sub-commands, options and docstrings.
  Delete all this and re-write it with docopt. But the code that actually carries out the commands - just keep it as-is but have it called by our
  new docopt stuff.
  Most of the non-CKAN paster commands aren't needed, but we will still need paster serve and paster post at least. For these, re-implement
  their UIs and docs in docopt, duplicating the UI stuff, just wrap them and call paster.
  paster make-config to be completely replaced by a new ckan make-config that just renders a Jinja2 template, accepting settings from env vars,
  and can be used to render both the dev/prod config file and the test one.
  The ckan executable to be installed as a script or console command or whatever in setup.py, so it ends up in the bin dir of the virtualenv.
  As soon as you activate a virtualenv, you get that CKAN instance's ckan command on your PATH.
  For the package install, we can make it symlink the ckan_default virtualenv's ckan executable onto the system-wide path so you don't even need to activate the virtualenv.
  For the source install we can add a command to make the same symlink.
  So by default you'll get the default CKAN instance's ckan command, but if you have multiple instances installed and activate one of their virtualenvs then you will get that ckan command.
  For docker we'll use CMD or ENTRY_POINT in the Dockerfile so you can just do `docker run serve` or maybe `docker run ckan serve` without typing the full path.

Meeting 2014-07-01

Chair: Adria Notes: ian

Pull Requests (41 open)

  • #1817 - upgrade sqlalchemy, requires some vdm changes in sqlalchemy-0.9-support branch, dread assigned
  • #1777 - add api example to docs, better in a source file with a test, sean takes it
  • #1734 - sean to merge
  • #1658 - looking for second reviewer, adria busy for next couple weeks.. anyone?
  • #1725 - joe merged
  • #1732 - requester to add tests
  • #1814, #1813 - docker-related nick assigned
  • #1879 - package_patch: to discuss in general questions
  • #1799 - sentry middleware, nigel to review; discussion around entry point required for sentry and other similar middleware, current middleware plugin isn't perfect for this case
  • #1412 - users regenerate api keys, ongoing
  • docker was merged!
  • #1798 - sean assigned
  • #1797 -

Issues (256 open)

  • #1819, #1816: requests + sqlalchemy version upgrades; nor more requirement upgrades add comments to #1816
  • #1818 recource_show auth done wrong, sean to respond
  • #1815, vitor is working on distinct with datastore
  • (lots of docker issues), #1809 suggests removing old packaging scripts
  • #1800 issues migrating from old docker to new docker config, issue for dev list?
  • #1796, celery? ckanext-queue? we need background tasks for a few things. Celery+redis? redis by itself? queues are hard; let's go shopping. Ask open spending about their celery experience https://github.com/okfn/ckanext-queue

extras to discuss:

  • #1768 organization_list all_fields misses out extras and users
  • #1796 Changing group name can time out

General Questions

Meeting 2014-06-26

Chair: ian Notes: joe

Pull Requests (47 open)

  • #1765
  • #1659 - still discussing tests
  • #1793 - Cannot determine why all cookies starting with ckan exists, behaviour seems bad. dread to review
  • #1755 - dockerfile :-) ping nigel to see if has time soon to review.
  • #1786 - joet to merge
  • #1782 - going to be moved to wiki as it seems it will be more useful, issue will be closed, sean will comment
  • #1725 - to merge subject to minor change re read_url
  • #1251
  • #1492

Issues (250 open)

  • #1796 - assigned to dread for now, discussion to continue
  • #1794 - leave with vitor for now, joet thought we required this for ckan-pakistan project so it might exist already.
  • extensions.ckan.org

General Questions

  • retiring issues- we should cull old issues
  • rufus wants commit access to be able to close old PRs himself (discuss at next meeting)

Meeting 2014-06-24

Pull Requests (51 open)

  • #1659 - Almost there, model for new functional tests
  • #1755 - Docker: docker links for postgres / solr
  • #1776 - joe assigned
  • #1786 - nick to look at test failure, joe to review
  • #1783 - ckan hardware requirements: easy to get out of date, really depends on the number of datasets, other factors, joe to come back to adam

Issues (x open)

  • #1789: ross to look at it
  • #1788: expected 404 on deleted thing
  • #1785: should be possible to only connect to the db / solr when needed,
  • #1784 amercader to work on it at some point

General Questions

Meeting 2014-06-19

Chair: joe Notes: wardi (for a bit at least)

Pull Requests (48 open)

  • #1686 nigel already assigned
  • #1734 assuming nigel is still working on it
  • #1755 nigel to review, possibly others
  • #1725 joe assigned, nigel to look as well
  • #1412 joe assigned
  • #1777 nigel assigned

Issues (244 open)

  • #1781 unicode in site title issue - will ask for pr, sean assigned
  • #1780 many ways to get user - wardi assigned
  • #1779 resources disappearing (we should fix our API for updating resources) - nigel assigned
  • #1776 datastore empty array failure - assigned to vitor
  • #1775 owner_org_validator can't be overridden by auth - general agreement that the issue should be fixed, sean assigned and will mentor submitter towards a fix

General questions

Meeting 2014-06-12

Chair: amercader Notes: nigelb

Pull Requests (55 open)

  • #1745: Agreed that style (d) works best, though we don't mind style (b). Adria to look.
  • #1757: Assigned to sean.
  • #1766: Assigned to nigel.
  • #1765: Assigned to Ian. We would stick the unvalidated package dict as validated.
  • #1664: Waiting for tests
  • #1658: Already assigned to Ian
  • #/1659: Assigned to vitor.
  • #1761, #1760, #1759, #1758 - Assigned to sean.

Issues (247 open)

  • # 1769: Nigel
  • #1768: We'll wait for dread to explain.
  • #1767: Assigned to vitor.
  • #1764: Related to #1765.
  • #1763: User-error. Adria will get back to user.

General questions

  • Road to 2.3 (amercader) What should go into the next stable release (without thinking about time)
    • Resource views (#1251) - vitor working on this
    • Upgrade requirements
    • Turn off OpenID (#1661) - joe
    • Docker (#1755) - nick
    • Ubuntu 14.04 (#1651) - nigel
    • #1530] use passlib for passwords / apache log - joe
    • Nuke Legacy templates +∞ need to create an issue-> (some) new functional tests -ian
    • call_action - open, no issue yet.
    • after_/before_action - Needs a bit of discussion
    • responsive(?) - nigel to follow up with sam.
    • How to avoid a plugin to be loaded? (vitor) - vitor to create an issue explaining the use case
    • Validators that convert data as well (vitor)- vitor to create an issue explaining the use case

Meeting 2014-06-10

Chair: adria Notes: ian

Pull Requests (49 open)

  • #1734 main.debug.css - can we compile these less files with python? node is difficult to install for some users. wardi: compile debug at the same as prod css as part of release?
  • #1659 - vitor assigned again

Issues (239 open)

  • #1753 no new_ names, adria: +1, toby: rename new_authz and let things importing it break.
  • #1752 #1751 example extensions should have the same directory layout as real extensions
  • #1750 vendor versions not minified (?) assigned to vitor
  • #1749 good for contribution
  • #1748 web site problem
  • #1747 option to allow html in some markdown fields, toby to make PR
  • #1713 to backport fix to 2.2

General questions

Meeting 2014-06-05

  • Chair: Dread
  • Notes: Adrià

Pull Requests (50 open)

Issues (236 open)

General questions

sanitize urls / content


Meeting 2014-06-03

Chair: Ian Notes: dread

Pull Requests (49 open)

Issues (235 open)

  • https://github.com/ckan/ckan/issues/1741 Don't think the vuln is exploitable without edit permissions. No deliberate DOS events so far. Discussion about python 3, moving off pylons. Ian says hard bit to be joint python 2.7/3.3 compatible is the strings. Point him at move from pylons info. Assigned to wardi.
  • https://github.com/ckan/ckan/issues/1737 could be difficult -needs a background service to do it - an extension or something else. wardi will point him to roadmap.

Meeting 2014-05-29

Chair: Ian

Notes: Adrià

Pull Requests (46 open)

  • #1734 sean will look into it
  • #1727 nigel to answer back or merge it if he is happy

Issues (229 open)

No new issues

General Questions:

--- nigel away, deferred

Meeting 2014-05-27

Chair: Sean

Notes: Ian

Pull Requests (47 open)

  • #
  • #1724 - baseimage docker concerns from sean, vitor has been using docker for ~8 months with no problems
  • #1731 - resource extras in solr - wardi assigned
  • #1730 - vitor assigned

Issues (231 open)

  • #
  • # 1733 - adria: nigel said this would be easy for the new filestore, nigel assigned
  • # 1729 - need to backport fix from resource-views branch

General Questions:

  • navl_validate is in toolkit, adria has another use for it
  • sean: plugin toolkit refactor, all agreed with removing class that replaces module
  • adriaL check_access_core for plugins overriding access checking to call original check
  • sean: docker discussion

--- nigel away, deferred

  • Nigel: responsive branch
  • Nigel: Post to ckan-announce about datapusher bug / new package release
  • Nigel: ckanext-searchhistory

Meeting 2014-05-22

Chair: Adria

Notes: Ian

Pull Requests (46 open)

  • #
  • #1503 assigned to dread
  • #1686 docs for recommended use of templates - nigel
  • #1694 more docs, also nigel
  • #1727 to add a doc page about deprecated features

Issues (228 open)

General Questions:

--- nigel away, deferred

  • Nigel: responsive branch
  • Nigel: Post to ckan-announce about datapusher bug / new package release
  • Nigel: ckanext-searchhistory

Meeting 2014-05-20

Chair: Adria

Notes: Ian

Pull Requests (47 open)

  • #1707 - show a resource in any dataset, adria to help fix controller tests
  • #1652 - nigel to look at
  • #1724 - to discuss on thursday
  • #1721 - avoids an extra get request on signup - nigel to review
  • #1658 - passlib, nick and a number of us to view and comment, ian assigned
  • #1701 - solr indexing current date on empty fields - joe
  • #1723 - joe assigned
  • #1711 - david raznick's opinion of some changes sought, will merge first anyway

Issues (231 open)

  • no new issues! (applause)

General Questions:

-- rest punted until Thursday

  • Census is great - could i get responses shared
  • Nigel: responsive branch
  • Nigel: Post to ckan-announce about datapusher bug / new package release
  • Nigel: ckanext-searchhistory

Meeting 2014-05-15

  • Chair: amercader
  • Notes:

Pull Requests (47 open)

  • #1711 pr is ready, original intention seems to be that you cannot update packages in organization update. pr fixes this (and the broken test)

Issues (233 open)

General Questions:

Meeting 2014-05-13

Chair: Nigel

Notes: Adrià

Pull Requests (46 open)

Issues (230 open)

  • #1715 Assigned to Ross
  • #1713 Ask user to test on master and see if it's still fails
  • #1712 Assigned to vitor
  • #1710 Ask user for a patch
  • #1709 How do we manage multiple extras in multiple resources? Assigned to adrià
  • #1708 Ask user for a patch, assigned to joe
  • #1706 leave as is
  • #1705 remove /dataset/search endpoint. Ask more details about user extension that might be causing the issue

General Questions:

Meeting 2014-05-08

Chair
amercader
Notes
nigelb

Pull Requests (45 open)

  • #1665: nigel already reviewing.
  • #1679: new type of action. should probably be in its own file. lets you provide a json patch to update a package. allows us to do atomic updates or updates that don't clobber each other. Ian wants feedback and someone else to take the issue :) json patch is list of operations. there's move, test, etc. So you can test your patch if a certain parameter fails. You can make it fail if it isn't what you wanted it to be. You can update a resource object or add a resource. If you want to update a whole resource you can do that. David asks if we would use revision id, Ian clarifies that is not how it's done. We're using a json patch library. It needs to be wrapped in things. The four lines it is right now is not complete. This is not atomic. If we want it to be better, we can build the patch into package_update. All of the business logic will need to be explicit, like about resources. The complexity will be in package_patch. We will need to consider what happens when someone sends an empty list of extras. We don't want to break anything. package_update should stay as is. It could potentially provide atomic updates to our user. There's more work, like it's own module and validation. Ian will stay assigned. Generally agreed it'll be really cool. The sooner we integrate, the better.
  • #1696 Groups authorization bug. Nigel to continue working on.
  • #1251 ongoing
  • #1697 Ian to look again
  • #1677 Vitor already reviewing
  • #1512 Vitor will review. Need to check about localization.
  • #1688 Adria to look
  • #1617 assigned already
  • #1605 assigned already
  • #1659 need to talk about tests

Issues (221 open)

  • #1704 Need to take a look at library support. Allowing HTML is scary. Assigned to Nigel.
  • #1701 If you're building a filter with dates, you'll get a lot of datasets with index date. We could also have 2 fields, one for string. And one for indexed. But the date field in solr will still be a proper date field. Adria already has a patch. We can discuss more.
  • #1700 Vitor and Nigel to figure out. * ubuntu 14.04 support - to be decided about packages. We don't support ckan 1.8 unless there's a massive security bug.

General Questions:

  • (amercader) Feedback on CKAN surveys. Add stuff, remove? http://pad.okfn.org/p/ckan-surveys
  • (ian) functional tests with webtest: We need a way to test controllers. The suggestion is to start using webtest again, because in the scenario we don't care about js. Unless there's opposition, we'll use webtest with BeautifulSoup. Let's write one example with a pull request to discuss next week. Nigel to do this. David Read already has an example: https://github.com/ckan/ckan/blob/master/ckan/new_tests/controllers/test_util.py
  • (nigel) Template tracebacks. Nigel wrote pull request to catch all exceptions so templates don't blow up. We should do a wrapper or something. Adria thinks helper should catch all expected exceptions. Catch the exception but re-raise it if debug mode is on. Otherwise make sure it sends an email. Ian wants the emails sent out. And about failures that may be related to us catching the exceptions. Agreed that catching all exceptions is a bad thing.
  • (vitor) Logic about querying models outside of the models themselves: There were few places where we're querying models, like cli.py. Should we refactor that into models themselves. Adria agrees that this is a good idea. If the method from the model returned a query, we could add more filters. The might raise DetachedInstanceError. Vitor will bring up on ckan-dev about a more concrete example.
  • (ian) vdm removal + sql for clearing old revisions (support from statcan). The options Ian had were clearing all revisions or dumping the packages into a clean database. Re-creating datasets might change UUIDs. David has a script that delete revisions (It's incredibly hard to do). Ian will try to convince new people to work on removing vdm.
  • (ian) rename new_tests->tests and tests->legacy_tests: +1

Meeting 2014-05-06

Chair
joet
Notes
vitorbaptista

Pull Requests (44 open)

  • #1665 - take care with how this changes the organization permissions as well (nigelb)
  • #1679 - everyone agrees that it's a cool feature, but needs more discussion. we will revisit, please add your comments to the PR. (wardi)
  • #1697 - needs more convincing. vitor will add a good test name that's over the line length limit to prove the point (vitorbaptista)
  • #1659 - 2-stage dataset create is done, just missing (frontend) tests (vitorbaptista)

Issues (221 open)

General Questions:

  • nigelb: Do we land UI changes without tests or do we write old tests rather than no tests?
    • we wondered what' s the issue with webtest. Nigel suggested doing integration tests with webtest through the controllers, and capybara (or something else) for pages that need javascript.
    • Ian would like to unit test controllers. Nigel disagrees, saying that controllers are an integration point, so we shouldn't test them in isolation. Using webtest for controllers is fine. And we can use something for integration tests with javascript later.
    • All in all, we felt webtest was good, but we would like to hear seanh/amercader opinions on this. Nigel'll mail ckan-dev talking about it.
  • vitorbaptista: pull requests with commit messages not following our guidelines

Meeting 2014-05-01

Chair
amercader
Notes
nigelb

Pull Requests (48 open)

  • #1692 assigned to vitor
  • re: clean_action pull requst, it breaks calling dataset_show instead of package_show

Issues (230 open)

  • #1696 nigel to take a look. reproducable.
  • #1694 sean will fix.
  • #1598 If you hit the back button in the third page, the data in the third page is lost. The two state data creation might help. The state gets messed up by the package controller. There's no easy solution. We could use hidden fields without breaking customization.

General Questions:

  • amercader: Proposal, dev polls. To know more about the ecosystem, help decide roadmap and recruit help
    • Deployment: What OS do you use, Source install or package, How do you find the install instructions? Solr/ Postgres same machine, What OS would you like to see supported, Would you be willing to help test new releases on your distro? - generally agreed this is a good idea. amercader will setup a demo by next week.

Meeting 2014-04-29

Chair
wardi
Notes
nigelb

Pull Requests (47 open)

Issues (231 open)

  • #1693 sean to reply
  • #1691 Documentation talks about old version of UI. Assigned to vitor.
  • #1690 Activity stream can be disabled, but not revisions. Sean to close.
  • #1688 wardi was trying get support for idea of removing draft stage. marked as good for contribution.
  • #1687 context should not be in templates because of how it tightly coupled. Use get_action helper instead. Jinja has scoping problems when you use set. In other frameworks you would use a dictionary. c is messy and hard to track. Generally agreed that not using c is a good thing.
  • #1686 But calling action functions from template not liked generally.
  • #1681 It's kinda hard writing an expression to catch all domains and all email possibilities.
  • #1678 wardi fixed it.
  • #1676 assigned to adria
  • #1675 general instructions/fixing https issues. talk to other people who have deployed ckan.

General Questions:

  • ckanext-realtime plugin by Justas Azna (reederz) Jutas joined us to talk about it. It observes datastores in real-time. It can makes websockets available to observe datastore. It's an internship project. There's documentation and tests. Once you setup the datastore, you need to make an API call which inserts a trigger. Uses postgres to listen to real time changes. There's a datastore listener script which listens for this, which sends to ckan to redis which sends to websocket server. There's a twisted eventloop between redis and websocket. Just calling the API makes it observable. It has some limitations. Currently, there can only be one websocket connection because it needs authentication and one API key can only get one connection. Justus is going to change it. It wouldn't be an additional load. May need to add multiple websocket servers.
  • vitor: convert issues to pull requests - use "hub pull-request -i " (https://github.com/github/hub). Easy to convert issue to pull request. P

Meeting 2014-04-24

Chair
seanh
Notes
Ian

Pull Requests (39 open)

  • #1667 break long title words - nigel to review
  • #1666 fix for serious errors to data pusher - need a decision on front end tests to add a test, joe to review
  • #1503 two-licenses issue - continued discussion on ambiguity, discusson to continue on pull request
  • #1664 package_create/update auth fix - adria to review, sean to comment on how to add test
  • #1251 resource views - continued work, adria to review
  • #1663 remove repeated string - vitor assigned
  • #1617 DetachedInstanceError - when new session is created old one is closed automatically, leading to a DetachedInstanceError later on, nigel has a fix but further explanation is requested. deep ckan knowledge required
  • #1656 paster db clean fix - seanh assigned
  • #1412 regenerate api keys - needs more tests joe reviewing, currently only usable from the front end. multiple api keys? possibly in the future

Issues (212 open)

  • #1668 deleted user bug - nigel assigned
  • #1665 group auth for logged in user - possibly not complicated to implement, need to investigate why feature was removed in the first place - vitor volunteered
  • #1662 can't deprecate with maintain.deprecated - likely decorator broken on object or controller method, possibly not designed for use around actions - joe to take a look

General Questions:

  • joet: turn off openid by default? - to proceed
  • joet: passlib is ok? https://github.com/ckan/ckan/pull/1658 agreed a great idea, work to continue and multiple reviewers to be requested when ready
  • nigel: email hash https://github.com/ckan/ckan/pull/1657 helper function vs. special context vs. sysadmin access to user_list action, nigel to work on removing from api while still supporting gravatar in the user list controller
  • seanh: DetachedInstanceError questions, discussion of controller, logic, model layers. discussed adding to description to contribting docs along with guidance about how to avoid replicating old code. session and model objects in context? are they singletons? No: session is per-request. model is passed because model.session might create a new session or return the existing one. model is also possibly good for mocking in tests.

Meeting 2014-04-22

Chair
Adria
Notes
Ian

Pull Requests (33 open)

  • #1656 joe to add some notes to docstring
  • #1412 joe to look at it
  • #1617 ready for review, assigned to sean
  • #1655 nigel assigned
  • #1654 wardi assigned
  • #1652 nigel assigned

Issues (207 open)

  • #1651 ubuntu 14.04 LTS support, ongoing

General Questions:

Meeting 2014-04-17

Chair
Adria
Notes
Nigel

Pull Requests (30 open)

  • #1251: sean is looking
  • #1641: still WIP.
  • #1550: nigel still working
  • #1539: adria got volunteered at the last meeting

Issues (205 open)

  • #1649, #1648, #1647: All of them are correct. Someone needs to review and fix it. We'll ask Ross to take a look and review on Tuesday again if he doesn't want to.
  • #1646: nigel
  • #1643: It may potentially need to be removed. A type of homepage might show facets, need digging. This also assumes that there's only one type of package. It could be used in a different type of home page. We could change it so that you can request facets instead of having them declared in your controller.

General Questions:

  • CLA Feedback.
    • Background: As we started the CKAN Association and moved to encouraging more contributions - we needed to get the legal status of CKAN core code on better footing. We (mostly Ira) explored both licence agreements and copyright assignments. Legally we are better protected with copyright assignment (presenting a united front to any who may want to challenge / sue), but data.gov.uk and others presented a strong preference for licencing agreement instead. We also reviewed all the various options that other open source projects and foundations use (usually a mix of the two). Ira talked lots to the JQuery Director who both have copyright assignement (for core devs) and licence agreements for others. After talking to the OKF lawyer, we decided to re-use their agreement (see here: http://contribute.jquery.org/CLA/) which they gave us permission for, with a few small tweaks our lawyer suggested. This meant that we take on less risk, using an agreement that already exists and has been used ‘in the wild’ and hence has set a precedent for how any legal challenges and complications are handled and how well this stands up in court etc.
    • From Meeting: We all agree that we need but the proposed one has issues raised on the repo. The issues raised are not resolved yet. The issues would prefer to be closed when the person who opened it is happy with the response, but we shouldn't bikeshed and decide on a process. Rufus has responded and the dev team will chase it. Most people who have contributed have been employed by Open Knowledge, so historical contributors aren't that big of a problem. Going forward, we need to get it setup for new people contributing. How does this affect extensions? How are things on github.com/ckan considered core and do we make github.com/ckan similarly licensed and marked as core? Extensions need to be published anyway under AGPL. Someone that has been given the CKAN produce re-licensed would have difficulty with extensions. Anyone who created an issue on the cla needs to reply about issue, so we can keep the discussion moving. nigel to arrange meeting to discuss remaining issues in 2 weeks.
  • Office hours. Rufus suggested and the people who want to come in are not peple who want to discuss things. Related issue people in the US who want to make it to the meetings, but the meetings are difficult for the US. From a user POV, this is great, but dev POV, this may end up being dedicated support time. The name is important and "office hours" might convey the wrong meaning. The discussions that we wanted part of it sounded good. Rufus is willing to step up and run a community hangout but needs someone from the tech team to help out. People should propose what they want to talk about. Ira suggested that this needs to be about QA, roadmap, etc. We generally think this is a good idea.
  • (adam) Persistent Hangout? Adam to setup a persistent hangout. - https://plus.google.com/hangouts/_/okfn.org/ckan-dev-call
  • (amercader) Supporting Ubuntu 14.04. Should we support 12.04 and 14.04 at the same time? It also switches to Python 3. Adria will create a new issue and we can start tracking this in there. Do we drop support for 12.04? We can't drop support easily. We could perhaps setup travis for 14.04 and also think about packages.
  • (ira) Frequency of server or internal errors on demo; is this across all of ckan? who looks at logs? why is this so flaky? Demo is flaky for various reasons. Nigel to talk to Ira. David suggested setting up sentry.
  • (amercader) 2.2.1 needs to happen. There are enough bugs to justify this. If you think something needs to be backported, tag it as such.
  • (ira) possible for previews for what the resource file looks on the dataset page. Like a thumbnail of it. Potentially a great extension. If there's already a graph, a thumbnail of it will be really engaging. Potentially do it from a datapusher sort of thing in an extension. Ira to go and get lots of money to get it done!
  • (wardi) moar cla discussion (only if there is time). Ian talked to devs at open contracting. They had seen CKAN but thought it was way too complicated and used Django instead. There wasn't a lot of compelling reasons. This adds danger to CKAN as a project. That'll give competitors the advantage. The copyright assignment bits are the dangerous bits. Was the lawyer's concern about copyright assignment? Copyright is not a very good open source citizen thing to do. The lawyer said this is the most legally defensible position. It is what others are using. It's not balanced, OKF has more rights than everyone else. Copyright assignment vs licencing. In a CLA, you give license, not give copyright. The difference is whether you actually assign copyright.

If there's a chance of someone going to pay to relicense CKAN, it's enough money to rewrite the whole thing. Ira is fairly happy as long as we have some clarity. Ira will look at DCO and see if it meets the things that Ira was worried about. Recommended reading: https://github.com/ckan/cla/issues/2. It's important to capture the questions and motivations of the CLA.

Meeting 2014-04-15

Chair
Nigel
Notes
Everyone

Pull Requests (32 open)

  • #1641 resource_create should break when called without URL (vitorbapista)
  • #1644 - add xlsx tsv to datapusher defaults (joet)
  • #1617 - detached instance error (seanh)

Issues (205 open)

  • #1646 - nigelb will reply
  • #1645 - should be part of a larger discussion about the api, is it consistent with package_show, user_list, etc. The count of the number of packages should be consistent as well, and not clash with another field in another api call - wardi
  • #1643 - seanh

General Questions:

  • (amercader) Meeting notes to wiki: Tricky, as no easy way to export to Markdown. Tried this but not great, as issues #xxx are translated as headings. Perhaps Etherpad allows export to Markdown? - (generally agreed)

Older meeting notes

https://docs.google.com/document/d/1MRNmhqBthZILBF8oG1NkwmyofRfOXr3NRJA1CCuHVD4/pub