Add import comments from JOIN Taiwan

[pm5]

Hi. I added some code to import comments from the policy discussion service https://join.gov.tw/ in Taiwan. JOIN Taiwan is a service for citizens to propose and discuss about policy changes much like VTaiwan https://vtaiwan.tw/. Both are maintained by the Taiwanese government. In some heated debates such as gay marriage legislation, there may be ~10k comments under a single proposal. We are interested in seeing if Wikum can help us sort out information in this set of data.

We are also working on a tool to sort out the opinions in forum discussions at https://sense.tw/. We hope we can gain some insights from this experiment. Thanks for the good work!

[amyxzhang]

Hi @pm5! Thank you for your pull request! I am very excited to look into whether Wikum can be helpful to you and will get this merged in ASAP. Please do not hesitate to file issues for features you would like to see added or bugs that you notice!

[amyxzhang]

Everything looks good! I will merge this and get it onto the production server momentarily.

[amyxzhang]

Ok, I was able to import a small discussion from JOIN Taiwan into Wikum successfully!
http://wikum.org/visualization_flags?article=https://join.gov.tw/policies/detail/1e1bd523-96d3-4a39-80e2-de6bd2a10045&owner=None

Some more:
http://wikum.org/visualization_flags?article=https://join.gov.tw/policies/detail/e8c10e79-a259-45f8-bb72-abbdcac0cf58&num=0&owner=None

http://wikum.org/visualization_flags?article=https://join.gov.tw/policies/detail/7cb969ae-cf34-49a4-9792-3337f2655a02&num=0&owner=None

I noticed some new bugs while playing around and some experimental code that is running, so I will work on fixing them, hopefully in the next few days!

[amyxzhang]

Hi @pm5 I just wanted to mention that Wikum has undergone a lot of improvements in the last few months. If you are ever interested in trying an experiment, please let me know and I can work more closely with you all to prepare the tool.

[pm5]

Hi @amyxzhang thanks for the heads up. We might want to try something else on wikum, but currently we are facing a really tight schedule on https://github.com/SenseTW/sensetw (our tool to collect and organize online discussions) so it's not going to happen in near future.

As for the experiment on join.gov.tw, we found that the discussion style there is more akin to a bulletin board with a list of posts instead of a forum with deeper threads, so it seems hard to summarize arguments base on their replying structure.

Still, this is very interesting work. Let's keep in touch to see if there is another chance to collaborate! 🙌

[amyxzhang]

Thanks @pm5, yes let me know for the future! I'm also open to collaborating if you think Wikum could be helpful but with some changes/new features.

Btw, you can still use Wikum for a bag of posts that are not threaded. For that, the clustering interface (http://wikum.org/cluster?article=http://www.theatlantic.com/magazine/archive/2012/07/why-women-still-cant-have-it-all/309020/&num=0&owner=None) and the tagging and suggested tags feature would be helpful for finding related comments and grouping them to summarize. (I need to write a better explainer for all the features and ways to use the tool). A little bit of work is needed to get the NLP models to work with Chinese text.