Universal Quick Capture for Roam Research Beta #187

mlava · 2021-01-19T06:38:09Z

✂️ Copy of your #42SmartBlock from Roam

Please download the latest code:
Universal Quick Capture for Roam Research.zip

📋 Describe the SmartBlock

This SmartBlock allows you to utilise the excellent Todoist Quick Capture mechanisms as an alternate Quick Capture to the inbuilt Roam Research one. You can capture thoughts, notes and ideas using the Todoist app, popular voice assistants and email into Todoist.

All of that data can now be imported into Roam Research.

✅ Describe any prerequisites or dependencies that are required for this SmartBlock

Roam42 obviously.
A Todoist account. This script works with Free and Premium Todoist accounts. Free users can't import comments or attachments (Todoist API limitation). Premium users can also assign a label in their Todoist inbox to only import certain items and not the whole inbox, which is useful if you already use Todoist in its own right.

📷 Screenshot of your #42SmartBlock workflow/template from Roam

💡 Additional Info

Import this json file to start:
Universal Quick Capture for Roam Research.zip

pomdtr · 2021-01-19T21:56:02Z

This is great! The only feature I miss is support for todoist dates. Is this information available in the API?

mlava · 2021-01-19T22:55:02Z

Hi everyone.
There have been lots of queries about how this script is intended to work, and it occurs to me that I should have clarified the design brief before working on it. I assumed I knew what people meant in the thread about using Todoist inbox as a Quick Capture replacement for the inbuilt Roam Research one, but lots of questions suggest that maybe it isn't as clear as I thought. https://roamresearch.slack.com/archives/C0190JLGDUJ/p1610276819246200
So, here are some explanations for design choices that I hope will help. This can also be used as a starting point for discussion, as I am open to tweaking if there is agreement.

This set of SmartBlocks is not intended to link Task management via Todoist into RR.
I am not outputting a TODO for these imported items as I didn't think they were tasks. My understanding of Quick Capture as a concept is that it could be ideas, thoughts, emotions and tasks. The quick part suggests relatively frictionless and easy, and that there will be some kind of later review.
There are SB in the github that are for task management, but my intent with this set is to manage quick capture. The choice of Todoist as a gateway is largely that their QC is excellent, and their ubiquity means that ideas can be captured by voice assistants, mobile apps and email.
As my vision for this was to Quick Capture thoughts, ideas, emotions etc, I did not implement due dates. @david
I am not sure that we should, but would suggest that the task management Todoist scripts in github be modified to allow for this.
I answered @mark about adding dates in the Quick Capture thread, but he was really referring to the scripts in Github for task management, not this set of SB. I perhaps should have made it clear in the thread that it was off-topic.
Assignment of a label on import. @roamhacker
I understand Quick Capture to be a way of getting a thought down immediately so it isn't lost, but that it requires triage later as to whether it remains relevant and what it actually means. Therefore, I thought forcing a tag on import into Roam would allow for storing until such triage occurs.
These tags should not be conflated with labels in Todoist. I am not importing Todoist labels (I don't see creating them as part of Quick Capture as too much friction), and the config options to use labels to guide the import from Todoist are only for Todoist Premium account holders who already use their Todoist inbox and might not want to import all items to Roam. As such, I gave those Premium users a way to tell the script which items to import. This isn't possible with the Free Todoist option.
I could modify the scripts to make assigning a tag in RR optional, but am already wary of how many config options there are. I've had multiple messages and queries about getting the SB running despite the documentation in the page. I can add more and more config options and if/then in the script, but I wonder if it will be overwhelming.
Import of attachments @owen Cyrulnik
The way Todoist Quick Capture works is that an idea/thought/whatever will be called a task. It can then have comments. I have created this SB to allow import of comments as nested blocks / sub-blocks. This choice was made as they are related thoughts and this structure will keep them together in RR. An unrelated thought should be captured as a different item in Todoist.
In addition to importing text comments, Premium users can also hotlink to attachments including pdf and jpg/png hosted by Todoist, while Free users cannot. This is a Todoist limitation. I am planning to modify to have a setting for Free vs Premium account holders, and will remove the linking/embedding that occurs for people on Free Todoist as it is not helpful as is.
For those on Premium, however, the possibility to have pdfs and images as part of Quick Capture is really useful. I am emailing myself things to review later into Todoist and then importing to Roam and being able to see the pdf inline is really helpful.
I am happy to talk more about this, as these are only my thoughts and assumptions. It is possible that I misunderstood some things.
The biggest differentiation I would like to make is that these SB are not intended to support task management, but only Quick Capture.
Cheers! 🙂

mlava · 2021-01-20T08:18:03Z

New version 0.1.5 Beta in first post.

lifsys · 2021-01-20T21:59:33Z

Fantastic work on this!

eatondpe · 2021-01-24T00:57:23Z

For anyone who just really wants to have due dates come across as well, this is pretty easy to do.

First, copy and past this code immediately following the vars at the top of the code block in the TQC - Todoist QC Inbox SmartBlock.

function convertToRoamDate(dateString) {
  var parsedDate = dateString.split('-');
  var year = parsedDate[0];
  var month = Number(parsedDate[1]);
  const months = ['January','February','March','April','May','June','July','August','September','October','November','December'];
  var monthName = months[month-1];
  var day = Number(parsedDate[2]);
  let suffix = (day >= 4 &&  day <= 20) || (day >= 24 && day <= 30)
    ? "th"
    : ["st", "nd", "rd"][day % 10 - 1];
  return "[[" + monthName + " " + day + suffix + ", " + year + "]]";
}

Then, replace this line - which occurs in two places

roam42.common.setEmptyNodeValue(document.activeElement, "" + task.content) + " #[["+TodoistImportTag+"]]" );

with this

      if (task.due) {
        roam42.common.setEmptyNodeValue(document.activeElement, "" + task.content + " " + convertToRoamDate(task.due.date)) + " #[["+TodoistImportTag+"]]" );
      } else {
        roam42.common.setEmptyNodeValue(document.activeElement, "" + task.content) + " #[["+TodoistImportTag+"]]" );
      }

You should end up with something like this.

lifsys · 2021-01-24T21:46:36Z

For anyone who just really wants to have due dates come across as well, this is pretty easy to do.

First, copy and past this code immediately following the vars at the top of the code block in the TQC - Todoist QC Inbox SmartBlock.

function convertToRoamDate(dateString) {
  var parsedDate = dateString.split('-');
  var year = parsedDate[0];
  var month = Number(parsedDate[1]);
  const months = ['January','February','March','April','May','June','July','August','September','October','November','December'];
  var monthName = months[month-1];
  var day = Number(parsedDate[2]);
  let suffix = (day >= 4 &&  day <= 20) || (day >= 24 && day <= 30)
    ? "th"
    : ["st", "nd", "rd"][day % 10 - 1];
  return "[[" + monthName + " " + day + suffix + ", " + year + "]]";
}

Then, replace this line - which occurs in two places

roam42.common.setEmptyNodeValue(document.activeElement, "" + task.content) + " #[["+TodoistImportTag+"]]" );

with this

      if (task.due) {
        roam42.common.setEmptyNodeValue(document.activeElement, "" + task.content + " " + convertToRoamDate(task.due.date)) + " #[["+TodoistImportTag+"]]" );
      } else {
        roam42.common.setEmptyNodeValue(document.activeElement, "" + task.content) + " #[["+TodoistImportTag+"]]" );
      }

You should end up with something like this.

There were some issues with the closed parens. This change fixed and allowed the script to work in the new beta:

		if (task.due) {
        		roam42.common.setEmptyNodeValue(document.activeElement, "" + task.content + " " + convertToRoamDate(task.due.date) + " #[["+TodoistImportTag+"]]" );
      		} else {
        		roam42.common.setEmptyNodeValue(document.activeElement, "" + task.content + " #[["+TodoistImportTag+"]]" );
      		}

eatondpe · 2021-01-24T21:52:57Z

Thanks, @lifsys. Yep. I made that mistake in preparing to post it here. Appreciate you helping others with this.

lifsys · 2021-01-24T21:55:21Z

Thanks, @lifsys. Yep. I made that mistake in preparing to post it here. Appreciate you helping others with this.

@eatondpe, the least I can do. You all make this magic possible!

mlava · 2021-01-25T02:55:14Z

Updated code to (hopefully) fixed the dropped items reported by Jason Philips on Slack...

https://roamresearch.slack.com/archives/C0190JLGDUJ/p1611413283091700?thread_ts=1611363111.083300&cid=C0190JLGDUJ

kmaustral · 2021-01-28T10:48:32Z

I removed the import tag and found items were given #[[]] by default. I know you were wary of adding more configuration, but would there be a way of including no tag if the setting was blank? It's a little cumbersome deleting the tag for every import. I'm still hoping that someone will develop a Workflowy style action to delete tag by alt-click.

mlava · 2021-01-28T11:03:27Z

@kmaustral

Remove this string from lines 25 and 51 of the TQC - Todoist QC Inbox code block.

#[["+TodoistImportTag+"]]

Note the space ahead of the #

kmaustral · 2021-01-28T21:13:21Z

Thanks Mark. I get that string on lines 34, 39, 63, 73,78 and 83. Sorry if I misinterpret.

mlava · 2021-01-28T22:25:25Z

Hi Kevin.
I think you're using an old version. Latest is 0.1.7 beta.
Suggest update to latest and then change lines 25 and 51.
Don't forget to backup your config somewhere else before deleting the SB page and re-importing.
Cheers.
Mark

kmaustral · 2021-01-30T05:19:09Z

Fine. I updated and removed the tag. Nice and clean. Thanks Mark.

mlava · 2021-02-23T05:20:30Z

Updated to v0.18 - see first post

This version includes advanced settings configuration options to:

remove the tag assigned on import
show item created date
show the due date if set
show priority

Each of these is set to False as default and need to be enabled by changing the setting to True.

mlava · 2021-04-05T01:22:49Z

New version 0.1.9 beta

New feature: import Todoist subtasks nested under primary task with comments
Update: use Roam Research alpha API allowing faster data entry

Download in first post.

kmaustral · 2021-04-13T22:52:12Z

Hi Mark. It would be great if there was a way to import attachments as links. That way we could access the content of emails.

And can you remind me if there is a setting to delete imported tasks from Todoist. I've uploaded the latest version and can't find that setting.

Thanks for all your work.

mlava · 2021-04-13T22:57:55Z

Hi Kevin,
It should be automatically deleting the tasks from Todoist. Is that not happening??

Do you have premium or free? With premium you can import attachments.

kmaustral · 2021-04-13T23:17:27Z

It's not deleting at the moment, but that might be temporary. Todoist generously has just allowed attachments for the free plan: https://todoist.com/help/articles/whats-included-in-the-new-free-plan

…

On Wed, 14 Apr 2021 at 08:58, Mark Lavercombe ***@***.***> wrote: Hi Kevin, It should be automatically deleting the tasks from Todoist. Is that not happening?? Do you have premium or free? With premium you can import attachments. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#187 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ARTR6NYCDEFQS4EM5SGVNZLTITEABANCNFSM4WIJOP7A> .

kmaustral · 2021-04-14T11:50:13Z

Mark, I can download the first task, but not the others. The first task is not deleted from Todoist.

mlava · 2021-04-15T23:13:24Z

Kevin, I just tested again and it's working for me with both free and premium accounts. Is there anything in the console? Cheers, Mark

…

On Wed, Apr 14, 2021 at 9:50 PM kmaustral ***@***.***> wrote: Mark, I can download the first task, but not the others. The first task is not deleted from Todoist. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#187 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABUKIPSIIWPZ6N24OJVDOQ3TIV6QHANCNFSM4WIJOP7A> .

kmaustral · 2021-04-15T23:19:47Z

I couldn't locate anything specific, but I'm not sure what I would be looking for.
Should this setting be filled out even if you are not tagging items: #42Setting TodoistImportTag

mlava · 2021-04-15T23:22:50Z

Not sure if I included logic. Maybe just add a tag and let me know what happens?

…

On Fri, Apr 16, 2021 at 9:19 AM kmaustral ***@***.***> wrote: I couldn't locate anything specific, but I'm not sure what I would be looking for. Should this setting be filled out even if you are not tagging items: #42Setting TodoistImportTag — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#187 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABUKIPXNLICUU4AJHNMIYT3TI5YB7ANCNFSM4WIJOP7A> .

ariiiak · 2021-10-03T12:12:25Z

unfortuantely the {{button}} block which includes 42RemoveButton=false, keeps disappearing after successfully imports tasks from todoist.
Any solutions? My usual workaround which was adding an empty bulletpoint under the UQC script doesn't help

Now it works,
added two blanks as parents and that did the job:
#42SmartBlock UQC...

(blank)
> (blank)
> <%JAVASCRIPT...

JustinHatchett · 2021-10-19T01:59:00Z

I haven't changed anything on my configuration but starting a few days ago I'm getting this when I run this block:

Block threw an error while running: <%JAVASCRIPTASYNC: ```javascript
var myToken = ...

Is anyone else seeing this and is there a way to get more detail than just this truncated error message?

gijs-epping · 2021-10-19T20:27:15Z

Have the same issues because of smartblock V2

JustinHatchett · 2021-10-22T13:48:44Z

@mlava, do you know if SmartBlocks V2 caused this? If so, is this amazing tool being worked on? No worries if not, I just wanted to check before looking for another tool. 👍

mlava · 2021-10-23T00:21:10Z

I;ve uploaded a new version t the marketplace

JustinHatchett · 2021-10-23T02:11:28Z

Thanks @mlava! The RoamJS marketplace? I'm not seeing it there yet, is that where you mean?

mlava · 2021-10-23T03:05:40Z

Yep, RoamJS marketplace. I just checked and it's in there for me. Maybe refresh your roam?

JustinHatchett · 2021-10-23T13:40:08Z

Found it. I wasn't looking on the SmartBlock store, but the marketplace that is part of the roamjs website.

Glad you're getting a few bucks for this great integration now, thanks for the update!

WalterChr · 2021-10-31T05:29:17Z

On the contrary I now found it on the Smartblocks-Store :)
But you should post a documentation in the store. Because for me the addon initially didnt work because I had both versions (the one here and the one from the store) "installed".
I figured out that you have to put in all the data again in the new addon (which of course makes sense after thinking about it), but it nevertheless took me 10 minutes or so to make it running again because there is no documentation.
And the link in the description in the smartblock store cannot be opened (at least I dont have access there).

mlava · 2021-10-31T20:57:53Z

Thank you. I've updated the description in the store to point to this Github issue. Hopefully, people will be able to get it working.

…

On Sun, Oct 31, 2021 at 4:29 PM WalterChr ***@***.***> wrote: On the contrary I now found it on the Smartblocks-Store :) But you should post a documentation in the store. Because for me the addon initially didnt work because I had both versions (the one here and the one from the store) "installed". I figured out that you have to put in all the data again in the new addon (which of course makes sense after thinking about it), but it nevertheless took me 10 minutes or so to make it running again because there is no documentation. And the link in the description in the smartblock store cannot be opened (at least I dont have access there). — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#187 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABUKIPSRBA4L5MG422O3CBDUJTH3RANCNFSM4WIJOP7A> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

markpmccoy · 2021-11-17T17:54:11Z

I recently bought the plugin through the SmartBlocks store.

Inbox items pull in from Todoist fine but they are NOT removed from the Todoist inbox.

Have you encountered this before / have any ideas for solving it?

mlava · 2021-11-17T21:03:15Z

Hi Mark.
Thank you. I haven't seen this, but am going to start experimenting and see if I can reproduce it.
A couple of questions:
Are the tasks that aren't being removed pulled into Roam again the next time you call the SB?
Could you please open Console (F12 in many browsers) and go to the Errors section. Then, call the SB and see if any errors appear. If there are, please screenshot or record a Loom for me?
Thanks in advance,
Mark

markpmccoy · 2021-11-17T21:54:35Z

Hi Mark, Thanks for getting back to me so quickly. Responses below. 1. The SB will pull in duplicate Todoist tasks when it's called again. 2. The error message definitely points to the problem (screenshot attached) - Not sure if it helps, but I usually use the Roam Desktop app. To capture the screenshot I opened Roam in my browser. Thanks for your help! Mark On Wed, Nov 17, 2021 at 21:03:27, Mark Lavercombe ***@***.***> wrote: ![Screenshot 2021-11-17 at 21 53 42](https://user-images.githubusercontent.com/13409250/142294643-7bdde39e-a851-4823-879d-7b3a42db8ec1.png)

…

Hi Mark. Thank you. I haven't seen this, but am going to start experimenting and see if I can reproduce it. A couple of questions: Are the tasks that aren't being removed pulled into Roam again the next time you call the SB? Could you please open Console (F12 in many browsers) and go to the Errors section. Then, call the SB and see if any errors appear. If there are, please screenshot or record a Loom for me? Thanks in advance, Mark — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#187 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ADGJXYW3QRBG2ANE6SNUMZDUMQKB7ANCNFSM4WIJOP7A> .

mlava · 2021-11-18T04:18:20Z

Hi Mark.
That error looks pretty worrying. CORS issues often aren't fixable without creating a nodejs server as a middleman.
How wedded are you to using Roam in the Desktop app?
I will experiment with trying the other Todoist API from the desktop app and see if I can progress. It might take me a little bit of time.
Cheers,
Mark

markpmccoy · 2021-11-18T10:12:18Z

Hi Mark, While I primarily use the Roam Desktop app, I took the screenshot from a Chrome window (not sure if that makes a difference). I prefer the Desktop App to having Roam in a Chrome window, though I'm happy to experiment with other solutions. Out of curiosity, what's your current setup, or popular setups that others use? Mark

…

On Thu, Nov 18, 2021 at 04:18:32, Mark Lavercombe ***@***.***> wrote: Hi Mark. That error looks pretty worrying. CORS issues often aren't fixable without creating a nodejs server as a middleman. How wedded are you to using Roam in the Desktop app? I will experiment with trying the other Todoist API from the desktop app and see if I can progress. It might take me a little bit of time. Cheers, Mark — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#187 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ADGJXYTMN67JU6NJDOLC4BDUMR5BRANCNFSM4WIJOP7A> .

mlava added the SmartBlock label Jan 19, 2021

mlava mentioned this issue Jan 19, 2021

Todoist: pulling in active tasks into Roam (Demonstrates how to bring back multiple blocks from API) #37

Open

mlava changed the title ~~Todoist Quick Capture for Roam Research v0.1.1 Beta~~ Todoist Quick Capture for Roam Research v0.1.2 Beta Jan 19, 2021

mlava changed the title ~~Todoist Quick Capture for Roam Research v0.1.2 Beta~~ Todoist Quick Capture for Roam Research Beta Jan 19, 2021

mlava changed the title ~~Todoist Quick Capture for Roam Research Beta~~ Quick Capture with Todoist Gateway for Roam Research Beta Jan 21, 2021

TfTHacker pinned this issue Feb 7, 2021

mlava changed the title ~~Quick Capture with Todoist Gateway for Roam Research Beta~~ Universal Quick Capture for Roam Research Beta Feb 23, 2021

Universal Quick Capture for Roam Research Beta #187

Universal Quick Capture for Roam Research Beta #187

Comments

mlava commented Jan 19, 2021 • edited Loading

✂️ Copy of your #42SmartBlock from Roam

📋 Describe the SmartBlock

✅ Describe any prerequisites or dependencies that are required for this SmartBlock

📷 Screenshot of your #42SmartBlock workflow/template from Roam

💡 Additional Info

pomdtr commented Jan 19, 2021

mlava commented Jan 19, 2021

mlava commented Jan 20, 2021

lifsys commented Jan 20, 2021

eatondpe commented Jan 24, 2021

lifsys commented Jan 24, 2021

eatondpe commented Jan 24, 2021

lifsys commented Jan 24, 2021

mlava commented Jan 25, 2021

kmaustral commented Jan 28, 2021

mlava commented Jan 28, 2021 • edited Loading

kmaustral commented Jan 28, 2021

mlava commented Jan 28, 2021

kmaustral commented Jan 30, 2021 • edited Loading

mlava commented Feb 23, 2021

mlava commented Apr 5, 2021

kmaustral commented Apr 13, 2021

mlava commented Apr 13, 2021

kmaustral commented Apr 13, 2021 via email

kmaustral commented Apr 14, 2021

mlava commented Apr 15, 2021 via email

kmaustral commented Apr 15, 2021

mlava commented Apr 15, 2021 via email

ariiiak commented Oct 3, 2021 • edited Loading

JustinHatchett commented Oct 19, 2021 • edited Loading

gijs-epping commented Oct 19, 2021

JustinHatchett commented Oct 22, 2021 • edited Loading

mlava commented Oct 23, 2021

JustinHatchett commented Oct 23, 2021

mlava commented Oct 23, 2021

JustinHatchett commented Oct 23, 2021

WalterChr commented Oct 31, 2021

mlava commented Oct 31, 2021 via email

markpmccoy commented Nov 17, 2021

mlava commented Nov 17, 2021

markpmccoy commented Nov 17, 2021 via email • edited Loading

mlava commented Nov 18, 2021

markpmccoy commented Nov 18, 2021 via email

mlava commented Jan 19, 2021 •

edited

Loading

mlava commented Jan 28, 2021 •

edited

Loading

kmaustral commented Jan 30, 2021 •

edited

Loading

ariiiak commented Oct 3, 2021 •

edited

Loading

JustinHatchett commented Oct 19, 2021 •

edited

Loading

JustinHatchett commented Oct 22, 2021 •

edited

Loading

markpmccoy commented Nov 17, 2021 via email •

edited

Loading