Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Gmail data source #9

Closed
mholt opened this issue Feb 15, 2019 · 4 comments
Closed

Add Gmail data source #9

mholt opened this issue Feb 15, 2019 · 4 comments
Assignees

Comments

@mholt
Copy link
Owner

mholt commented Feb 15, 2019

1. What is the data source you want to add?

Gmail - the ability to download emails and attachments, with very heavy filtering options. Having a record of emails would be useful because my family often documents their lives to the rest of us through emails.

2. How are items obtained from the data source?

Gmail API via Google OAuth2

2a. If authentication is required, how does a user create or obtain credentials for Timeliner to access the data?

Google OAuth2 is already documented in the wiki.

2b. If an API is available, what are its rate limits?

250 queries per user per second: https://developers.google.com/gmail/api/v1/reference/quota

2c. If a file is imported, how is the file obtained?

n/a

3. What constitutes an "item" from this data source?

An email or attachment.

4. How can items from this data source be related?

Emails can have attachments. Emails can be replies to other emails.

5. What constitutes a "collection" from this data source?

Perhaps a conversation (a thread of messages); but that might be redundant if emails can be related as replies to other ones.

6. What might not be trivial, obvious, or straightforward when implementing this data source?

A lot of filtering will need to be configurable, since Gmail contains a messy amount of noise; somehow I have Google Voice messages, Hangout chats, and other things that aren't really emails in my Gmail account which also show up in the API.

Will need to filter by label, subject, sender, To, other headers, etc. Optionally include attachments (from some emails only, or files of a certain type or size, etc).

@mholt
Copy link
Owner Author

mholt commented Feb 20, 2019

I've started on this.

@phardwick
Copy link

Be great to see this implemented - perhaps also for other email providers (yahoo/hotmail - lots of history in those old accounts). Perhaps an IMAP/POP3 general access data source would be great. Unless there is this capability already.

@mholt
Copy link
Owner Author

mholt commented Feb 25, 2019

IMAP/POP3 would be a separate data source (it does not yet exist); this one is specifically for Gmail via its API.

@mholt mholt self-assigned this Jun 17, 2019
@mholt
Copy link
Owner Author

mholt commented Jan 19, 2024

I have an implementation of .eml and .mbox files working in Timelinize (see #84 and updated README). Gmail API integration can come later, but it's quite compelling that the archive files are the superior import method.

@mholt mholt closed this as completed Jan 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants