Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exporting to excel error #159

Closed
jonharrell opened this issue Feb 9, 2024 · 21 comments
Closed

Exporting to excel error #159

jonharrell opened this issue Feb 9, 2024 · 21 comments
Assignees

Comments

@jonharrell
Copy link

JWLManager v4.3.3
Windows-10-10.0.22631-SP0

Traceback (most recent call last):
File "JWLManager.py", line 1125, in export_items
File "JWLManager.py", line 1065, in export_notes
File "JWLManager.py", line 1011, in get_notes
sqlite3.OperationalError: no such column: n.Created

@erykjj
Copy link
Owner

erykjj commented Feb 9, 2024 via email

@jonharrell
Copy link
Author

It was with the latest version. I was trying to merge two files and wanted to get a clean export of both to manually work through them

@jonharrell
Copy link
Author

reindexing gave this error:

JWLManager v4.3.3
Windows-10-10.0.22631-SP0

Traceback (most recent call last):
File "JWLManager.py", line 2374, in trim_db
sqlite3.OperationalError: no such table: PlaylistItemLocationMap

@jonharrell
Copy link
Author

I'm sorry I think I was including a sign language back up as well...

@erykjj
Copy link
Owner

erykjj commented Feb 9, 2024 via email

@erykjj
Copy link
Owner

erykjj commented Feb 9, 2024 via email

@jonharrell
Copy link
Author

jonharrell commented Feb 9, 2024

It is the JW library sign app. I have both of them backing up into the same folder and grabed one of the sign versions. They have play lists etc but came out with features a few years prior to the main app so I'm sure the db is different.
/

That asside I can export to XLS, txt erorrs and importing XLS errors on #1:

JWLManager v4.3.3
Windows-10-10.0.22631-SP0

Traceback (most recent call last):
File "JWLManager.py", line 1125, in export_items
File "JWLManager.py", line 1097, in export_notes
KeyError: 'ISSUE'

PC version 14.1.42.0
Android ver 14.1.2

Exporting to TXT with PC and Android version of the backup have the same error:
JWLManager v4.3.3
Windows-10-10.0.22631-SP0

Traceback (most recent call last):
File "JWLManager.py", line 1125, in export_items
File "JWLManager.py", line 1097, in export_notes
KeyError: 'ISSUE'

@erykjj
Copy link
Owner

erykjj commented Feb 9, 2024

Just to make sure I understand: you are opening a certain .jwlibrary archive (from the JW Library app) and...

  1. you can export to Excel without issues
  2. importing that same Excel file crashes
  3. exporting to text also crashes
    Is that correct?

Is there any way you can send me that .jwlibrary archive? You can use the Mask option from Utilities menu to obfuscate all your text fields and then save this archive, zip it up and attach, please. I will have to have a look at the database itself.

@jonharrell
Copy link
Author

Correct, export to xls works, import errors and export to txt errors.
masked-exportfromdesktop_2024-02-09.zip

@erykjj
Copy link
Owner

erykjj commented Feb 9, 2024

OK, I think you found what I would call an "edge case" involving adding a note to a document (publication page) from the app menu ("Add Note"), which doesn't associate the note with any paragraph (block) in particular.

I was handling this with the Bible notes, but not with "regular" publications. I will push out a fix in the next day or two.

@erykjj erykjj self-assigned this Feb 9, 2024
@erykjj
Copy link
Owner

erykjj commented Feb 10, 2024

@jonharrell
Your archive contains at least one messed-up note: NoteId 221.
It's attached to 2 Corinthians 11:53 in the nwt. That verse doesn't exist. JW Library will show it in the notes section, but try clicking the link at the bottom of it...

That aside, the issue you reported is also present. Fix if coming.

@erykjj
Copy link
Owner

erykjj commented Feb 10, 2024

@jonharrell please try v4.4.0 and let me know how it behaves. I did some testing and it behaves correctly, but please do keep backups till you're sure it's all good.

Also, do you think it would it be helpful to have access to JW Sign backups in JWLManager? If so, send me a sample backup file and I'll see if I can make some adaptations.

@jonharrell
Copy link
Author

The updated version works great.

Also, attached is a jwlib file for sign language with a playlist added for a talk
masked-exportfromdesktop_2024-02-09.zip
. Please let me know if you would like anything specific - db files etc.

@jonharrell
Copy link
Author

jonharrell commented Feb 12, 2024 via email

@erykjj
Copy link
Owner

erykjj commented Feb 12, 2024

Also, attached is a jwlib file for sign language with a playlist added for a talk
masked-exportfromdesktop_2024-02-09.zip

Are you sure you attached the correct file?

@erykjj
Copy link
Owner

erykjj commented Feb 12, 2024

Jw sign single playlist exports and merging would be incredibly helpful.

Do you mean being able to select individual items in the Playlists view and exporting/importing them (like with Notes, etc.)?

@jonharrell
Copy link
Author

jonharrell commented Feb 12, 2024 via email

@erykjj
Copy link
Owner

erykjj commented Feb 12, 2024

I can certainly think about it...
Please resend the backup file generated by the JW Sign app.

@jonharrell
Copy link
Author

jonharrell commented Feb 13, 2024

Sorry about that, the last attachment was obviously wrong and the actual one was too large. I simplified the talk by removing many of the videos and it is small enough now.

@erykjj
Copy link
Owner

erykjj commented Feb 13, 2024

Thank you.
I will have a look and think about it.

I will close this issue as completed, if you don't mind.

@erykjj erykjj closed this as completed Feb 13, 2024
@erykjj
Copy link
Owner

erykjj commented Apr 4, 2024

It would be very helpful to be able to export individual playlists and import them. Also, basic editing of the publication lists would help with issues that arise from changing drive letters. In the past, after upgrading computers I've manually edited the db files to point to the media files' new locations. But in general the db is a lot less used from the user standpoint as notes do not exist and only playlists. The playlist feature predates the main JW library by several years (around 2015/6) so I would suspect it could be very different in structure. Jon Harrell

Hi @jonharrell
I have been doing a bit of work on the playlist export/import. For now, I've got the export working (?). I need someone to do testing. Are you up for it?

If so, what kind of OS do you use? Can you by any chance execute the Python directly, or do you need the compiled binaries?

PS: just noticed you are on Win10. Can you do Python directly?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants