Compress file content with zstd

[kshuta]

@robherley
This is a draft pull request that implements file content setter/getter as discussed in #6. I was hoping to get feedback on the core compression and decompression implementations to make sure they align with what you had in mind!

If the implementations are something you had in mind, I'll go ahead and swap file.Content statements with getters and setters.

[robherley]

👍 overall looks good, just a few small comments!

thanks again for working on this 💪

[kshuta]

@robherley

Was hoping if you could take a look at the additional setters and getters: SetRawContent() and GetRawContent(). They are exclusively used in db_sqlite.go to pass the raw content to and from the database.

When storing the file content to the db we need access to the compressed file content, but File.GetContent() would return the uncompressed file content. Similarly, we need to pass the content from the database to the File struct, but SetRawContent() may compress the already compressed file. We can deal with this by always setting the compress argument to false in the db file, but I thought since we already have GetRawContent() from the problem before, might as well add SetRawContent().

I feel like there is a better way to handle this, and I would appreciate it if you could give me any advice!

[robherley]

I think just making a public RawContent field is fine, makes usage in DB pkg a bit easier, left some comments!

Lemme know if you need anything clarified 👍

[robherley]

Looks good! Just a few minor things then we can ship it 🚀

[kshuta]

The raw bytes were acquired from the following script:

package main

import (
	"fmt"

	"github.com/klauspost/compress/zstd"
)

func main() {
	encoder, err := zstd.NewWriter(nil)
	if err != nil {
		panic(err)
	}

	target := []byte("Hello World")

	rawContent := encoder.EncodeAll(target, nil)
	for _, val := range rawContent {
		fmt.Printf("%d, ", val)
	}

}

[kshuta]

@robherley Ready for review!

[robherley]

one last super tiny fix and then we can merge

[robherley]

Suggested change

	wish.Print(sesh, content)
	wish.Print(sesh, string(content))

found this when testing locally 😉 it was printing out the byte slice haha

[kshuta]

sorry! was caught up in the unit tests :(