go generate based DataLoader
Switch branches/tags
Nothing to show
Clone or download
vektah Merge pull request #15 from codyleyhan/cl/package
Fixes issue where dataloader package would be a test package
Latest commit 484aef2 Nov 5, 2018
Type Name Latest commit message Commit time
Failed to load latest commit information.
.circleci coverage Feb 9, 2018
example Update to match generated source header. (#9) Jun 22, 2018
.gitignore Fix windows build Jul 13, 2018
Gopkg.lock circle fixes Feb 9, 2018
Gopkg.toml circle fixes Feb 9, 2018
README.md coverage badge Feb 9, 2018
appveyor.yml Fix windows build Jul 13, 2018
dataloaden.go move to go/build for package name Nov 5, 2018
licence.md coverage Feb 9, 2018
template.go Update to match generated source header. (#9) Jun 22, 2018


The DATALOADer gENerator CircleCI Go Report Card codecov

This is a tool for generating type safe data loaders for go, inspired by https://github.com/facebook/dataloader.

The intended use is in graphql servers, to reduce the number of queries being sent to the database. These dataloader objects should be request scoped and short lived. They should be cheap to create in every request even if they dont get used.

Getting started

First grab it:

go get -u github.com/vektah/dataloaden

then from inside the package you want to have the dataloader in:

dataloaden github.com/dataloaden/example.User

In another file in the same package, create the constructor method:

func NewLoader() *UserLoader {
	return &UserLoader{
		wait:     2 * time.Millisecond,
		maxBatch: 100,
		fetch: func(keys []string) ([]*User, []error) {
			users := make([]*User, len(keys))
			errors := make([]error, len(keys))

			for i, key := range keys {
				users[i] = &User{ID: key, Name: "user " + key}
			return users, errors

Then wherever you want to call the dataloader

loader := NewLoader()

user, err := loader.Load("123")

This method will block for a short amount of time, waiting for any other similar requests to come in, call your fetch function once. It also caches values and wont request duplicates in a batch.

Wait, how do I use context with this?

I don't think context makes sense to be passed through a data loader. Consider a few scenarios:

  1. a dataloader shared between requests: request A and B both get batched together, which context should be passed to the DB? context.Background is probably more suitable.
  2. a dataloader per request for graphql: two different nodes in the graph get batched together, they have different context for tracing purposes, which should be passed to the db? neither, you should just use the root request context.

So be explicit about your context:

func NewLoader(ctx context.Context) *UserLoader {
	return &UserLoader{
		wait:     2 * time.Millisecond,
		maxBatch: 100,
		fetch: func(keys []string) ([]*User, []error) {
			// you now have a ctx to work with 

If you feel like I'm wrong please raise an issue.