Bookkeeping for pipeline_id and the current scroll layer id is logic
that is shared among all clients. We can just move this into
DisplayListBuilder.