Grid Search on NNI Grid Search Grid Search performs an exhaustive search through a manually specified subset of the hyperparameter space defined in the searchspace file. Note that the only acceptable types within the search space are choice, quniform, and randint.