Conditional sampling + batch size: ValueError: Length of values (1) does not match length of index (5)

[npatki]

Environment Details

Please indicate the following details about the environment in which you found the bug:

• SDV version: 0.16.0.dev1

Error Description

1. Create a tabular model
2. Try conditional sampling (either by using sample_conditions or sample_remaining_columns functions) while also applying the batch_size parameter

Sampling conditions:  25%|██▌       | 5/20 [00:00<00:01, 13.25it/s]Error: Sampling terminated. Partial results are stored in a temporary file: .sample.csv.temp. This file will be overridden the next time you sample. Please rename the file if you wish to save these results.

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-42-55096f039bf9> in <module>()
      4 condition2 = Condition({'gender': 'M', 'high_spec': 'Science'}, num_rows=10)
      5 
----> 6 model.sample_conditions(conditions=[condition1, condition2], batch_size=5)

9 frames
/usr/local/lib/python3.7/dist-packages/pandas/core/common.py in require_length_match(data, index)
    530     if len(data) != len(index):
    531         raise ValueError(
--> 532             "Length of values "
    533             f"({len(data)}) "
    534             "does not match length of index "

ValueError: Length of values (1) does not match length of index (5)

Expectation

The batch_size should be used for each of the conditions. For example:

a = Condition({'gender': 'M', 'high_spec': 'Science'}, num_rows=100)
b = Condition({'gender': 'M', 'high_spec': 'Science'}, num_rows=500)

model.sample_conditions(conditions=[a, b], batch_size=200)

Then each condition should be batched at the minimum of num_rows and batch_size:

• Condition a should be batched at 100
• Condition b should be batched at 200