Refacto/Updated format of Harness

[Prikshit7766]

Description

Updated format of Harness

one model

harness = Harness(
            task = "text-classification",
            model={"model": "textcat_imdb", "hub": "spacy"},
            data={
            "data_source" : "glue",
            "subset": "sst2",
            "feature_column": "sentence",
            "target_column": "label",
            "split": "train",
            "source": "huggingface"
            }
        )

multiple model

Harness(
task="ner",
model=[{"model": "bert-base-cased", "hub": "huggingface"},
 {"model": "dslim/bert-base-NER", "hub": "huggingface"}],
data={
"data_source" : "/content/langtest/tests/fixtures/tner.csv"
}
)

where

• model (list | dict, optional): Specifies the model to be evaluated.
  If provided as a list, each element should be a dictionary with 'model' and 'hub' keys.
  If provided as a dictionary, it must contain 'model' and 'hub' keys when specifying a path.

• data (dict, optional): The data to be used for evaluation.
  The data parameter should be updated to accept a dictionary, providing more flexibility and options for data sources. The dictionary should include the following keys:

data_source (mandatory): The source of the data.
subset (optional): The subset of the data.
feature_column (optional): The column containing the features.
target_column (optional): The column containing the target labels.
split (optional): The data split to be used.

---

➤ Fixes #581

Type of change

Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

Usage

Checklist:

• I've added Google style docstrings to my code.
• I've used pydantic for typing when/where necessary.
• I have linted my code
• I have added tests to cover my changes.

[chakravarthik27]

if data_source is not provided, then it should raise an error.

[chakravarthik27]

please make it changes, @Prikshit7766 @RakshitKhajuria

[chakravarthik27]

user can provide only the str of the input path. and we can convert it into the required dict format within the function.