[BUG] Failure in Anomaly Detection for Sample Dataset

[jayanthchandra]

Describe the bug

I used the sample RDS dataset from AWS and applied anomaly filter on cloud cost. After 15 minutes, it returned with an error. I used Standard Deviation Model.

Explain the environment

• Chaos Genius version: example is 0.1.3-alpha
• OS Version / Instance: example macOS 11.1, Windows 10, Ubuntu 18.04, AWS EC2
• Deployment type: Docker Setup

Current behavior

Crash in Anomaly Detection

Expected behavior

The Anomaly filter should render/display detected anomaly

Logs

Traceback (most recent call last):
  File "/usr/src/app/chaos_genius/jobs/anomaly_tasks.py", line 80, in anomaly_single_kpi
    run_anomaly_for_kpi(kpi_id, end_date, task_id=task_id)
  File "/usr/src/app/chaos_genius/controllers/kpi_controller.py", line 94, in run_anomaly_for_kpi
    adc.detect()
  File "/usr/src/app/chaos_genius/core/anomaly/controller.py", line 736, in detect
    self._run_anomaly_for_series(input_data, "overall")
  File "/usr/src/app/chaos_genius/core/anomaly/controller.py", line 561, in _run_anomaly_for_series
    raise e
  File "/usr/src/app/chaos_genius/core/anomaly/controller.py", line 552, in _run_anomaly_for_series
    ) = self._detect_anomaly(
  File "/usr/src/app/chaos_genius/core/anomaly/controller.py", line 222, in _detect_anomaly
    return ProcessAnomalyDetection(
  File "/usr/src/app/chaos_genius/core/anomaly/processor.py", line 90, in predict
    anomaly_df = self._predict(model)
  File "/usr/src/app/chaos_genius/core/anomaly/processor.py", line 143, in _predict
    prediction = model.predict(
  File "/usr/src/app/chaos_genius/core/anomaly/models/standard_deviation_model.py", line 76, in predict
    df_anomaly = self._detect_anomalies(df)
  File "/usr/src/app/chaos_genius/core/anomaly/models/standard_deviation_model.py", line 82, in _detect_anomalies
    forecasted = forecast[["ds", "yhat", "yhat_lower", "yhat_upper", "y"]].copy()
  File "/usr/local/lib/python3.8/dist-packages/pandas/core/frame.py", line 3511, in __getitem__
    indexer = self.columns._get_indexer_strict(key, "columns")[1]
  File "/usr/local/lib/python3.8/dist-packages/pandas/core/indexes/base.py", line 5796, in _get_indexer_strict
    self._raise_if_missing(keyarr, indexer, axis_name)
  File "/usr/local/lib/python3.8/dist-packages/pandas/core/indexes/base.py", line 5859, in _raise_if_missing
    raise KeyError(f"{not_found} not in index")
KeyError: "['ds'] not in index"

[github-actions]

Hello there, thanks for opening your first issue. We welcome you to the community!

[Samyak2]

Moving this to #1189