I am having this issue

[divyendrajadoun]

Some weights of RobertaModel were not initialized from the model checkpoint at roberta-base and are newly initialized: ['roberta.pooler.dense.bias', 'roberta.pooler.dense.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.

[divyendrajadoun]

(audioldm1) J:\a_openai\aa_foley_aii>audioldm -t "A hammer is hitting a wooden surface"
Load AudioLDM: %s audioldm-m-full
DiffusionWrapper has 415.95 M params.
C:\Users\user.conda\envs\audioldm1\lib\site-packages\torchlibrosa\stft.py:193: FutureWarning: Pass size=1024 as keyword args. From version 0.10 passing these as positional arguments will result in an error
fft_window = librosa.util.pad_center(fft_window, n_fft)
C:\Users\user.conda\envs\audioldm1\lib\site-packages\torch\functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\actions-runner_work\pytorch\pytorch\builder\windows\pytorch\aten\src\ATen\native\TensorShape.cpp:3484.)
return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
Some weights of RobertaModel were not initialized from the model checkpoint at roberta-base and are newly initialized: ['roberta.pooler.dense.bias', 'roberta.pooler.dense.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
Traceback (most recent call last):
File "C:\Users\user.conda\envs\audioldm1\lib\runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Users\user.conda\envs\audioldm1\lib\runpy.py", line 87, in run_code
exec(code, run_globals)
File "C:\Users\user.conda\envs\audioldm1\lib\site-packages\audioldm_main.py", line 152, in
audioldm = build_model(model_name=args.model_name)
File "C:\Users\user.conda\envs\audioldm1\lib\site-packages\audioldm\pipeline.py", line 86, in build_model
latent_diffusion.load_state_dict(checkpoint["state_dict"])
File "C:\Users\user.conda\envs\audioldm1\lib\site-packages\torch\nn\modules\module.py", line 2041, in load_state_dict
raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for LatentDiffusion:
Unexpected key(s) in state_dict: "cond_stage_model.model.text_branch.embeddings.position_ids".

[AndyInAi]

pip install --upgrade transformers==4.29.0

[jmren168]

pip install --upgrade transformers==4.29.0

the same issus, and now it works for me. thanks.