clamsproject.github.io/documentation/index.rst at main · clamsproject/clamsproject.github.io · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
CLAMS Project
=============

**Computational Linguistics Applications for Multimedia Services**

The CLAMS project, developed at Brandeis University in partnership with GBH Archives and funded by the Mellon Foundation (see :doc:`partners`), is an open-source Artificial Intelligence (AI) and machine learning (ML) platform for cultural heritage institutions. It provides a framework for developing and implementing ML-based tools to analyze multimedia content, such as video, audio, and text. By automating content analysis and information extraction, CLAMS provides archivists with an AI-assisted environment for metadata refinement, which in turn improves access, search, and exploration of archival audiovisual material.

CLAMS tools aim to generate metadata and knowledge from A/V material that may be hidden or invisible to archivists and database indexes. CLAMS is also designed to be used by computer scientists and developers of content analysis tools within an interoperable platform for custom workflows and pipelines.

The project is under active development. Contact us for any concerns or suggestions at admin@clams.ai.

----

Primary Components
------------------

.. grid:: 2
   :gutter: 3

   .. grid-item-card:: 📝 MMIF Specification
      :link: https://mmif.clams.ai/
      :link-type: url

      An interchange format for multimodal annotations (text, audio, image/video)

   .. grid-item-card:: 🐍 Python SDKs
      :link: https://clams.ai/clams-python/
      :link-type: url

      Software Development Kits for building CLAMS applications

   .. grid-item-card:: ⚙️ Workflow Engine
      :link: wfe
      :link-type: doc

      Information about the CLAMS workflow engine.

   .. grid-item-card:: 📦 App Directory
      :link: https://apps.clams.ai
      :link-type: url

      A public registry of free and open-source CLAMS apps.

----

.. toctree::
   :maxdepth: 2
   :caption: Documentation
   :hidden:

   Home <self>

.. toctree::
   :maxdepth: 1
   :caption: About
   :hidden:

   team
   partners
   events

----

Citing CLAMS
============

Information on how to cite the CLAMS project in your research.

Publications
------------

If you use CLAMS in your research, please cite the following publications:

*   **A Platform for AI-Assisted Archival Metadata Generation** (Platform updates paper, `doi:10.1007/978-3-031-93160-4_12 <https://doi.org/10.1007/978-3-031-93160-4_12>`_, accepted manuscript `PDF <_static/CLAMS_HCII_CNC_2025.pdf>`_ )

*   **Computational Linguistics Applications for Multimedia Services** (Original framework paper, `doi:10.18653/v1/W19-2512 <https://doi.org/10.18653/v1/W19-2512>`_)