Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
b139280
[add] main_llm_tokenizer experiment
dianjixz Nov 19, 2024
ab093b6
[format] new clang-format
dianjixz Nov 20, 2024
a5b6935
[fix] llm_task_channel_ not erase
dianjixz Nov 21, 2024
b49fe25
[fix] Circular reference error
dianjixz Nov 21, 2024
b192997
[fix] llm_task_channel_ resource release
dianjixz Nov 21, 2024
82b580e
[update] audio setup && fix StackFlow sys_sql_unset
dianjixz Nov 22, 2024
0ceff54
[update] change StackFlow component msg
dianjixz Nov 22, 2024
814c91f
[update] sys.reset
dianjixz Nov 22, 2024
a0b6082
[update] cv support yolo.
Abandon-ht Nov 22, 2024
4937e36
[add] ax-samples
dianjixz Nov 22, 2024
a02304c
[change] cv to yolo
dianjixz Nov 22, 2024
a4ab2ac
[clean] code
dianjixz Nov 22, 2024
011a961
[update] yolo output class_name.
Abandon-ht Nov 22, 2024
ee21a23
[update] add error msg
dianjixz Nov 22, 2024
d3521b0
Merge branch 'dev' of github.com:m5stack/StackFlow into dev
dianjixz Nov 22, 2024
06194f0
[update] SDK
dianjixz Nov 25, 2024
93b69a8
[update] supports seg & pose model.
Abandon-ht Nov 26, 2024
ebdcfe9
[super update]
dianjixz Nov 26, 2024
88b585b
Merge branch 'dev' of github.com:m5stack/StackFlow into dev
dianjixz Nov 26, 2024
1253d7d
[fix] sys.reset error
dianjixz Nov 26, 2024
6881a5a
[fix] decode_stream
dianjixz Nov 26, 2024
225ab5b
[update] StackFlow subscriber_event_call decode_stream,delet simdjson…
dianjixz Nov 26, 2024
394640c
[update]
dianjixz Nov 27, 2024
689d507
[fix] serial_com error
dianjixz Nov 27, 2024
1a9971d
[fix] Run the error individually.
dianjixz Nov 27, 2024
f5e81ca
[update] pzmq close && base64 size
dianjixz Nov 27, 2024
d2747b8
[update] yolo11s to yolo11n
Abandon-ht Nov 28, 2024
234cc58
[update] fix confidence
Abandon-ht Nov 28, 2024
8ec0be8
[update] add llm_skel(Temporary version)
Abandon-ht Nov 28, 2024
f649b92
[update] add llm_camera!
dianjixz Nov 29, 2024
046b753
Merge branch 'dev' of github.com:m5stack/StackFlow into dev
dianjixz Nov 30, 2024
bc70332
[update]
dianjixz Dec 2, 2024
fb8feab
[update] StackFlow add default serial_zmq_url
dianjixz Dec 2, 2024
71fe7f2
[update] fix melotts english generate.
Abandon-ht Dec 2, 2024
ce0d88a
[update] fix config path.
Abandon-ht Dec 3, 2024
c2bf248
[update] pack deb
dianjixz Dec 3, 2024
2bb50d5
Merge branch 'dev' of github.com:m5stack/StackFlow into dev
dianjixz Dec 3, 2024
9f8115c
[fix] tts input msg escape
dianjixz Dec 3, 2024
69c9de4
[update] add yolo package.
Abandon-ht Dec 3, 2024
6cb8075
[update] yolo
dianjixz Dec 3, 2024
b3915bf
Merge branch 'dev' of github.com:m5stack/StackFlow into dev
dianjixz Dec 3, 2024
c91d0f9
[update] down play audio
dianjixz Dec 3, 2024
a399667
[update] add qwen2.5-coder, llama3.2-1B, openbuddy-llama3.2. rename j…
Abandon-ht Dec 3, 2024
88fdc64
[update] add vlm internvl2. rename json name.
Abandon-ht Dec 4, 2024
aea8f17
[update] llm_pack.py add vlm internvl2.
Abandon-ht Dec 4, 2024
23d2adc
[update] llm-camera
dianjixz Dec 4, 2024
e2f8967
[update] yolo doc
dianjixz Dec 4, 2024
422ed2f
[update] format code. sys add rmmode method.
Abandon-ht Dec 11, 2024
13c4102
[update] ax_msp
dianjixz Dec 12, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
167 changes: 167 additions & 0 deletions .clang-format
Original file line number Diff line number Diff line change
@@ -0,0 +1,167 @@
---
Language: Cpp
BasedOnStyle: Google
AccessModifierOffset: -4
AlignAfterOpenBracket: Align
AlignConsecutiveMacros: true
AlignConsecutiveAssignments: true
AlignConsecutiveDeclarations: false
AlignEscapedNewlines: Left
AlignOperands: true
AlignTrailingComments: true
AllowAllArgumentsOnNextLine: true
AllowAllConstructorInitializersOnNextLine: true
AllowAllParametersOfDeclarationOnNextLine: true
AllowShortBlocksOnASingleLine: Never
AllowShortCaseLabelsOnASingleLine: false
AllowShortFunctionsOnASingleLine: false
AllowShortLambdasOnASingleLine: All
AllowShortIfStatementsOnASingleLine: WithoutElse
AllowShortLoopsOnASingleLine: true
AlwaysBreakAfterDefinitionReturnType: None
AlwaysBreakAfterReturnType: None
AlwaysBreakBeforeMultilineStrings: true
AlwaysBreakTemplateDeclarations: Yes
BinPackArguments: true
BinPackParameters: true
BraceWrapping:
AfterCaseLabel: false
AfterClass: false
AfterControlStatement: false
AfterEnum: false
AfterFunction: true
AfterNamespace: false
AfterObjCDeclaration: false
AfterStruct: false
AfterUnion: false
AfterExternBlock: false
BeforeCatch: false
BeforeElse: false
IndentBraces: false
SplitEmptyFunction: true
SplitEmptyRecord: true
SplitEmptyNamespace: true
BreakBeforeBinaryOperators: None
BreakBeforeBraces: Custom
BreakBeforeInheritanceComma: false
BreakInheritanceList: BeforeColon
BreakBeforeTernaryOperators: true
BreakConstructorInitializersBeforeComma: false
BreakConstructorInitializers: BeforeColon
BreakAfterJavaFieldAnnotations: false
BreakStringLiterals: true
ColumnLimit: 120
CommentPragmas: '^ IWYU pragma:'
CompactNamespaces: false
ConstructorInitializerAllOnOneLineOrOnePerLine: true
ConstructorInitializerIndentWidth: 4
ContinuationIndentWidth: 4
Cpp11BracedListStyle: true
DeriveLineEnding: true
DerivePointerAlignment: true
DisableFormat: false
ExperimentalAutoDetectBinPacking: false
FixNamespaceComments: true
ForEachMacros:
- foreach
- Q_FOREACH
- BOOST_FOREACH
IncludeBlocks: Regroup
IncludeCategories:
- Regex: '^<ext/.*\.h>'
Priority: 2
SortPriority: 0
- Regex: '^<.*\.h>'
Priority: 1
SortPriority: 0
- Regex: '^<.*'
Priority: 2
SortPriority: 0
- Regex: '.*'
Priority: 3
SortPriority: 0
IncludeIsMainRegex: '([-_](test|unittest))?$'
IncludeIsMainSourceRegex: ''
IndentCaseLabels: true
IndentGotoLabels: true
IndentPPDirectives: None
IndentWidth: 4
IndentWrappedFunctionNames: false
JavaScriptQuotes: Leave
JavaScriptWrapImports: true
KeepEmptyLinesAtTheStartOfBlocks: false
MacroBlockBegin: ''
MacroBlockEnd: ''
MaxEmptyLinesToKeep: 1
NamespaceIndentation: None
ObjCBinPackProtocolList: Never
ObjCBlockIndentWidth: 2
ObjCSpaceAfterProperty: false
ObjCSpaceBeforeProtocolList: true
PenaltyBreakAssignment: 2
PenaltyBreakBeforeFirstCallParameter: 1
PenaltyBreakComment: 300
PenaltyBreakFirstLessLess: 120
PenaltyBreakString: 1000
PenaltyBreakTemplateDeclaration: 10
PenaltyExcessCharacter: 1000000
PenaltyReturnTypeOnItsOwnLine: 200
PointerAlignment: Left
RawStringFormats:
- Language: Cpp
Delimiters:
- cc
- CC
- cpp
- Cpp
- CPP
- 'c++'
- 'C++'
CanonicalDelimiter: ''
BasedOnStyle: google
- Language: TextProto
Delimiters:
- pb
- PB
- proto
- PROTO
EnclosingFunctions:
- EqualsProto
- EquivToProto
- PARSE_PARTIAL_TEXT_PROTO
- PARSE_TEST_PROTO
- PARSE_TEXT_PROTO
- ParseTextOrDie
- ParseTextProtoOrDie
CanonicalDelimiter: ''
BasedOnStyle: google
ReflowComments: true
SortIncludes: false
SortUsingDeclarations: true
SpaceAfterCStyleCast: false
SpaceAfterLogicalNot: false
SpaceAfterTemplateKeyword: true
SpaceBeforeAssignmentOperators: true
SpaceBeforeCpp11BracedList: false
SpaceBeforeCtorInitializerColon: true
SpaceBeforeInheritanceColon: true
SpaceBeforeParens: ControlStatements
SpaceBeforeRangeBasedForLoopColon: true
SpaceInEmptyBlock: false
SpaceInEmptyParentheses: false
SpacesBeforeTrailingComments: 2
SpacesInAngles: false
SpacesInConditionalStatement: false
SpacesInContainerLiterals: true
SpacesInCStyleCastParentheses: false
SpacesInParentheses: false
SpacesInSquareBrackets: false
SpaceBeforeSquareBrackets: false
Standard: Auto
StatementMacros:
- Q_UNUSED
- QT_REQUIRE_VERSION
TabWidth: 4
UseCRLF: false
UseTab: Never
...
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
.vscode/settings.json
projects/core135_llm_product_test_ui
projects/imx678_test
2 changes: 1 addition & 1 deletion SDK
147 changes: 147 additions & 0 deletions doc/projects_llm_framework_doc/llm_camera.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,147 @@
# llm-camera
视频源单元,用于从 USB V4L2 视频设备中获取视频流到内部通道。

## setup
配置单元工作。

发送 json:
```json
{
"request_id":"2",
"work_id":"camera",
"action":"setup",
"object":"camera.setup",
"data":{
"response_format":"camera.raw",
"input":"/dev/video0",
"enoutput":false,
"frame_width":320,
"frame_height":320
}
}
```
- request_id:参考基本数据解释。
- work_id:配置单元时,为 `camera`。
- action:调用的方法为 `setup`。
- object:传输的数据类型为 `camera.setup`。
- response_format:返回结果为 `camera.raw`,是 yuv422 格式。
- input:读取的设备名。
- frame_width:输出的视频帧宽。
- frame_height:输出的视频帧高。
- enoutput:是否起用用户结果输出。如果不需要获取摄像头图片,请不要开启该参数,视频流会增加信道的通信压力。

响应 json:

```json
{
"created":1731488402,
"data":"None",
"error":{
"code":0,
"message":""
},
"object":"None",
"request_id":"2",
"work_id":"camera.1003"
}
```
- created:消息创建时间,unix 时间。
- work_id:返回成功创建的 work_id 单元。


## exit

单元退出。

发送 json:

```json
{
"request_id": "7",
"work_id": "camera.1003",
"action": "exit",
}
```

响应 json:

```json
{
"created":1731488402,
"data":"None",
"error":{
"code":0,
"message":""
},
"object":"None",
"request_id":"7",
"work_id":"camera.1003"
}
```

error::code 为 0 表示执行成功。

## taskinfo

获取任务列表。

发送 json:
```json
{
"request_id": "2",
"work_id": "camera",
"action": "taskinfo"
}
```

响应 json:

```json
{
"created":1731652311,
"data":["camera.1003"],
"error":{
"code":0,
"message":""
},
"object":"camera.tasklist",
"request_id":"2",
"work_id":"camera"
}
```

获取任务运行参数。

发送 json:
```json
{
"request_id": "2",
"work_id": "camera.1003",
"action": "taskinfo"
}
```

响应 json:

```json
{
"created":1731652344,
"data":{
"enoutput":false,
"response_format":"camera.raw",
"input":"/dev/video0",
"frame_width":320,
"frame_height":320
},
"error":{
"code":0,
"message":""
},
"object":"camera.taskinfo",
"request_id":"2",
"work_id":"camera.1003"
}
```


> **注意:work_id 是按照单元的初始化注册顺序增加的,并不是固定的索引值。**
Loading