Convert dmss (Dahua DMSS) to LAVA @artifact_processor (consolidate + media migration)#829
Merged
Conversation
…media migration)
Converts the Dahua DMSS CCTV/IoT parser to the decorated pattern. The
original emitted 8 reports including three pairs that were the SAME query
run on the no-account .db and each per-account ez*.db, with per-account
dynamic report names. These are consolidated into single tables with an
'Account' discriminator column ('Without Account' or the account name), so
the artifact is now six stable LAVA tables: CCTV Channels, CCTV Info, IoT
Registered Sensors, IoT Registered Cloud Devices, IoT Notifications, and
User Created Media. Notification timestamps become aware UTC datetimes
(from raw epoch ms; the stored device time string is kept as a plain
column). User-created media migrates from media_to_html to a
('File Content','media') column via check_in_media. Author attribution
preserved in the header; reserved-word column audit run (clean).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Converts
dmss.py(Dahua Technology DMSS — CCTV + IoT) to the decorated@artifact_processorpattern.Consolidation: the original produced 8 reports, where the IoT trio (Sensors / Cloud Devices / Notifications) was the same query run twice — once on the no-account
.dband once per per-accountez*.db, with dynamic per-account report names ((Account- {filename})). Dynamic names don't fit LAVA tables, so each duplicated pair is consolidated into one table with anAccountdiscriminator column (Without Accountor the account name). Result — six stable artifacts (category Dahua Technology (DMSS)):get_dmssget_dmss_infoget_dmss_sensorsget_dmss_cloudget_dmss_notificationsget_dmss_mediaOther
Timestamp→ aware UTCdatetime(raw epoch ms); the stored device time string is kept as a plainDevice Reported Timecolumn..jpg/.mp4/.dav, thumbnails skipped) migrates frommedia_to_htmlto('File Content','media')viacheck_in_media.Original dates (2023-04-13) preserved.