Repository navigation
Endpoint Visibility Edr Telemetry
Host-level instrumentation โ turn endpoints into rich telemetry sources for detection and hunting
Part of the ULTIMATE CYBERSECURITY MASTER GUIDE ยท Incident Response section
Collection and detection links: Velociraptor evidence-triage workflow and Sigma/osquery/Elastic rule validation complement Sysmon, auditd and osquery. Agent telemetry alone is not evidence of full detection coverage.
Index for the Endpoint Visibility sub-section โ deployment and configuration guides for the host-level instrumentation that feeds a SIEM: Windows Sysmon, Linux auditd/syslog, and cross-platform Osquery.
Links to a guide per instrumentation source โ installation, configuration, the key events/queries that matter for detection, and how to forward the resulting telemetry into a SIEM.
Enable a defender to instrument Windows and Linux hosts so that process, network, file, and authentication activity is captured with enough fidelity to detect and reconstruct an attack.
- Standing up endpoint telemetry before (or alongside) a SIEM
- Deciding what to log on Windows (Sysmon) vs Linux (auditd) hosts
- Adding SQL-based, on-demand host inspection with Osquery for threat hunting
- Tuning event volume so detections fire without drowning the SIEM in noise
- Overview
- Instrumentation Sources
- Deployment Guides
- Deployment Workflow
โ ๏ธ Monitoring, Consent & Legal Warning- Contributing
- Resources
A SIEM is only as good as the telemetry it ingests. Endpoint visibility is the practice of instrumenting hosts so that security-relevant activity โ process creation, network connections, file writes, image loads, logons โ is recorded in a form you can search and alert on.
This sub-section covers the three sources that do most of the heavy lifting in a homelab or small SOC. They are complementary: Sysmon and auditd provide continuous event streams, while Osquery provides on-demand, point-in-time inspection of host state.
Tip
Deploy an event stream first (Sysmon on Windows, auditd on Linux), forward it to your SIEM, then layer Osquery on top for interactive hunting.
| Source | Guide | Platform | Model | Best For |
|---|---|---|---|---|
| ๐ช Sysmon | Windows/sysmon.md | Windows | Continuous event stream | Rich process/network/file/DNS tracing |
| ๐ง Auditd / Syslog | Linux/auditd_syslog.md | Linux | Continuous event stream | Kernel-level syscall & file/session auditing |
| ๐ Osquery | Linux/osquery.md | Cross-platform | On-demand SQL queries | Interactive threat hunting & host state |
๐ช Windows Sysmon
Deploy and configure Sysmon with community configs (SwiftOnSecurity, Olaf Hartong). Covers install/update, the configuration XML structure, and the critical event IDs โ 1 (process create), 3 (network), 7 (image load), 8 (CreateRemoteThread), 10 (process access), 11 (file create), 22 (DNS) โ plus hashing, SIEM forwarding, and a detection use case per event type. The single highest-value Windows telemetry source.
Harden Linux logging with auditd and rsyslog/syslog-ng. Covers auditd rule syntax (syscall auditing, file-access watches, user-session tracking), pre-built rule sets (STIG, CIS), log forwarding to a SIEM, parsing with ausearch/aureport, and common detection use cases.
๐ Osquery
Instrument hosts as a SQL-queryable surface. Covers installation (with the modern signed-by apt keyring), configuration, and queries for proactive threat hunting and monitoring โ ideal for asking ad-hoc questions ("which processes have a deleted binary on disk?") across a fleet.
- DAT โ dag's Audit Tool โ PowerShell inventory of Windows hardware, accounts, services, networking, updates, Defender and event-log information. Check the script, permissions and sensitive output handling before using it on a client machine.
- PNWC SystemTester โ your portable Windows/Sysinternals diagnostic and malware-triage toolkit; useful for technician baselines and pre/post-repair reports. A clean diagnostic run does not prove the absence of compromise.
These produce point-in-time observations; Sysmon, auditd, osquery and a SIEM still provide the continuous telemetry described below.
PNWC DeployWorkstation automates Windows application provisioning, updates and removal of selected preinstalled software. It belongs in an approved deployment or rebuild workflow after investigation, required evidence preservation and recovery planningโnot in live malware triage. Test change lists on a disposable VM, obtain customer approval for removals and keep rollback/restore options available.
1. Instrument
โโ> Windows: install Sysmon with a curated config (Olaf Hartong / SwiftOnSecurity).
โโ> Linux: load an auditd rule set (CIS/STIG) + configure rsyslog forwarding.
2. Forward
โโ> Ship events to your SIEM (Winlogbeat/Filebeat, or the SIEM's own agent).
โโ> Confirm events index correctly โ see ../SIEM/README.md.
3. Hunt on demand
โโ> Add Osquery for interactive, SQL-based host inspection.
4. Tune
โโ> Trim noisy events; keep the high-signal IDs. Map detections to MITRE ATT&CK.
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ ๏ธ DEPLOY TELEMETRY ONLY WITH AUTHORIZATION โ ๏ธ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โบ Only install agents/telemetry on systems you own or are explicitly
authorized (in writing) to monitor. Endpoint monitoring can capture
keystrokes, commands, and personal data.
โบ Covert monitoring of users/employees without proper notice can violate
wiretap/interception, privacy, and labor laws โ coordinate with legal/HR.
โบ Forwarded logs often contain PII/credentials; protect the SIEM and
transport (TLS) accordingly, and follow GDPR/HIPAA/CCPA where applicable.
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Contributions from detection engineers and SOC analysts are welcome.
What we accept:
- โ Sysmon config tweaks and per-event-ID detection notes
- โ auditd rule sets and rsyslog/syslog-ng forwarding configs
- โ Useful Osquery packs/queries for hunting
- โ SIEM field-mapping notes
Guidelines:
- Sanitize sample events of real PII/credentials.
- Note the OS/tool version tested.
- Describe the detection value in your PR.
- Sysmon (Sysinternals): https://learn.microsoft.com/en-us/sysinternals/downloads/sysmon
- sysmon-modular (Olaf Hartong): https://github.com/olafhartong/sysmon-modular
- auditd / Linux Audit: https://github.com/linux-audit/audit-documentation/wiki
- Osquery docs: https://osquery.readthedocs.io/
- MITRE ATT&CK (data sources): https://attack.mitre.org/datasources/
- โฌ ๏ธ Incident Response section
- ๐ SIEM deployment guides
- ๐ Digital Forensics
- ๐ฅ Log Aggregation primer
- ๐ Glossary (EDR, IoC, TTP, Sysmonโฆ)
- ๐ Main Repository
๐ก๏ธ Visibility is the foundation of defense โ instrument hosts ethically and legally.
Maintained by Pacific Northwest Computers (PNWC)
โฌ ๏ธ Back to Master Index | ๐ฏ Role Navigation | Legal Notice
๐ Source: IncidentResponse/Endpoint-Visibility/README.md | โ๏ธ Suggest an edit | โฌ
๏ธ Back to Incident Response
- ๐บ๏ธ Browse by Topic
- ๐ All Repository Files
- ๐งญ Learning Paths
- ๐ Master Guide
- ๐ค Glossary
- โ๏ธ Legal & Disclaimer
๐ Foundations & Learning
๐ก๏ธ Defense & Investigations
- Incident Response
- Open Source Intelligence (OSINT)
- Reverse Engineering
- Operations Security (OPSEC)
- Compliance
โ๏ธ Platforms & Infrastructure
๐ก Hardware, Wireless & Field Projects
- PNWC Cyberdeck
- Hardware Testing
- Hardware Hacking
- Software-Defined Radio
- Wardriving
- uConsole
- Space Security
๐งฐ Assessment & Field Reference
๐ฆ Downloads & Project Resources
๐๏ธ Additional Topics