Skip to content

Tisats/ObsidianProcessorProcessorPlugin

 
 

Repository files navigation

Processor Processor for Obsidian

version license

For anyone involved in vendor risk management, mapping out subprocessor relationships can be a complex and time-consuming task. This plugin is a specialized tool designed to automate and streamline that process.

Processor Processor acts as your AI-powered co-pilot to discover, map, enrich, and document the relationships between data processors and their subprocessors, all directly within your Obsidian vault. This is the first release, and your feedback is greatly appreciated!


🚀 Getting Started: One-Time Setup

This plugin is deeply integrated with RightBrain.ai to provide its intelligent features. You only need to perform this setup once.

1. Create a RightBrain Account

  • Go to https://app.rightbrain.ai/ to register.
  • You can create an account using social sign-on with GitHub, GitLab, Google, or LinkedIn.
  • Follow the initial setup steps to create your account and first project.

2. Create your RightBrain API Client

  • Navigate to your RightBrain API Clients page: https://app.rightbrain.ai/preferences?tab=api-clients.
  • Click Create OAuth Client.
  • Give it a descriptive name (e.g., "Obsidian Plugin").
  • For "Token Endpoint Auth Method," select Client Secret Basic (client_credentials).
  • Click Create.

3. Securely Store Your Client Secret

  • You will now be shown your Client ID and a Client Secret.
  • IMPORTANT: The Client Secret is like a password for your application. It will only be shown to you once.
  • Immediately copy the Client Secret and store it securely in a password manager.

4. Copy Your Environment Variables

  • On the same page, you will see a block of text with your environment variables (RB_ORG_ID, etc.).
  • Click the Copy ENV button to copy this entire block to your clipboard.

5. Run the Setup in Obsidian

  • Make sure the Processor Processor plugin is installed and enabled in Obsidian.
  • Open the Obsidian Command Palette (Cmd/Ctrl + P).
  • Run the command: Complete First-Time Setup (Credentials & Tasks).
  • A window will pop up. Paste the environment variables you just copied into the text area.
  • Click Begin Setup.

That's it! The plugin will automatically save your credentials and create all the necessary AI tasks in your RightBrain project.


🔒 A Note on Security

Your RightBrain credentials (Client ID, Client Secret) and other settings are stored in the data.json file located within this plugin's folder in your vault's system directory (.obsidian/plugins/processor-processor/).

Please be aware that your Client Secret is stored in plaintext in this file. This is standard practice for most Obsidian plugins that require API keys. We recommend you use a dedicated vault for this type of research and ensure your vault's location is secure.


✨ Core Features

  • One-Command Setup: Get started in minutes. Paste your credentials from RightBrain and the plugin automatically configures itself and creates the required AI tasks in your project.
  • Smart Recursive Mapping: Start with a single company and automatically cascade searches through their subprocessors, building a deep dependency map. The search is "smart"—it uses a cache to avoid re-analyzing recent vendors and maps aliases to existing notes to prevent duplicates. Note: this powerful feature can take a long time to complete. It is recommended to start with a mapping depth of 2 to avoid excessive processing time.
  • Handle Difficult Sources: Some subprocessor lists are buried in PDFs, hard-to-parse web pages, or not publicly available at all. The Manually Add Subprocessor List URL and Input Subprocessor List from Text features allow you to point the AI directly at a URL or simply paste the text to ensure nothing is missed.
  • AI-Powered Verification & Extraction: Uses RightBrain to verify if a URL is a genuine, current subprocessor list and then extracts the names of all third-party vendors and internal company affiliates.
  • Automated Note Creation & Linking: Creates a central, linked note for each processor and subprocessor. A processor's note lists its subprocessors; a subprocessor's note lists who it's "Used By."
  • Visualize Your Supply Chain: Because all notes are inter-linked, you can use Obsidian's native Graph View to get an instant, interactive map of your vendor relationships. This makes complex data supply chains easier to understand and allows you to dive in and out of particular nodes of interest.
  • AI-Powered Deduplication: Run a command on your processors folder to find and merge duplicate entities, combining their relationships automatically. Duplicate files are safely archived with version numbers to prevent data loss, and all references are automatically updated to maintain link integrity.
  • Compliance Document Enrichment: Right-click any processor file to automatically find and link to that company's public DPA, Terms of Service, and Security pages.
  • Interactive Graph Visualization: Use Obsidian's native Graph View to visualize your supply chain relationships with color-coded nodes (processors in red, subprocessors in green) and smart filtering. Run Apply Recommended Graph Settings from the command palette to optimize the graph view for processor relationship visualization.

How to Use: A Sample Workflow

  1. Start with an Initial Discovery:

    • Open the command palette (Cmd/Ctrl+P) and run Search for Subprocessors (Discover).
    • Enter "OpenAI".
    • The plugin will find OpenAI's nicely formatted subprocessor page, extract the vendors, and create linked notes for them. You'll see it creates a new note for Microsoft Azure, a key subprocessor for OpenAI.
  2. Enrich a Discovered Subprocessor:

    • Now that a note for Microsoft Azure.md exists, right-click on it in the file explorer.
    • Select Enrich Processor Documentation. The plugin will find and add direct links for Microsoft's DPA, ToS, and Security pages into that note, giving you immediate access to key compliance documents.
  3. Go Deeper with Recursive Mapping:

    • To see the full supply chain, right-click the original OpenAI.md file again and select Map Subprocessor Relationships.
    • The plugin will now start looking for the subprocessors of each of OpenAI's subprocessors (like Microsoft Azure), building out the network map in your vault.
  4. Clean Up Duplicates:

    • After the discovery process, you might have notes for both "AWS" and "Amazon Web Services."
    • Right-click on your Processors folder and select Deduplicate Subprocessor Pages to automatically find and merge them, combining all their relationships into a single file.

🌱 Future Development & Feedback

This is the first release of Processor Processor. The "Enrich" features are just the beginning of a larger plan to build a suite of automated due diligence tools. I am also actively exploring enhancements to the graph visualization to make these relationship maps even more powerful.

Your feedback is invaluable for guiding what comes next! If you have ideas for new features or improvements, please share them by raising an issue on the plugin's GitHub repository.


⚠️ Limitations & Caveats

  • Reliance on Public Data: The plugin can only find and process subprocessor lists that are publicly accessible. If a company does not publish this information, the plugin cannot invent it.
  • Scope of Subprocessor Lists: Vendor subprocessor lists are typically comprehensive and cover all of their services. For example, Google's list includes subprocessors for all its products (Workspace, Cloud, etc.). If you only use Google Workspace, the plugin will still identify and map all subprocessors from the master list, many of which may not be relevant to your (or your processor's) specific use case. The plugin accurately reflects the source documentation and does not attempt to guess which subprocessors apply to you, as this would be unreliable.
  • Quality of Source Data: The accuracy of the extracted relationships depends on the clarity and format of the source documents. Ambiguous or poorly formatted lists may lead to less accurate results.
  • This is not Legal Advice: The plugin is a tool to accelerate research. It is not a substitute for professional legal or compliance advice. Always verify critical information.

Advanced Configuration

The Complete First-Time Setup command handles all essential configuration. However, you can review and tweak settings by going to Settings -> Community Plugins -> Processor Processor. Here you can adjust:

  • API Keys & Task IDs: All credentials and task IDs are stored here.
  • Mapping Depth: The maximum number of levels the recursive mapping will traverse. Warning: Setting this to a high number (e.g., above 3) can result in very long processing times and a large number of API calls. It is strongly recommended to start with a depth of 2 or 3.
  • Discovery Cache Duration: How many days to consider a processor's data "fresh" before re-analyzing it in a recursive run.
  • Folder Paths: Change the default Processors and Analysis Logs folder locations.
  • LLM Model Selection: Choose which AI model to use for each task (verification, extraction, deduplication, etc.). The plugin automatically fetches available models from your RightBrain project and allows you to select the best model for each specific task.
  • RightBrain Dashboard Access: All the underlying AI tasks created by the plugin can be viewed, modified, and fine-tuned directly in your RightBrain dashboard. This gives you full control over the AI prompts, output formats, and task configurations if you want to customize the behaviour beyond the plugin's settings.

Author

Tisats rightbrain.ai

Funding

This plugin is provided to encourage the use and exploration of RightBrain.ai. If you find it useful, please consider exploring RightBrain for your other automation needs.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • TypeScript 99.2%
  • Other 0.8%