Skip to content

lucasdicioccio/deptrack

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

THIS PROJECT HAS MOVED

You are looking at an old version of DepTrack. A newer, up-to-date, better-documented version with more features and better performance is available at: DepTrack-Project Repository

DepTrack

DepTrack is a concise DSL (domain-specific language) to express dependencies between objects.

One goal of DepTrack is to leverage a modern type system as the one in Haskell:

  • write your dependencies using a concise DSL, with no accidental complexity (e.g., type inference)
  • inexpensive and expressive data types to model your objects

Motivation

The concept of dependencies arise naturally when building and operating large systems. Unfortunately, tracking dependencies between components of a system is one of these easy but daunting task.

There exist systems such as build-systems, package managers, and configuration management systems to express dependencies between components. Theses systems focus on particular business requirements and have an opinionated idea of what is a dependency. Somehow, you may not want to attach an action to check for dependencies or build the missing ones.

We wanted to design something as useful as a graphical editor but using textual descriptions. The dot language from Graphviz is a good target for outputting graphs but the dot language is not an ideal input format. Unsatisfied with the state of affairs, we built DepTrack. DepTrack is a library to track dependencies between arbitrary objects.

Usage and examples

We discuss a typical workflow with DepTrack and provide ideas.

Workflow

The intended workflow for DepTrack is as follows:

a) describe what is a dependency (e.g., hardware/software/an action to check if present/alive)
b) write `data` definitions for a small component or a combination of components
c) wrap constructors with the `pure` and `nest` functions to track dependencies
d) print the graph of the component
e) goto b if the result is not fine enough

See the example in the example/Car.hs for a result. This example takes a fictional example of a "Car" which has a brand, a type of engine, and four wheels. Therefore, we want to provide a nice DSL to build Cars and track their dependencies with DepTrack. Existing "combinators" from Data.Traversable (sequenceA) and Control.Applicative (<$> et al.) let you write type-checked helpers.

A more complex example in example/Service.hs provides a more-in-depth example than example/Car.hs . The Service example represents some Internet services that I want to run (namely, websites). These services must be working according to some simple rules. We define a DSL to express what is a 'check' (an action to tell whether the service works) and how to define new services. We further provide a function which walks the graph of services and tries to locate faulty services in the dependency graph.

Possible uses

DepTrack already provides enough to generate "Graphviz visualizations", such visualizations are useful documentations. Some graph computation may help you compute what is the probability of failure of a given node. Elaborating on the type of dependency nodes also lets you get more "actionable" dependency graphs. For instance, one can generate a decision process to locate faulty nodes in a large system when dependencies have a "check" method.

Installation

This project is cabalized but not yet published on Hackage. You can install it from source like any other cabal project.

Design

DepTrack uses an applicative functor to carry out a side-effect (recording dependency links) while computing a value (an object you may be interested in). Sometimes, the only interesting result is the dependency graph from the side-effect.

The type of dependency to track is a parameter and may depend on your business requirements. For instance, dependencies could be servers that must be running for your application to operate. In this example, we probably want to attach a "check" function to each dependency. This way we get a troubleshooting plan when things go wrong. In other situation, you may be interested in the dependency graph for documentation purposes only.

Implementation

The applicative functor is implemented using the Ap free-(applicative/monad) from the free package.

Dependencies of type a are encoded in a Data.Tree (Maybe a). The children of a node are the node's direct dependencies.

The evalTree function evaluates a tree where node may appear multiple times. For instance, if A and B both depends on C, you will see two copies of the node C in the branch for A dependencies and in the branch for B dependencies.

Performance are not the most critical goal for DepTrack and DepTrack may be overly lazy. If you run into situations where DepTrack performance are poor, please file a bug report (GitHub issue).

Known limitations

  • DepTrack cannot directly express "alternate paths" (e.g. "A" depends on "B OR C"). A possible workaround is to enrich the dependency type.
  • The evalTree computation must terminate (especially, we cannot express a lazily-computed infinite list of dependencies.) In particular, DepTrack cannot encode loops.