Skip to content

mohamadkav/Forensics

Repository files navigation

Here is Node Merge doc:

--------Here are some info about how to run the program--------

1. You need to download and install postgresql and postman first.

2. When you run this code, you must run read first, and input the file of data source in postman,
   the head is: localhost:8080/command/read, the body is: {"trace":"C:\\Data\\ta1-marple-e4-A.log"},
   You need to set the index of data file in class AvroReader, line 39,
   for example: if the data file is C:\\Data\\ta1-marple-e4-A.log, the index is ta1-marple-e4-a.index;

3. When you finish running "read", you can run "reduce", you also need to input the file of data source.
   the same to 1. the class is Reducer, the line is 86, the head is localhost:8080/command/reduce;

4. I set result text as "temp.txt" in class Reducer line 88, the result text stores all the events after reducing.
   For result text, we can get the size of this text to evaluate the result of system.
   The size of Marple-A is 60G before reduction, and Marple-B is 69G.
   
5. You can read how to call these function in main function, the Node Merge need two data input: 
   The first one is reading data to database, in fact the function receives subjects and events that is set by Mohammad, not CDM subject and event.
   The second one is reading data to reduce, here the input is also set by Mohammad.
   
6. You can read subject and event info in folder db.entity;
   Instead of the whole system, I leave some interfaces so that you can merge Node Merge to your system.
   I think you can store subjects and events to database before all the reduction systems begin, it is only my suggestion.

7. My test file is: 47g.out and ta1-marple-1-e5-bgt-2.bin.1.
   There may be problems that the stack is overflow in Module reduce, you can add threshold in PostGreSqlApi to avoid this problem.
   The format of input file has some problems, you can read it when you run my code.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages