Excavate: I PROGNOS MEMBERS

[spikelynch]

Unearthing a latent text from an existing one (a la Tom Phillips' A Humument), probably using an RNN for this

Project home page: https://etc.mikelynch.org/nanogenmo2019/

Blog writeup: https://mikelynch.org/2019/Nov/22/excavate/

Fork of torch-rnn with excavate algorithm: https://github.com/spikelynch/torch-rnn

Project repo with pre- and post-processing scripts and instructions on how to run the whole chain https://github.com/spikelynch/Excavate/

[spikelynch]

First cut of the code: https://github.com/spikelynch/Excavate

[spikelynch]

Very early preview: primary text is The Three Musketeers and it's been excavated with an RNN trained on Charles Fort's Book of the Damned

In the of the story we are to our the my I by the of the of in a more by I of
the and devoured my I satisfy of the of the to of and although squibs may be,
for and the of the of Anne of and the of the in of the mind as a matter one
the he met in the men, in the illustrious of of and Aramis. We but which
disguised the of of the simple we had no rest of our of the we read this
object a whole be the at discouraged many fruitless at in the de of of and the
of the of King be was our the page of of the of The of a unknown at a period
in a high degree of the pack of the of if with our own we the who pretend of
the part of precious which we to our it title to and an that if we this part
the it we is a second the reader to our and to of the de or the may let us 1
OF the of the of the market of of ROMANCE OF THE ROSE as of the had just of
it. the women the High and somewhat or the Jolly and times of this kind. who
made against each there was the king, the was which made war against in to or
The took up arms or nobles or the king, the or the on the clamor, nor of the
of the arrived of the was to of a Don his coat of the of had faded into a
nameless of wine and a heavenly face and bones, of an sign a Gascon of the
open too him for a son a journey the which, the of his steed the of all It was
a pony, to on his though his head lower the of horse were so under his hide of
the pony of an before, the gate of to And of this second his not to the that a
steed the of the pony the He was not a beast was at had the were above price.
of the house of father ago, and has which and honorably and if you make a with
it, of you the to go the to

[spikelynch]

More sophisticated example: I've now hacked the torch-rnn code to force it to output words (or partial words) from a predetermined vocabulary. This is the net trained on RNN, but the vocab from Robert Burton's Anatomy of Melancholy:

6, inflicted with a smile that which was a little in the course of the cardinal to the cardinal to the cardinal to the cardinal to the cardinal to be concerned in the commission of the cardinal at the same time that he had not been able to say to him. He had a trial on the same time that he was not so long as much as he was about to be concerned by a lady of the cardinal and the cardinal to the cardinal to be sent to him, and a horse for him, he had not seen him at the same time that he had arrived at the noble and political air, and that he had not been able to deal with his sword, and said to him, he remained at the sight of his horse, and the travel was a favor of the cardinal and his pock in the court, and he had not the same countenance, and as the wounded man and the stranger had been at the king, and the other was a little forty to seek up at the same time that he was a letter to himself, and a pretty woman had been at the moment of arresta that the cardinal had passed through the country to the cardinal to be concerned in the streets of a surprised his eyes, and asked him that the sight of his three friends were all at once. He had a tarrying himself at the end of the conversation, and a horse from the cardinal had not the less interrogati and the stain of the hotter of the cardinal when he had been sent to him as a conversation, in which he had fixed his hands and the bearing of the stain of the cardinal when he had seen him at the same time that he had not been able to lose in the morning. At the same time the poor girl did not know that he had not been able to deal with a single sword in the house, should be assassinate the cardinal to be confidence in his shoulder, and his adversary were fixed upon him, and the cardinal saw that he had found himself well, and as he had never seen him at the door. He had not the less faithful to his sister that he had not been able to say to him. He was at the same time that he had not been so little to him, he was about to reply to the cardinal to open so much attaches to his anxiety a part of his heart. He took advantage of the cardinal and the letter in the command of the cardinal to the cardinal to which he had not been so far from her beautiful diamond studied floor at the door. He had a struggle was not so long as a single step toward the cardinal and the cardinal in which the cardinal was at the state, and the lackey waiter in his turn, and the sight of him was not exactly on the same time that he had not been so lifted him. He had a statue, and the cardinal was at the end of the stain of the cardinal and his pock to see if they had been forced to return to the house, and the lackey waiter in the antecedent his hand, and he had seen him and his sword with him. He was about to say, and retired as a compliment, he was too late, and who, but for a visit in which the cardinal had been at the same time that he had not been able to deal with him. He had not to be concerned in a convent of his horse, and all was over. The cardinal appeared to him that the stranger was a man who had been the honor to be satisfied. This was the count the principal things were already admitted the door of the present distance of the contrary, and who had not been so much dread of a mistress. He was about to pass on the part of his horse, he said, that he had not been seen in the house of the partition, in which he had finished the singular streets, and the cardinal was acquainted with a single word to be a strange carriage, and was seen in his hand, and the cardinal was at the first hand, and was seen the sum that it was the preceding evening he had been stolen from his friends. A single word, and said that he had not returned to him that the lackey of the stain of his friends with a single smile to the demon and the countenance of the cardinal and the cardinal when he was about to say to him. He had a struggle would be sorry to see him at the same time that he was a man who had accompanied him to himself, and the stranger had been the same countenance. He was too late, and stopped on his hand on his pock to his pock away. He had already lost the countenance of the cardinal to the second time. The cardinal was still so pale that he had received a little and sound, and had been waiting on that letter, and the moment he had acted upon the stain of the party of the cardinal and his passage of his friends. The first time he had to do with her beautiful hand, and the cardinal was at the same time that he had not to deal with a single smile to his lackey. He was at the same time that he was only a sign to his friends to the house, and had been seen in some simplicity of age, he had a trial of a countenance at the same time that he was a woman who was still difficult it was necessary to be sure, and was acquainted with all his eyes and the two hands he was to be committed. He was a man who had been seen to him, and a pretty woman had been made by the contrary, and who had been at that

[spikelynch]

Further examples here

https://github.com/spikelynch/torch-rnn/tree/feature-excavate/Samples/Excavate

[spikelynch]

Improved the excavate algorithm so that it preserves the line-breaks and punctuation from the RNN while substituting the vocabulary from Anatomy of Melancholy

“This is the matter,” said Athos, “you will find me to tell you that you are
about to be concerned in the court.”

“The devil!” said d’Artax and seemed to him.

“Well, then, that it is not my faith, my dear Athos, you may see her.”

“And what did you say?”

“That is to say, then, that you may be assured that I am in a convent.”

“Then you have seen the same time that you may be some fine and short
immediately.”

“What the devil do you say?”

“Yet,” said Athos, “and that is a fresh sign to repair the day before he was to prevent
my honor.”

“What do you mean to say that the cardinal said, Athos, you know that it is to say,
you must not go away by that of my honor, it is not the less
true that I have the order to be in the company of the cardinal.”

“What is that?”

“Yet if you know that I wish to be some finer to the cardinal?”

“Yet in a convent, then, to be satisfied,” said the cardinal, “that we are
at the same time that I have not left us.”

“And I am sure of it?”

“Yet in all this, monsieur, I will see her to see you again, and that as I have not told you
the same secret.”

“Well, then, that it is to be sure that I have said, then, as I have
seen a cardinal.”

“What do you mean by my own cases,” said Athos, “for I am sure.”

“With the same consideration,” replied d’Artayn, who had not
the saddle to the second time. “It is a sad thing, madder in the
contrary, the cardinal has not a service to him who have not told me the same
of the state.”

https://github.com/spikelynch/torch-rnn/blob/feature-excavate/Samples/Excavate/Musketeers_aom2.txt

[spikelynch]

First example of the real excavate algorithm, which uses the RNN from Three Musketeers to work its way through the text of Anatomy of Melancholy in order, using it up as it goes along

https://github.com/spikelynch/torch-rnn/blob/feature-excavate/Samples/Excavate/Musketeers_AoM_true.txt

The of a man which he have same in heart as a content of the studies and the part of the
presentiaque of the cares of the carry. The cap an intent of the most sin
of serve or makes the most sit and see this dishes he sense her
for him. How is the more that had bear company as he was about to
repair to his comment. The case was so much the satisfy
as in the aris men of the strong. Tho know, the devout was to be some another in the
matter with a bad free, and the little cause which having so love heard in the
content, and the boar was one of the cart of him.

“I will see, mad a signis--”

“The devil!” said de Troy. “I have the less to be dissolute the cannon. The cannon is
a star of a human spend in the count that he have not see the satin of the horses.”

“And you were absurd, the carriage may company you to obstinate the
more than the world.”

“Where do you sad, mors.”

“Who is that?”

[spikelynch]

First preview of Humument-style excavated Musketeers

[spikelynch]

Draft with only 6649 words - it will need some tuning to get a lookahead value that can get 50,000 words out of the 500k+ in Anatomy of Melancholy

https://etc.mikelynch.org/nanogenmo2019/Test1/

[spikelynch]

Some better drafts, although not quite at the 50k mark yet, and a project home page

https://etc.mikelynch.org/nanogenmo2019/

[spikelynch]

Completed! The final version, I PROGNOS MEMBERS, is on the project home page now

https://etc.mikelynch.org/nanogenmo2019/streaming250k20.html
https://etc.mikelynch.org/nanogenmo2019/streaming250k20_raw.html

[spikelynch]

Here's a blog post about how the algorithm works, and a few of the annoying technical hitches:

https://mikelynch.org/2019/Nov/22/excavate/