Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lda topics on nasa Pits #1

Closed
amritbhanu opened this issue Mar 31, 2016 · 2 comments
Closed

Lda topics on nasa Pits #1

amritbhanu opened this issue Mar 31, 2016 · 2 comments

Comments

@amritbhanu
Copy link
Contributor

Experiment 1

  • Words greater than 3
  • Extracted those logs whose severity is 2, and discarded the others

Top 30 Topics

30 topics:
TOPIC 0
capabl  0.0072857702548080085
detect  0.006889243638298703
thruster    0.006700064944549625
int 0.006607782123785966
verifi  0.0065153889947990404
monitor 0.00650296321145424
provid  0.006375887077561054
version 0.006342073856340687
mode    0.006232402158806654
illeg   0.006220333047750552

TOPIC 1
sequenc 0.033129759453011234
flight  0.03252374735588161
address 0.022959018219828313
configur    0.019362618270488675
execut  0.018645697987183907
spacecraft  0.018536089237481138
vml 0.016712577126068412
contain 0.014304561669005917
dump    0.012876027216572137
capabl  0.012353371621085145

TOPIC 2
text    0.014176183805144018
indic   0.01402861490766197
disabl  0.011578996197979974
initi   0.01114483984031251
power   0.010708437769477594
process 0.010701123372393252
issu    0.010398400658366539
number  0.008637492236074887
configur    0.007928624859391881
manag   0.007903798812742504

TOPIC 3
mode    0.07966584673217642
state   0.03718070354145717
initi   0.03572169251594875
address 0.031429716725763605
fault   0.030452571566128406
spacecraft  0.027279151643025204
submod  0.022740745115632146
event   0.021906758483994815
array   0.01824853606074547
safe    0.017724767764738542

TOPIC 4
paramet 0.0071188055404684805
sram    0.006827464128244202
mode    0.00673273831926996
srup    0.006591190141582033
trace   0.006586444155181463
lead    0.006553998061153735
verifi  0.00645559544261332
packet  0.00642680558984484
refer   0.0064026813981321005
statu   0.006329258144168653

TOPIC 5
step    0.07957132256961552
procedur    0.0645619658601564
valv    0.041675091536043866
execut  0.036320039850185164
engcntrl    0.03142032361285736
rvm 0.031151429519339312
ppu 0.028139784762838016
latch   0.026210595939019456
control 0.01665968261541891
safe    0.01489455854502568

TOPIC 6
detect  0.006901424936164037
illeg   0.006830546315072616
ssp 0.006780407223867901
calcul  0.00675266664234023
chang   0.006670584494538672
baselin 0.006639908707605641
size    0.006587158292765058
base    0.006470646527962334
byte    0.006417814822230279
attitud 0.006399922089239512

TOPIC 7
engcntrl    0.12864125725078046
rvm 0.08106913144631238
miss    0.06797058286501821
paramet 0.04712804740169639
oper    0.03959955807878258
question    0.03548013555542337
set 0.035106402441915874
lead    0.035063628473402754
baselin 0.0331610948442407
valid   0.025475517399741195

TOPIC 8
text    0.013554263569267398
issu    0.011318615133417836
monitor 0.010701013969762457
function    0.01063652335226498
data    0.010621648784653277
eeprom  0.008556587731938457
indic   0.008555600925061647
manag   0.008527574670884068
flight  0.0083612822637015
number  0.008008184417918564

TOPIC 9
refer   0.007059825821001276
lead    0.006984447280031191
scr 0.006838087440533121
receiv  0.006717873863744479
uplink  0.006674271056485936
process 0.0066346156141782455
iru 0.006563385386916043
index   0.006443017673025953
safe    0.006432388815486642
pressur 0.006411195054815109

TOPIC 10
fals    0.03580471202584637
initi   0.010931205194610211
file    0.008206711770178607
num 0.007587271599197137
word    0.007044442564413284
code    0.007024508831246105
verif   0.006556217191035221
fail    0.0064630813488873295
number  0.006456010424001303
baselin 0.006374013212012404

TOPIC 11
projecta    0.06746218996739925
point   0.04184767002882261
tabl    0.028350651612809887
specif  0.026752048078420344
control 0.02492652800690521
inertia 0.024851322524132656
design  0.019213967081341876
perform 0.01911143149108216
analysi 0.01904415564239937
note    0.018525507516305707

TOPIC 12
scr 0.007000582800495213
paramet 0.006666637905827172
oper    0.006660309291516552
process 0.006600259070505539
state   0.006473211101004202
procedur    0.0063467868940232505
latch   0.006293818254668043
task    0.00625789441880334
monitor 0.006250431817756035
fals    0.006204256309834193

TOPIC 13
text    0.05542830868272589
issu    0.03725262264123818
function    0.035717358930808504
use 0.03449499026069172
number  0.024030362307005032
configur    0.023222596144389325
file    0.02161114366150162
differ  0.02041661569850046
rate    0.019600705898817104
data    0.019428473501135756

TOPIC 14
plenum  0.06249745243079222
engcntrl    0.0409187547507851
rvm 0.036013477398814595
pressur 0.03230371555369164
paramet 0.02545298747765356
second  0.022874174938327285
check   0.02236197131682671
valu    0.022107342696258078
data    0.018644210188598787
miss    0.017962971753087812

TOPIC 15
integr  0.006770258735374216
paramet 0.0065478122693753025
state   0.006507774808691103
event   0.006457570853626896
step    0.006382456198675023
result  0.006294514557105005
sequenc 0.006211944228406801
contain 0.006182191108707061
pse 0.006174884134512087
file    0.006140997936215436

TOPIC 16
perform 0.006759823859313174
gener   0.006753369449746122
idl 0.006579616748933607
discuss 0.006444489487713062
verif   0.00644447573029011
illeg   0.006349126276971217
calcul  0.006300919187424522
respons 0.006298347915265842
fault   0.0062068278503890325
projecta    0.006161297742674911

TOPIC 17
float   0.06443236109201486
equal   0.047199710697273065
variabl 0.02934617624497164
constant    0.023256584077755587
accept  0.017902067085217875
point   0.014308891713200092
number  0.01066318416415156
sun 0.01047228634419052
line    0.010271237303141185
safe    0.010187038486312423

TOPIC 18
constant    0.0067272032380626
event   0.006509176463676518
accept  0.0064645037686356
invalid 0.006408657163372205
statu   0.006308655882355975
follow  0.006282119776234993
updat   0.006242530188278966
case    0.0062374334951456134
valid   0.006232355334315194
gener   0.006214309165593506

TOPIC 19
code    0.06089576666196665
document    0.023529369371275612
calcul  0.019601636551500184
line    0.017346617131557968
bit 0.01578553107263362
float   0.014946003104453131
equal   0.0116140446933427
valu    0.01101304871095636
variabl 0.010571777572977425
flight  0.010009773380919672

TOPIC 20
text    0.01319767734485295
engcntrl    0.012989456529975841
issu    0.011008447357302964
miss    0.010487501094100416
valv    0.010455669829729019
rvm 0.010301555088397404
state   0.010288119759840264
initi   0.010162147401351915
use 0.010023395745515468
manag   0.00805930979917511

TOPIC 21
file    0.03711533387181546
line    0.036662071751758965
prioriti    0.03252689221436745
ace 0.024601020266133027
defin   0.023781163143673706
counter 0.02375448623140276
buffer  0.023409858058972895
valu    0.02262365120226543
size    0.02100273544220952
error   0.018441500948256993

TOPIC 22
rvm 0.058557052788672445
engcntrl    0.05147203358485272
bootload    0.04588724664333789
checksum    0.045278735080949054
calcul  0.041654115486330225
memori  0.03298984546384696
text    0.03269440107902858
idl 0.026195712265557315
fsw 0.023523170638217756
address 0.021366050392282596

TOPIC 23
num 0.006609283590812713
subaddress  0.0066003824882191
fals    0.006592974808638571
switch  0.006572564017413236
rate    0.006493912398838559
fsw 0.006470888042171489
control 0.006409973661028382
sun 0.006394022472625757
set 0.006350634655874299
launch  0.0063247526201570085

TOPIC 24
suncrosscalib   0.00683729202567074
init    0.006589179818997157
address 0.006555629737091954
hop 0.006453259698936264
valu    0.006421198805018765
dump    0.006304229634976303
scrub   0.006231210980935616
checksum    0.006222658102646131
type    0.0062151285407071565
limit   0.0062148949738669084

TOPIC 25
access  0.007015605770948273
packet  0.006878738003382888
sub 0.00681656724573433
obc 0.006680487905656781
prioriti    0.006644301963427974
write   0.006550542311169962
wait    0.006507482714691407
correct 0.006478934758681904
initi   0.006461548505262755
hlp 0.0064226804419323874

TOPIC 26
transit 0.007274267735111653
use 0.0067174487488747
verif   0.0067061381279485445
ppu 0.00658514885657192
receiv  0.0065420117405110695
scrub   0.006522674447596902
execut  0.006514190194472578
defin   0.006414629726145246
main    0.006374296721232405
capabl  0.0063654238087001505

TOPIC 27
statu   0.03141061634696384
messag  0.02692935272088277
bound   0.02655592019775904
access  0.026544893112142195
flexelint   0.020997808517881016
line    0.020127632879032676
file    0.01948517834033966
attitud 0.016821070971116785
int 0.01674476456958524
valid   0.015860426415481667

TOPIC 28
request 0.006491484194327534
limit   0.006442496939425952
bootload    0.006403388811680738
fdc 0.006399974023558598
progress    0.00639587365713958
index   0.006275722391109265
control 0.006249616915266672
includ  0.006200056435239194
vcdu    0.006174630782103055
calcul  0.006159157887654544

TOPIC 29
ang 0.007032597978994753
pcontrol    0.006737330705273606
rate    0.00672458742169172
rvm 0.006693384392581234
address 0.006614323139184355
flight  0.00656254355888187
valv    0.006546939310696933
switch  0.00648290719226052
sub 0.006415598605858243
spacecraft  0.006386103243420132
@amritbhanu
Copy link
Contributor Author

Experiment 2

  • Words greater than 5
  • Extracted those logs whose severity is 2, and discarded the others

Top 30 Topics

TOPIC 0
latch   0.04296334939486119
close   0.03775588868064399
bound   0.015289302880046587
defin   0.011485650045913074
build   0.011291443681479723
limit   0.011137415715298546
point   0.011038154738481448
monitor 0.010905894493565488
provid  0.010892680546767498
function    0.010817322767400172

TOPIC 1
updat   0.044510132369346395
engcntrl    0.02267504746919872
packet  0.021172558009450077
telemetri   0.014181863935712285
check   0.013229127826311455
contain 0.012393675391203942
follow  0.011913135853140046
valid   0.011261734414264826
baselin 0.010630357703077528
question    0.01044835608819319

TOPIC 2
engcntrl    0.21575717847054998
question    0.05147053105058905
pressur 0.04052312898875211
baselin 0.03962979329953389
paramet 0.03921709141759282
check   0.03293997675715105
sourc   0.02880633271329411
valid   0.028525223862820297
plenum  0.026959070139871574
number  0.023253343762793834

TOPIC 3
contain 0.009493985009117464
allow   0.009409136633628369
access  0.009357419360832803
includ  0.009300604526953816
verifi  0.009293125368650937
sourc   0.009203002131393731
telemetri   0.009196022947945852
current 0.009172229975575581
plenum  0.009158959614710322
chang   0.009030817538022798

TOPIC 4
interrupt   0.1259342162735302
illeg   0.08278783977799142
error   0.07449923912098239
engcntrl    0.06322179387947635
detect  0.03482335440301513
enabl   0.027086877848378443
flight  0.026555055682625332
indic   0.017648270595848854
sourc   0.017116530577894796
differ  0.016780991390209127

TOPIC 5
manag   0.010079589866698288
provid  0.009843771619717157
capabl  0.009321908845350326
eeprom  0.009319620211664582
discuss 0.00925796743984761
event   0.009238012528503394
suncrosscalib   0.009065843049641722
interrupt   0.00903662474157246
defin   0.009009865040983568
projecta    0.008899789621128909

TOPIC 6
variabl 0.009474521843427305
inconsist   0.009427665780559442
illeg   0.009164074710499069
disabl  0.00912798273924226
result  0.009073698978985705
control 0.009070518609257304
refer   0.009002734034292628
pressur 0.008976286439760053
receiv  0.008942624439315075
start   0.008922364215155009

TOPIC 7
specif  0.009541980036516786
question    0.009382104242981342
execut  0.009302951787012691
inertia 0.009276304543943297
sequenc 0.009236406922783715
switch  0.009128691762383189
discuss 0.009061479921439443
paramet 0.008908130324359925
identifi    0.008889498602600396
document    0.00887927728347143

TOPIC 8
event   0.010357056626764616
specifi 0.009539433604298118
variabl 0.009389335742752341
updat   0.009327333668352814
second  0.009292989626023866
bound   0.00925532466394645
write   0.00911116291184148
engcntrl    0.00905736740123587
refer   0.00904206281864103
build   0.009024457398406387

TOPIC 9
function    0.0731946241982215
result  0.02136670782850698
uplink  0.019218236372475425
enabl   0.01439511921246187
state   0.013636480070015092
defin   0.013194068091323043
analysi 0.012094723065542136
process 0.012064327729263986
second  0.011768282426045445
follow  0.011477941917589923

TOPIC 10
verifi  0.09444937899667975
initi   0.051339266792119816
verif   0.048920742083868374
messag  0.04184342678198856
error   0.028805397832264854
switch  0.027283340564706632
bootload    0.023818071449864933
flexelint   0.02309997399708012
follow  0.022148491245184677
constant    0.020661674742921077

TOPIC 11
fault   0.009717272311903561
revis   0.009696581191103648
state   0.009643623571233459
error   0.009501314636719906
variabl 0.009264241641335106
sourc   0.00919707713678771
section 0.00916527836059709
current 0.009065869876525637
equal   0.009049981290171564
bound   0.008969610035352219

TOPIC 12
inertia 0.010119232059026094
project 0.009653141486301899
bound   0.009399117770787623
baselin 0.009244423487196785
monitor 0.009134701037888639
detect  0.009125722183910915
plenum  0.009095084451764227
respons 0.009054089952672569
write   0.008976514429166855
follow  0.008968543251548243

TOPIC 13
index   0.134697786954609
variabl 0.07337106825317598
defin   0.06586570098680936
array   0.06270140516116851
float   0.027852798239896368
bound   0.02520550028187855
doubl   0.024175605232621338
capabl  0.02319245427427881
function    0.021637315867629826
event   0.02157378992004301

TOPIC 14
memori  0.10789801498857028
function    0.07245222176964765
error   0.03935168087807402
prioriti    0.0292154201419533
scrub   0.026767527812434164
eeprom  0.026710187518234466
address 0.017829512169083805
initi   0.01700911910173763
defin   0.015600816901373101
perform 0.012766515550189225

TOPIC 15
state   0.009747549299482985
voltag  0.009636135432820023
checksum    0.009633722920117428
flexelint   0.009514111173337933
messag  0.00941817602884363
transit 0.009235894400993285
interfac    0.009221295611087693
calcul  0.009169485820478487
allow   0.009148863276869241
procedur    0.009044979656269837

TOPIC 16
prioriti    0.009485009989161752
event   0.00939274739880475
specifi 0.009312727670354268
indic   0.009196164431531251
verifi  0.009191353426732501
design  0.009060432974206549
cardnumb    0.008740431378275307
follow  0.008711988532727314
projecta    0.008707117879164769
index   0.008691326763974216

TOPIC 17
verif   0.009727311476502009
index   0.009589285790146203
correct 0.00957458035450249
inconsist   0.00945494279996503
paramet 0.009416489065057314
process 0.009262255382543471
result  0.009130552300873373
checksum    0.009079966098062263
progress    0.009078250721625556
messag  0.009066151601962169

TOPIC 18
checksum    0.07504656044846399
subaddress  0.06568417117461715
calcul  0.0597104329572484
engcntrl    0.055923695033354794
check   0.05119730864679638
progress    0.04636352118423583
receiv  0.04535141267582219
bootload    0.03968296156981613
write   0.03941250927980981
process 0.030334424049742775

TOPIC 19
scrub   0.00998157315800137
verif   0.009443282316388347
switch  0.009263292893102834
invalid 0.009128949565881093
close   0.009049365288531104
result  0.009027730955605997
power   0.008994596758062485
contain 0.00898937768391405
flexelint   0.008967244215033518
event   0.00895169009859769

TOPIC 20
voltag  0.009420651937708266
correct 0.009322634697686063
sourc   0.009222356216014563
sroac   0.00918243129803163
engin   0.009166541637316573
project 0.009086221682777248
integr  0.009035122681997432
engcntrl    0.008979054243510504
identifi    0.008848340606120612
document    0.008713420982425652

TOPIC 21
inertia 0.010119396714568752
execut  0.009440483435357454
identifi    0.009427447995633435
plenum  0.00913464235312562
launch  0.009106348477590296
projecta    0.009087015902436825
float   0.009040098017375105
sntbl   0.009003352753460767
baselin 0.008917410570462582
check   0.008872512451334698

TOPIC 22
enabl   0.009389293742530716
execut  0.009277170174381634
current 0.00914867361426131
engcntrl    0.009127334188076442
provid  0.0090561239670902
bootload    0.008920027029170118
counter 0.008854817562713812
question    0.008854238742991507
checksum    0.008845583181292157
respons 0.008826069685283499

TOPIC 23
design  0.009702754008110404
respons 0.009279230050760949
interfac    0.0092151556168899
eeprom  0.009182417192974144
ignor   0.009079018410699125
check   0.009004314237790748
variabl 0.008994917246775987
checksum    0.008932604365467074
latch   0.008853273971442695
array   0.008821178030319876

TOPIC 24
ground  0.00933512646917572
engin   0.009318729334438482
telemetri   0.009296779570957774
pcontrol    0.009215680261828198
attitud 0.009126409595391759
state   0.009009389572536641
sntbl   0.008966815238670583
statu   0.008927006842642849
flight  0.008921445550873822
projecta    0.008907346650839648

TOPIC 25
pcontrol    0.11203891399554602
integr  0.03896119560593689
limit   0.017899770750215278
error   0.015496857615916564
inertia 0.012168566242057564
doubl   0.011026639916747231
control 0.009887999451348328
design  0.009368224923176854
differ  0.009105982625730872
includ  0.008968400041222273

TOPIC 26
paramet 0.01922073277836441
engcntrl    0.01850910039555241
number  0.01529521442883589
engin   0.01500744272052941
invalid 0.012673481302849524
ignor   0.011963161055373614
baselin 0.011957527705462144
indic   0.011735354933864166
error   0.011687794182760761
question    0.011212929220720888

TOPIC 27
request 0.08494460843754202
transit 0.05464655696038395
chang   0.03727893409625909
verifi  0.023694133926420256
check   0.02208447032942963
engcntrl    0.02089621523397186
indic   0.019724188348991423
error   0.018453118019760847
control 0.01772871335682011
ignor   0.016258804166027277

TOPIC 28
target  0.009772088004858667
address 0.00932736737462312
disabl  0.009280266675238317
procedur    0.009264752829220124
cardnumb    0.009247025164853708
eeprom  0.009230179079133115
includ  0.009188352257288018
checksum    0.00917748514388672
subaddress  0.008994262331093555
equal   0.008961040541880853

TOPIC 29
point   0.058861860079994346
state   0.044109711502219824
flight  0.04273505810149117
projecta    0.038292478721560864
specif  0.03494453041908503
control 0.032320617472353985
spacecraft  0.031108452716651018
attitud 0.024577167592338682
perform 0.023877840298090987
target  0.02128526725445825

@amritbhanu
Copy link
Contributor Author

@timm these are the topics with words greater than 3 and words greater than 5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant