Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[issue 5428] No longer let the worker store things in share/testresults #212

Merged
merged 13 commits into from Mar 4, 2015

Conversation

coolo
Copy link
Contributor

@coolo coolo commented Mar 1, 2015

The worker uploads everything through HTTP - not yet finished though and it goes together with the os-autoinst pull request.

Just for review/discussion for now

@coveralls
Copy link

Coverage Status

Coverage decreased (-0.2%) to 64.05% when pulling 4491b65 on issue_5428 into 3d7cbef on master.

@coolo
Copy link
Contributor Author

coolo commented Mar 1, 2015

that's rather sad, but more worker code == less coverage ;(

my $workerurl = $worker->{properties}->{WORKER_IP} . ':' . $workerport;
$self->stash('worker', $job->worker);
my $workerport = $job->worker->get_property('WORKER_PORT');
my $workerurl = $job->worker->get_property('WORKER_IP') . ':' . $workerport;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think WORKER_PORT and IP aren't needed for anything anymore.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

depends on your definition of needing:

./templates/test/running.html.ep:              Worker: <%= $worker->{properties}->{WORKER_IP} %>:<%= $worker->{properties}->{WORKER_PORT} %>

@aaannz
Copy link
Contributor

aaannz commented Mar 1, 2015

Heh, I didn't notice your 'not yet finished' note, now those TODOs makes sense. :)
I like the direction, but I feel I'll need a 'guided tour' or more time to comprehend how's going to work.

@coolo
Copy link
Contributor Author

coolo commented Mar 2, 2015

The ultimative goal is to have openQA act on DB and not on files - so the worker reads the files and uploads them as needed. There is no need for us to store the things as os-autoinst spits them out. What matters is that we can dig them quickly in the webui.

See also https://progress.opensuse.org/issues/6496 for an idea how to make an even bigger mess with the files :)

@coveralls
Copy link

Coverage Status

Coverage decreased (-0.01%) to 64.24% when pulling 81568fd on issue_5428 into 3d7cbef on master.

@coolo coolo force-pushed the issue_5428 branch 3 times, most recently from afdeca3 to 237d7bd Compare March 2, 2015 12:30
@coolo
Copy link
Contributor Author

coolo commented Mar 2, 2015

I rebased the branch and removed all debugging aids as it works pretty fine now.

What's missing:

  • writing a migration that splits all result.json files
  • upload the ulogs

@coolo
Copy link
Contributor Author

coolo commented Mar 2, 2015

  • upload video and log file and ...

I will need a 2nd route for that - pngs as base64 JSON are already challenging :)

@coolo
Copy link
Contributor Author

coolo commented Mar 2, 2015

wrote a migration now and rebased one more time :)

@coveralls
Copy link

Coverage Status

Coverage decreased (-0.3%) to 64.16% when pulling 288a182 on issue_5428 into 7b63a60 on master.

@coolo
Copy link
Contributor Author

coolo commented Mar 2, 2015

I just counted: I added netto 0 TODOs as I removed 3 :)

left TODO:

  • fix interactive mode (I left that open intentionally as lnussel rewrites this anyway)
  • cleanup tmpdirs (can happen after merge to master as I'm not sure when to do it actually)
  • upload logs as already mentioned

@coveralls
Copy link

Coverage Status

Coverage decreased (-0.65%) to 63.8% when pulling 0478fed on issue_5428 into 7b63a60 on master.

- add jobs::backend which stores the backend name extracted from the infos
- add jobs::result_dir which stores the subdirectory name (so we can change the NAME format later)
@coolo
Copy link
Contributor Author

coolo commented Mar 3, 2015

I'm done with my TODO

@coolo
Copy link
Contributor Author

coolo commented Mar 3, 2015

I would like to merge this tomorrow morning and rebase Ludwig' changes together with him - so last chance for public humilation :)

@nilxam
Copy link
Member

nilxam commented Mar 4, 2015

Looks fine to me, I skipped DB schema update though.

coolo added a commit that referenced this pull request Mar 4, 2015
[issue 5428] No longer let the worker store things in share/testresults
@coolo coolo merged commit ff72a98 into master Mar 4, 2015
@coolo coolo deleted the issue_5428 branch March 4, 2015 08:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants