Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove the LDP Basic tests from suite #94

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

Conversation

kjetilk
Copy link
Contributor

@kjetilk kjetilk commented Mar 18, 2020

As we do not have a strict LDP interpretation in Solid, this is removes the LDP test suite from the test suite itself. Those who use an LDP server below Solid are encouraged to run the LDP test suite as part of their environment.

We need to confirm the Docker container runs with this, thus the Work in progress tag in the subject.

@kjetilk kjetilk mentioned this pull request Mar 18, 2020
@kjetilk kjetilk changed the title [WIP] Remove the LDP Basic tests from suite Remove the LDP Basic tests from suite Mar 18, 2020
@kjetilk kjetilk requested a review from csarven March 18, 2020 15:39
Copy link
Collaborator

@michielbdejong michielbdejong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should keep it.

The current spec requires compliance with LDP BasicContainer.

The draft new spec even requires compliance with all of LDP.

You mentioned solid/specification#69 but I think that is at a higher layer. Solid builds on LDP in the same way LDP builds on HTTP, it's layering, right?

Can you point to evidence that the work-in-progress version of the next spec is moving away from (some of) the requirements that the LDP Basic tests are testing for?

You say we will keep ldp:contains but not some of the other things. Out of the 90 LDP Basic tests we have now, which ones do you think test things that Solid does not require from a pod?

@kjetilk
Copy link
Contributor Author

kjetilk commented Mar 18, 2020

This is a very long discussion, that has been going on for many months.

The spec draft was a quick thing put together by Ruben and myself, and previously, even though the old documentation says that it is an LDP application, NSS is just 20% compliant with the test suite. NSS also doesn't respect the interaction models, etc. In reality, LDP hasn't ever been crucial to Solid.

It might well be that a future Solid spec compliant implementation will pass 100% of the Solid test suite, but we will need to document all of Solid in tests anyway, and the 90 tests there will not change this. Meanwhile, I would be concerned that an implementor would come along and look at LDP and think they have to be Solid compliant, which is a mouthful. It is likely easier to write a compliant Solid implementation from scratch, than an LDP implementation from scratch.

I agree that there is little in terms of text, but it is being worked on. If you wish, we can wait to merge this until the new spec comes to the level where it is clear that the LDP legacy is too much to bear.

Copy link
Contributor

@csarven csarven left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#94 (comment) summarises the rationale for this PR to go through. Merge whenever it makes sense.

node-solid-server 15/90 0/1 22/49
trellis 47/90 0/1 10/45
wac-ldp 57/90 1/1 8/50
Server Websockets-pub-sub RDF-fixtures
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should Websockets-pub-sub be removed until it is actually worked out? Or is there intended to be a particular subset covered?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it is OK to have there as there is something to test, the actual details are worked out as we go, which is true for everything right now, we're in flux. If we do reach a point where tests are not aligned with the state-of-the-art on specification, then we can consider removing it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants