My local directory ended up getting wiped somehow on windows.

[KaelBaldwin]

I wasn't paying very close attention to it so I don't have steps to reproduce at this time, but I ran devspace up and started working on something else.

When I came back to the project, everything except for some directories I had explicitly excluded from downloading had been removed, including my .git directory. Luckily I didn't have anything I was working on in the project elsewhere at the time, but it could have been a lot worse.

I'm going to attempt to reproduce if I can and I'll share more, but I figured you all should be aware this happened.

If I had to guess off the top of my head, since windows gets it's time differently than linux, perhaps the root folder that was being synced was being calculated as older than the directory in the devspace deployed container and so it wiped it.

[KaelBaldwin]

OK, that's probably why you all had the COPY . /var/www/html, I guess I assumed it would sync the changes on it's own when I made my own image so I removed that line

[FabianKramm]

@KaelBaldwin Thanks for opening this issue! This is very interesting and generally this should also work without the COPY statement in the docker file. I suspect that the find command that we use to check what files exist remotely somehow failed and did not retrieve anything, which led to the assumption that there are no more files remotely and hence led to the deletion of your files locally. This never happened to any of us though. I'll implement an additional check to verify that the find command returned a correct answer, before any deletion takes place.

Could you provide us the .devspace/logs/sync.log and .devspace/logs/sync.log.old files so that I can investigate further what circumstances led to this behavior?

[KaelBaldwin]

I'm afraid the logs are gone from that particular issue, I should have saved them, sorry, but I wiped the remaining files from the directory and re-cloned my repo since it was damaged beyond repair.

However, I'm running into problems with syncing that might be related, namely, I can't get upstream syncing to work at all. There are log messages about upstream syncs, when the process starts, but nothing actually appears to have changed from the time of the Docker COPY statement.

Whenever I create a new file locally, the remote container never seems to receive the new file.

Back to the original issue, perhaps with upstream syncing not working (for me), coupled with the fact that I didn't have a Docker COPY statement, it saw the directory as being empty and blew away my local. Not sure, still just guessing.

I can create a new issue for the upstream sync problems, I was about to when I saw you reopened this.

I can get you the logs for today in that issue or here if you like.

[KaelBaldwin]

I've noticed the syncing issues on both linux and windows.

Though I'll note that all my linux work thus far has been on a CIFS mounted directory of a windows share, which I could imagine might throw things off.

[FabianKramm]

Okay no problem. Yes maybe you can share your .devspace/config.yaml here, especially the sync configuration. Could you also run devspace up --verbose-sync and post the logs here or send it to me via mail (kramm@covexo.com) so that I can investigate the upstream problems?

[KaelBaldwin]

sure thing, this test is being done on windows.

(you'll note I got smart and added .git to the excludePaths so I can at least recover if everything gets wiped...)

devSpace:
  deployments:
  - helm:
      chartPath: ./chart
    name: devspace-apps
  ports:
  - labelSelector:
      release: devspace-apps
    portMappings:
    - localPort: 80
      remotePort: 7001
  sync:
  - containerPath: /var/www/html
    labelSelector:
      release: devspace-apps
    localSubPath: ./
    excludePaths:
    - Dockerfile
    - .devspace/
    - chart/
    - .git/
    - .idea/

{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Sync] Start syncing","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:44:56-05:00"}
{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Sync] Initial sync completed","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:45:00-05:00"}
{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Upstream] Create File /src/AppBundle/UserBundle/Controller/AccessControlApiController.php","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:45:00-05:00"}
{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Upstream] Create File /test.txt","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:45:00-05:00"}
{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Upstream] Upload 2 create changes (size 4287)","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:45:00-05:00"}
{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Upstream] Successfully processed 2 change(s)","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:45:01-05:00"}

Now I'm testing this with the test.txt file.

This is immediately after running devspace up --verbose-sync

The docker image was not rebuilt, so the conatainer has an older version of text.txt, as it was at the time of the docker build:

12345678910

Locally, the files contents are actually:

testing123

Now if I change the contents locally:

testing123456

New log messages are added:

{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Upstream] Couldn't stat file C:\\Users\\kabaldwin\\projects\\My-Project/test.txt___jb_tmp___: GetFileAttributesEx C:\\Users\\kabaldwin\\projects\\My-Project/test.txt___jb_tmp___: The system cannot find the file specified.\n","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:49:15-05:00"}
{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Upstream] Couldn't stat file C:\\Users\\kabaldwin\\projects\\My-Project/test.txt___jb_tmp___: GetFileAttributesEx C:\\Users\\kabaldwin\\projects\\My-Project/test.txt___jb_tmp___: The system cannot find the file specified.\n","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:49:15-05:00"}
{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Upstream] Couldn't stat file C:\\Users\\kabaldwin\\projects\\My-Project/test.txt___jb_old___: GetFileAttributesEx C:\\Users\\kabaldwin\\projects\\My-Project/test.txt___jb_old___: The system cannot find the file specified.\n","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:49:15-05:00"}
{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Upstream] Handling 1 removes","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:49:15-05:00"}
{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Upstream] Remove /test.txt","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:49:15-05:00"}
{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Upstream] Create File /test.txt","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:49:15-05:00"}
{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Upstream] Upload 1 create changes (size 117)","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:49:15-05:00"}
{"container":"/var/www/html","level":"info","local":"C:\\Users\\kabaldwin\\projects\\My-Project","msg":"[Upstream] Successfully processed 6 change(s)","pod":"devspace-apps-66cc796c6-zqzjf","time":"2018-10-29T09:49:15-05:00"}

yet remotely I still have:

12345678910

[FabianKramm]

Thanks for providing this detailed information! The logs look actually okay to me, the change was recognized locally and transferred to pod devspace-apps-66cc796c6-zqzjf:/var/www/html/test.txt . So I'm wondering why it was not changed in the pod. Could you run kubectl exec devspace-apps-66cc796c6-zqzjf stat /var/www/html/test.txt and post the output here? Maybe it is a permission issue in the container

[FabianKramm]

@KaelBaldwin could you also provide your Dockerfile, so I can test this on my side?

[KaelBaldwin]

  File: test.txt
  Size: 12              Blocks: 8          IO Block: 4096   regular file
Device: fc00h/64512d    Inode: 12461471    Links: 1
Access: (0777/-rwxrwxrwx)  Uid: (   33/www-data)   Gid: (   33/www-data)
Access: 2018-10-29 13:39:19.000000000 +0000
Modify: 2018-10-29 13:39:19.000000000 +0000
Change: 2018-10-29 14:05:04.963584714 +0000
 Birth: -

Don't ask my why the client is all red, the windows client has a few other problems I haven't had time to create issues for yet. (some keys don't work... i.e. arrow keys, not sure what other yet) I've taken to just ditching the console that devspace up is running in and kubectl execing into the container manually.