File change watcher is not working in TextMate2 on Mac #1053

hgfischer · 2015-04-06T19:33:34Z

File watching in the current master version is broken in Mac, but not on Linux. Hugo looks to detect only the first change. Another sub-sequential changes are not detected.

I also had to checkout the 967d001ebe40cfe90992d953880356a495216202 version instead of the v0.13 tag because the v0.13 cannot be built.

The text was updated successfully, but these errors were encountered:

bep · 2015-04-06T19:41:47Z

I would be very surprised if this was true - as the core Hugo devs are mostly hugging their pretty Macs. I'm Linux.

Can you confirm this @mdhender ?

mdhender · 2015-04-06T20:39:23Z

I'm not having any issues with the current master recognizing multiple changes:

$ git checkout master
Switched to branch 'master'
Your branch is up-to-date with 'origin/master'.

$ go build

$ go install

$ hugo version
Hugo Static Site Generator v0.14-DEV BuildDate: 2015-04-06T15:32:57-05:00

$ cd ~/Data/Sites/n608/

$ hugo server -w
0 draft content
0 future content 
2 pages created
0 paginator pages created
0 tags created
0 categories created
in 6 ms
Watching for changes in /Users/test/Data/Sites/n608/{data,content,layouts,static,themes/l}
Serving pages from /Users/test/Data/Sites/n608/public
Web Server is available at http://localhost:1313/
Press Ctrl+C to stop

Change detected, rebuilding site
2015-04-06 15:36 -0500
0 draft content
0 future content 
2 pages created
0 paginator pages created
0 tags created
0 categories created
in 6 ms

Change detected, rebuilding site
2015-04-06 15:36 -0500
0 draft content
0 future content 
2 pages created
0 paginator pages created
0 tags created
0 categories created
in 6 ms

hgfischer · 2015-04-06T20:44:26Z

The Mac issue was observed in the computer of @reginaldosousa. Maybe he can give more detail about his Mac.

We tested many times, and got the same behavior even after resetting the entire GOPATH (bin, pkg and src).

mdhender · 2015-04-06T20:52:56Z

It looks like there is an outdated dependency for the v0.13 tag.

$ git checkout v0.13
Note: checking out 'v0.13'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

  git checkout -b new_branch_name

HEAD is now at e43eaba... Updating the final release notes for v0.13

$ git status
HEAD detached at v0.13
nothing to commit, working directory clean

$ go get
package bitbucket.org/kardianos/osext
    imports bitbucket.org/kardianos/osext
    imports bitbucket.org/kardianos/osext: code in directory /Users/Guest/go/src/bitbucket.org/kardianos/osext expects import "github.com/kardianos/osext"

$ go build
commands/version.go:23:2: code in directory /Users/Guest/go/src/bitbucket.org/kardianos/osext expects import "github.com/kardianos/osext"

$ go get -u
package github.com/spf13/hugo: github.com/spf13/hugo is a custom import path for https://github.com/spf13/hugo, but /Users/Guest/go/src/github.com/spf13/hugo is checked out from https://github.com/spf13/hugo.git

mdhender · 2015-04-06T20:55:29Z

FWIW:

$ uname -a
Darwin Michaels-Mac-Pro.local 14.1.0 Darwin Kernel Version 14.1.0: Thu Feb 26 19:26:47 PST 2015; root:xnu-2782.10.73~1/RELEASE_X86_64 x86_64
$ go version
go version go1.4.2 darwin/amd64

hgfischer · 2015-04-06T20:55:43Z

Yes @mdhender. That is why I had to checkout 967d001 to be able to build something that resembles v0.13, which works well in Mac.

bep · 2015-04-06T21:05:19Z

There are (big) rooms for improvements in the Go packaging world. So, if you build v0.13 now (if it had built successful), you will not get the same binary now compared to when it was released (because third partiy deps have changed).

So I would either:

Use brew (that I now think has the source dependencies sorted out)
Download the binary
Use the latest master

hgfischer · 2015-04-06T21:18:46Z

@bep If you start over with a clean GOPATH, are you able to successfully build v0.13?

The current brew formula does exactly what is needed to fix the v0.13 release before building it. It applies a patch to do the same thing that 967d001 does: https://github.com/Homebrew/homebrew/blob/master/Library/Formula/hugo.rb
This is OK, but not feasible in my use case. I have to support more than one platform environment and the go tool should be sufficient to install Hugo without issues.
The latest master appears to have a bug, as was previously reported in this issue.

We should not create other ways to build/install things that are made in Go. The go tooling is sufficient enough for building and installing things. IMHO it is nice to have a Brew formula to install a binary or maybe install Go and use it to build Hugo, but applying a patch just because the v0.13 release got wrong, is a smell for me.

In this case, I suggest creating a v0.13.1 release with the proper fix.

reginaldosousa · 2015-04-06T21:24:34Z

$ uname -a
Darwin Mac-81.local 14.1.0 Darwin Kernel Version 14.1.0: Thu Feb 26 19:26:47 PST 2015; root:xnu-2782.10.73~1/RELEASE_X86_64 x86_64
$ go version
go version go1.4.2 darwin/amd64

bep · 2015-04-06T21:42:23Z

For "bulding from a release tag" to be a success, we need to have a source release process that also includes thirdparty deps. I see discussion about a formal improvements of the current situation at go-nuts/go-dev mailing list, but it's not an easy task and not something that can be solved by Hugo alone.

@spf13 is the man to talk to about releases.

mdhender · 2015-04-07T15:54:51Z

I know that "v014-DEV build works on my Mac" isn't the answer that you're looking for, but it does. The only time I've had problems with the watch stopping were when there were errors in the templates. Sometimes the errors cause me to have to restart the server.

hgfischer · 2015-04-07T16:29:26Z

Our templates does not have errors, nor warnings. At least Hugo is not complaining. If is there some way to debug this, maybe we (me and @reginaldosousa) could help fix the issue, but we need help to debug it.

mdhender · 2015-04-07T16:58:00Z

Can you share the template? I have time this afternoon to run on my Mac to see if I can duplicate the issue. That would be a first step.

hgfischer · 2015-04-25T19:56:49Z

It is based on the original Hugo docs template, extracted from it's own source repository.

tcurdt · 2015-05-28T13:47:22Z

Installed via homebrew

Hugo Static Site Generator v0.14 BuildDate: 2015-05-26T18:46:46+02:00

and have the same problem.

I am running hugo server -w --theme=html5 --buildDrafts and it does not very consistently respond to file changes.

Especially when changing and saving the same file twice.
It's almost as if it only triggers on the first change per file.

dunn · 2015-05-28T16:22:58Z

I can't replicate that on 10.10.3, with Hugo 0.14 also installed via brew.

tcurdt · 2015-05-28T16:34:34Z

Odd. I am also on 10.10.3.

dunn · 2015-05-28T16:58:42Z

If you run it with --verbose, is there any output after the first reload?

tcurdt · 2015-05-29T01:01:11Z

$ hugo server -w --verbose --theme=html5 --buildDrafts
INFO: 2015/05/29 Using config file: /Users/tcurdt/Downloads/hugo-test/config.toml
INFO: 2015/05/29 syncing from /Users/tcurdt/Downloads/hugo-test/themes/html5/static to /Users/tcurdt/Downloads/hugo-test/public/
INFO: 2015/05/29 syncing from /Users/tcurdt/Downloads/hugo-test/static/ to /Users/tcurdt/Downloads/hugo-test/public/
INFO: 2015/05/29 found taxonomies: map[string]string{"tag":"tags", "category":"categories"}
ERROR: 2015/05/29 Site's .BaseUrl is deprecated and will be removed in Hugo 0.15. Use .BaseURL instead.
WARN: 2015/05/29 Unable to locate layout for 404 page: [404.html theme/404.html]
2 of 2 drafts rendered
0 future content 
2 pages created
0 paginator pages created
0 tags created
0 categories created
in 12 ms
Watching for changes in /Users/tcurdt/Downloads/hugo-test/{data,content,layouts,static,themes/html5}
Serving pages from /Users/tcurdt/Downloads/hugo-test/public
Web Server is available at http://127.0.0.1:1313/
Press Ctrl+C to stop

<save /Users/tcurdt/Downloads/hugo-test/content/about.md>
INFO: 2015/05/29 File System Event: ["/Users/tcurdt/Downloads/hugo-test/content/about.md": CHMOD "/Users/tcurdt/Downloads/hugo-test/content/about.md": REMOVE]

Change detected, rebuilding site
2015-05-29 02:56 +0200
INFO: 2015/05/29 found taxonomies: map[string]string{"tag":"tags", "category":"categories"}
WARN: 2015/05/29 Unable to locate layout for 404 page: [404.html theme/404.html]
2 of 2 drafts rendered
0 future content 
2 pages created
0 paginator pages created
0 categories created
0 tags created
in 14 ms

<save /Users/tcurdt/Downloads/hugo-test/content/about.md>
<save /Users/tcurdt/Downloads/hugo-test/content/about.md>
<save /Users/tcurdt/Downloads/hugo-test/content/about.md>

<save /Users/tcurdt/Downloads/hugo-test/content/post/2015-test-test/index.md>
INFO: 2015/05/29 File System Event: ["/Users/tcurdt/Downloads/hugo-test/content/post/2015-test-test/index.md": CHMOD "/Users/tcurdt/Downloads/hugo-test/content/post/2015-test-test/index.md": REMOVE]

Change detected, rebuilding site
2015-05-29 02:59 +0200
INFO: 2015/05/29 found taxonomies: map[string]string{"tag":"tags", "category":"categories"}
WARN: 2015/05/29 Unable to locate layout for 404 page: [404.html theme/404.html]
2 of 2 drafts rendered
0 future content 
2 pages created
0 paginator pages created
0 tags created
0 categories created
in 19 ms

<save /Users/tcurdt/Downloads/hugo-test/content/post/2015-test-test/index.md>
<save /Users/tcurdt/Downloads/hugo-test/content/post/2015-test-test/index.md>
<save /Users/tcurdt/Downloads/hugo-test/content/post/2015-test-test/index.md>

bep · 2015-06-28T18:01:36Z

@tcurdt are you still having this issue?

The thing is, I'm running OSX now -- and having this exactly issue.

See #1236

tcurdt · 2015-06-28T18:20:34Z

@bep yupp!

bep · 2015-06-28T18:32:17Z

The good thing is, I do not give up easily.

I have found a pattern (weird one, but still, a pattern).

With hugo server -w
If I open up foo.md in TextMate2 (my preferred text editor)
Do first change = > Hugo rebuilds, browser reloads OK
Do second change => Nothing

I I instead make the changes by just appending to the file:

echo "foo" >> foo.md

I can make many changes and everything works as expected. So it must be something fishy with the events triggered by the repetitive saves in Textmate2.

@tcurdt what text editor do you use?

bep · 2015-06-28T18:49:17Z

It's also working normally in TextEdit. So TextMate2 is the problem for me.

dunn · 2015-06-28T18:49:44Z

I can replicate this on TextMate also. It does not happen when I'm using Emacs.

tcurdt · 2015-06-28T18:57:37Z

@bep Wow - that I didn't expect. Was also using Textmate2 at the time.

bep · 2015-06-28T18:58:35Z

Yea, looks like it's the Atomic Save feature that messes up live reload stuff (not only for Hugo, but also Grunt etc.) -- I can not find a way to turn it off (it was an option in TextMate 1).

tcurdt · 2015-06-30T11:28:47Z

Maybe worth filing a bug on the watcher package then.

tcurdt · 2015-07-13T11:27:03Z

I've now seen this in a js setup as well - which to me suggests a problem on an even lower level.

Super annoying.

renatovargas · 2015-08-20T16:25:00Z

Hello everyone. I installed Hugo with homebrew and I am also getting the problem where the server with the --watch option tracks only one save with Textmate 2.0-beta.7.4. I'm on a MacBook Air and OS X Yosemite 10.10.4. I could use another text editor, but for me Textmate is very comfortable. Has anyone figured out a straight forward workaround? Thanks to all of you. Wonderful work!

Kevin-Hamilton · 2015-08-24T02:31:20Z

I just ran into this as well. Here's some issues from the fsnotify project that are probably related:
https://github.com/go-fsnotify/fsnotify/search?q=atomic&type=Issues

I'm not a Go developer, so I don't know that I can be much help, but here's some links I found in researching this that may be helpful to the Hugo developers:
golang/go#4068
howeyc/fsnotify#54
https://github.com/rjeczalik/notify

Kevin-Hamilton · 2015-08-24T05:02:05Z

Hm, I've done some testing with https://github.com/emcrisostomo/fswatch, with https://github.com/shama/gaze (the library behind gulp, grunt, etc), and with https://github.com/paulmillr/chokidar (the library behind browserify, webpack, etc) and all of them seem be succeeding at capturing multiple consecutive Textmate 2 saves. So I'm going to try and wire together a workaround to hugo server -w using one of these aforementioned projects until the underlying issue gets solved in hugo.

Maybe hugo could suggest a workaround like one of these in the docs, until a hugo fix surfaces...

bep · 2015-08-24T05:58:56Z

We will when a workaround arrives.

renatovargas · 2015-08-24T14:09:18Z

Thanks Kevin.

jbshirk · 2016-01-10T00:08:17Z

I thought you'd like to know that this issue affects me when I use Brackets. It might detect the first change after a restart but doesn't after that. However, switching to TextSoap watch works fine.

HTH

mikekreuzer · 2016-01-10T08:46:17Z

I get no updates at all with Atom 1.3.2/1.33. With TextEdit updates happen as I type, with Coda updates happen on file saves. Hugo v0.15 via brew.

bep · 2016-01-10T11:43:32Z

I have done some tests with TextMate andfsnotify`.

An edit triggers the events CHMOD + REMOVE
I guess the REMOVE triggers an un-watch in fsnotify

This hack-of-the-year works in my simple tests:

if event.Op&fsnotify.Remove == fsnotify.Remove {
    err = watcher.Add(event.Name)
    if err != nil {
        log.Fatal(err)
    }
}

@nathany - any input/advice on a temporary workaround for Hugo? This bug bugs me ...

/cc @spf13 @anthonyfok

bep · 2016-01-10T12:15:33Z

I have done some more testing and created a workaround-PR, see #1766

An edit in `TextMate` on OS X triggers the events `CHMOD` and `REMOVE`. This makes `fsnotify` stop watching that file. This commit works around that problem by re-adding the file to the watcher on `REMOVE` if the file still exists. See gohugoio#1053

bep · 2016-01-10T13:45:14Z

I thought you'd like to know that this issue affects me when I use Brackets.

@jbshirk just tested Brackets (nice editor) on OS X -- and it works fine for me re. watching (even without my patch).

bep · 2016-01-10T15:15:16Z

This patch in fsnotify fixes it for me in TextMate:

https://github.com/go-fsnotify/fsnotify/pull/111

nathany · 2016-01-14T02:20:52Z

Thanks @bep. https://github.com/go-fsnotify/fsnotify/pull/111 is merged.

Those waiting for this fix can update fsnotify and rebuild Hugo.

go get -u gopkg.in/fsnotify.v1

jbshirk · 2016-01-14T16:10:12Z

@bep Yes, it turned out to be a complex of issues, not the least was google drive interfering with normal finder functioning. Now brackets seems to be working the best of all the others I've tried.

WallStProg · 2018-05-03T14:24:50Z

It seems that this is still an issue w/version 2.0-rc.4.

github-actions · 2022-03-04T02:01:55Z

This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

bep mentioned this issue Jun 28, 2015

Livereload not working (for me) in OSX Yosemite #1236

Closed

bep added the Bug label Jun 28, 2015

bep added this to the v0.15 milestone Jun 28, 2015

bep self-assigned this Jun 28, 2015

nathany mentioned this issue Oct 16, 2015

Atomic saves in text editors cause havoc, unable to watch individual files fsnotify/fsnotify#17

Closed

anthonyfok modified the milestones: v0.16, v0.15 Nov 30, 2015

anthonyfok mentioned this issue Dec 19, 2015

Dynamic reloading of config file not always reliable #1684

Closed

bep mentioned this issue Jan 10, 2016

Workaround for watching in TextMate etc. #1766

Closed

bep closed this as completed Jan 14, 2016

stephanieluz mentioned this issue Jan 25, 2021

Mac constantly rebuilds (vim) plentico/plenti#109

Open

github-actions bot added the Outdated label Mar 4, 2022

github-actions bot locked as resolved and limited conversation to collaborators Mar 4, 2022

File change watcher is not working in TextMate2 on Mac #1053

File change watcher is not working in TextMate2 on Mac #1053

Comments

hgfischer commented Apr 6, 2015

bep commented Apr 6, 2015

mdhender commented Apr 6, 2015

hgfischer commented Apr 6, 2015

mdhender commented Apr 6, 2015

mdhender commented Apr 6, 2015

hgfischer commented Apr 6, 2015

bep commented Apr 6, 2015

hgfischer commented Apr 6, 2015

reginaldosousa commented Apr 6, 2015

bep commented Apr 6, 2015

mdhender commented Apr 7, 2015

hgfischer commented Apr 7, 2015

mdhender commented Apr 7, 2015

hgfischer commented Apr 25, 2015

tcurdt commented May 28, 2015

dunn commented May 28, 2015

tcurdt commented May 28, 2015

dunn commented May 28, 2015

tcurdt commented May 29, 2015

bep commented Jun 28, 2015

tcurdt commented Jun 28, 2015

bep commented Jun 28, 2015

bep commented Jun 28, 2015

dunn commented Jun 28, 2015

tcurdt commented Jun 28, 2015

bep commented Jun 28, 2015

tcurdt commented Jun 30, 2015

tcurdt commented Jul 13, 2015

renatovargas commented Aug 20, 2015

Kevin-Hamilton commented Aug 24, 2015

Kevin-Hamilton commented Aug 24, 2015

bep commented Aug 24, 2015

renatovargas commented Aug 24, 2015

jbshirk commented Jan 10, 2016

mikekreuzer commented Jan 10, 2016

bep commented Jan 10, 2016

bep commented Jan 10, 2016

bep commented Jan 10, 2016

bep commented Jan 10, 2016

nathany commented Jan 14, 2016

jbshirk commented Jan 14, 2016

WallStProg commented May 3, 2018

github-actions bot commented Mar 4, 2022