Parse GNU Makefiles with Python
I want to debug my GNU Makefiles.
Ultimate long-term goal is a GNU Make visual debugger. I want breakpoints on variables changing. I want to single step through the rules. I want to put a breakpoint on a rule.
Away from work sick with Covid. Not sick enough to not be bored watching TV.
- include directives work (need more testing)
- starting multi-line 'define' variables
- revamped the tokenizer to better handle rules vs expressions
- because of the improved tokenizer, much improved conditional block handling
Thanks to a PR, the code is in a much cleaner, more Pythonic state. All the test code and test makefiles are now in tests/ directory.
I've been battling problems with recipeprefix (aka 'tab'). GNU Make's parser is a bit ad-hoc and I need to match their behavior. Correctly supporting the is-a-recipe / is-not-a-recipe on lines starting with 'tab' is going to require a refactor of the tokenizer.
I have rules started. I have conditional directives working (needs more testing). The export and unexport directives work. I've been adding as many new pytest tests as I can think of.
Still TODO:
- include directives
- override directive
- 'define' multi-line variable definitions.
My original plan of returning arrays of python strings in the $() functions has been scrapped. I'm now building a 100% python string from each function. The functions .eval() will return a python string with the proper whitespacing. A chained function will be responsible to split() a string again to find the fields. There were just too many strange corner cases.
Whitespace is incredibly finicky in GNU Make. I have almost all of the string functions implemented but I keep running into strange whitespace problems.
Hello! Welcome! Someone noticed my silly little project.
My goal is a source level debugger for GNU Makefiles. (Nothing against other Make implementations but I have to start somewhere.) The plan is to have a text interface like gdb.
The project is very early. I can parse almost all of fully formed makefiles. I can output S-expressions, regenerate the makefile.
As of this writing, I am implementing the GNU make $() functions. I cannot yet execute rules so I'm not yet actually a fully functioning Make.
Read a makefile, dumps incredible amounts of debugging while parsing. Output of the makefile got to stdout
python -m pymake.pymake -f Makefile
Parse/execute functions.mk, rewrite the makefile from the parsed source to out.mk (very useful for seeing a cleaned makefile)
python -m pymake.pymake -o out.mk -f Makefile