This post is mainly a note for myself, in case I need this again, but forgot (and I will, both).
To compile a module (e.g. fuse.ko) for a kernel of which you only have the headers (e.g. some linaro build for a Pandaboard), do the following:
make -C /l… more »