I would say so for most of the cases. Somebody can rebuild the binary with special linker flags that mesh up the memory.
Check the last section to see an example on how to relocate the text segment via linker flags. In that case you also need the Makefile, however I do not believe that happens very often.