James Buchanan actually said...
It is my duty at all times to defend and protect the public property within the seceding States so far as this may be practicable.
Context
Special Message
01/27/1861
Special Message
01/27/1861