James Buchanan actually said...

The amendment does not seem necessary to secure any right either of the United States or of any American citizen claiming under them.

I confess I hail this movement on the part of Virginia with great satisfaction.

However strong may be my desire to enter into such an agreement, I am convinced that I do not possess the power.

It is my duty at all times to defend and protect the public property within the seceding States so far as this may be practicable.