In most instances yes, inmates may receive a pen and paper, but they are best served with a little money in their commissary account to buy stamps and envelopes to mail off what they've written.
https://www.inmateaid.com/ask-the-inmate/does-the-inmate-receive-paper-and-a-pen-to-write-back-or-would-he-have-to-buy-it#answer
Accepted Answer Date Created: January 25,2014