Yes - you are entitled to whatever balance you had in your account, barring you owing any fees or restitution upon your release.
https://www.inmateaid.com/ask-the-inmate/i-had-200-on-my-account-in-may-2015-upon-release-can-i-get-that#answer
Accepted Answer Date Created: April 01,2016