Not with the Walkman app. Although, as you say, Walkman is the default player for audio podcasts.
There appears to be a dedicated Podcast app for subscribing to and downloading podcasts but there doesn't seem to be any direct access to it. Instead it is accessed via the main menu of the Movies app!
