PocketSphinx is not a program, it is a speech recognition library written in C. It has language bindings for Python, which means you can use the library from Python programs too; to Python programs, the library looks like a normal Python library.
You don't really need to know C to use PocketSphinx, if you know Python. The
example program in the tutorial is written in C, but there is an example on how to use
PocketSphinx as a GStreamer component with the user interface written in Python.
I don't think you
have to use GStreamer to use PocketSphinx from Python programs, it just makes things easier. Without GStreamer, you'd probably have to use ALSA or some audio library to read the raw audio samples, and feed them to the library yourself. Nothing too complicated, but I'd still recommend checking out the PocketSphinx-GStreamer-Python stuff first.