Do you mean configuring the jump itself through the
jump server or do you mean setting up the underlying operating system for the jump server? If the former, take a look at the manual page for ssh_config and look at the ProxyJump directive. If the latter, then the best thing you can do (besides running no other services) is set up the SSH server to use only keys or certificates for authentication and then turn off password authentication.
Jump server
