It has been discussed in scifi that there is no range limitation effective on the illusions the Talosians can force upon conscious beings and it was observed how easy therefore it would be to make a crew member accidentally destroy the ship (even if this required multiple crew members to accidentally collaborate in this - Talosians are very, very intelligent).
So what is the point of having any penalty associated with visiting Talos IV -- perhaps such visits occur often when the inhabitants have a desire to read minds "close up" if that is even a thing: the Talosians may have no need to have physical visits and there sole motivation in bringing the injured Pike to Talos IV was a combination of altruism that only a Talosian can carry out and perhaps their own interest in living through humans who want to participate in the illusion.
If the Talosian illusions are as powerful as indicated, the Federation would want to be on good terms with that species and even send other helpless cases to Talos.
