First let me tell you a story of a Syrian Friend (I hope he and his Family are fine and doing well!) who came to Germany for his dissertation. In his first meeting with his supervisor he answered about each question or point of his discussed to do list by saying "I'll insha'Allah...".
His supervisor -who had some experience with Muslim postgraduates and students- said:" Muhammad! Don't say insha'Allah, but do it!"
Conclusion: Many non-Muslims with the time have got a bad experience with this statement. And Muslims are using it in different ways.
My practical suggestion or answer for your question would be: If it is something you don't intend to do and your conversation partner may ask you later or would be somehow offended, say insha'Allah "to yourself" and be honest, else you can and should say it loudly. Note that the story behind the verses teaches us to say insha'Allah in any case!
I'd like to add -explaining my former comment- that as Muslims we believe that anything which happens, happens with the will of Allah, so we don't know if we would do or accomplish something we intended or planed to do at the end of our given schedule or in our life. As you might not plan to do it, but Allah might lead you to it (read for example 76:28-31, 81:28-29). Imam al-Ghazaly in his Ihya' (Fourth Quarter: The Ways to Salvation, Book 36: On Love, Longing, Intimacy and Contentment. in the chapter explaining the virtues of Contentment) quoted a statement which might have an origin in the Torah as it seems to have been narrated from Ka'ab al-Ahbar () كعب الأحبار which goes as follows:
ويروى أن الله تعالى أوحى إلى دواد عليه السلام : يا داود إنك تريد وأريد، وإنما يكون ما أريد، فإن سلمت لما أريد كفيتك ما تريد، وإن لم تسلم لما أريد أتعبتك فيما تريد، ثم لا يكون إلا ما أريد
(My own translation take it with the necessary care)
It was narrated that Allah the Almighty has revealed to Dawod (peace be upon him): O Dawod you want and I want, but only what I want will be, so if you accept what I want I'll suffice you what you want, and If you don't accept what I want I'll burden you to excess in what you want, and afterwards only what I want will be!"