Meaningful collaboration requires a serious investment of effort. In interactions with a colleague, there is a massive difference between:
"Your work is interesting enough to spend 15 minutes skimming materials and providing feedback, and another 15 minutes looking through your eventual publication for useful nuggets."
versus
"Your work is critical enough to the progress of my work to spend 100+ hours working together on a collaboration leading to a new publication."
From what you have reported so far, it sounds like this potential collaborator is more at the first level and not the second. Remember that most people doing significant research are approached quite frequently by potential collaborators, and simply cannot work with most of the people who might be interested to work with them (or who they might be interested to work with!).
I think that you need to stop and ask yourself not, "What would I gain from working with this person?" but "What would this person gain from working with me?"
Moreover, are you sure they wouldn't get nearly as much value just from reading and incorporating results from a publication you make on your own? If there isn't a clear and valuable answer to these questions, it might be that there won't be a collaboration at this time. You could even ask that question (politely) directly and with a concrete action attached, something like:
"Based on our discussion so far, do you think it makes sense for us to try to work together on a project at this time? If so, can we set up a time soon to talk about specific plans?"
This is a hard question to ask, because you might get a "no," but that "no" will be valuable because it will let you move on. Worse, you might also get a "yes" from somebody who has a hard time saying no, but then they don't actually invest in the collaboration, and you also need to be able to recognize that and move on.
Finally, it's important to realize that even if you don't get the collaboration that you hope for, lower levels of interest and interaction can also be quite valuable for your career: even if this person isn't collaborating with you, they may well be genuinely interested and read your work, cite you, pass your work to others, become a good contact in your professional network, etc.