Only one Horcrux is shown to have negative effects on those around it. This is evident from the following:
Tom Riddle's diary - The diary was an active piece of soul and it entrapped Ginny over the course of the year. It eventually possessed her. This can be explained as Voldemort's soul trying to gain control of Ginny's body so as to return to a physical form(which he attempted towards the end in the Chamber of Secrets.)
Salazar Slytherin's locket - The Locket had been active all the time the trio were carrying it. It caused petty spats between them, which eventually led to Ron leaving Harry & Hermione. We can see that the Locket was having effect on the person wearing it.
Marvolo Gaunt's ring - We do not see a lot of this artifact's effects, except Dumbledore's charred hand. This wasn't directly caused by the ring being a horcrux, but rather by the enchantments placed on it, as evidenced from the quote (emphasis mine) from Deathly Hallows :
“It is a miracle you managed to return here!” Snape sounded furious.
“That ring carried a curse of extraordinary power, to contain it is
all we can hopefor; I have trapped the curse in one hand for the time
being ...... [The Prince's Tale]”
From these observations we can draw some conclusions:
Not all horcruxes had a direct negative effect on the owner. There is no mention of any such effect caused by the Diadem of Rowena Ravenclaw or by Cup of Helga Hufflepuff.
The diary had been talking to Ginny. Hence Ginny wasn't affected by merely possessing the diary.(Rather she was affected by the Diary possessing her... Oh the irony).
There is no evidence that all the Horcruxes caused negativity on the people around it.