No entiendo esta frase.
"les acabas pillando cariño" - you get to like them, become fond of them.
"cariño" is the key word here. Just remember to look at the bigger picture, as it were :)
Google translates the sentence as "you just catching them affection", which would have given you the gist of it.