The numbering for the jets corresponds to the amount of fuel flow...a 175 main jet will flow more than a 165, for example. The previous owner may have used a slightly smaller than stock main jet when running at 25 or 30 degrees F. to maximize performance at those temps, but that could make the motor run too lean when it's 0 degrees, so it was good he mentioned it. Just make sure it has the stock 175 Main jets in it, and ride and enjoy.
It's doubtful that the previous owner changed the needle, but you should probably take a look. The stock needle was a 6DH4, which should be stamped in the side of the needle, and the stock clip position is the 2nd groove down from the top.
Whoops, gixxer just posted ahead of me....my '79 Invader manual shows the 2nd groove, but not much diff between 2nd or 3rd.