There can be millions of songs without album art in someones computer, trust me it looks really messy.The photo on songs thumbnail help a lot for organisation and cooler view.
Best thing about this trick is it does not require any special/extra sotware to be downloaded.
Step 1: The Only Step
Goto images.google.com and search for "name of album album art" and save it in your pc.
Copy the album art image you want to add.(squre image preffered)
Open windows media player (Yeah the one that comes with your windows OS)
search for your song and locate it in library(see the image)
right click on the songs album art that maybe default or one you don't like and select 'paste album art'
Thats it! now you have new album art for your songs
TiffinyS made it!