What are the tiny black bugs on my wall?

Today I opened my window and started to turn away when I noticed a bunch of little holes in my wall that I had not seen before. Just above these holes are about 10 extremely tiny black bugs. When I asked about them, it turns out the holes were MOST LIKELY there when we bought the house, about 2 yrs ago. So I took a magnifying glass and looked at one of the bugs. It was still small, but I noticed sort-of long antennae that stuck out sort-of in front of it and longish legs, 6 of them, the 3rd pair seemed to drag along behind them. I've been searching for a while and they haven't moved at all today. Anybody know what they are and if I should be worried (which I am) about them? Thank you! :)