Yep, it's the house one. I also, back in junior high, read another short story by him that broke my heart even more. It was all about this little girl who lived on Venus, where the sun only shown once every 7 years. And she remember what the sun was like before she'd moved to Venus, and had waited four years to see it again. That story almost had me crying.
Re: