I've been meaning to blog about the stuff that really paid off during our first few weeks of parenthood. So here goes. Hopefully it will prove to be of use to future first-timers like us.
Vital: Swaddling blankets, regular and velcro.

Babies either love or hate swaddling. You'll know pretty quick. Ours is a lover. When she's fussy, nothing beats a tight swaddle. I think it's been the single biggest factor in Allison sleeping exceptionally well each night. (We usually have to wake her for the 2 a.m. feeding.)
There are tons of diagrams and videos out there to teach you swaddling, but I recommend asking the nurse or pediatrician once your newborn is actually out. Ask about "double swaddling" with two blankets. It can't be beat.
There are velcro swaddling blankets/sacks that are nice and highly recommended, but they'll never be as tight as a fine hand-rolled baby cigar. Remember, no swaddle is too tight, but it CAN be too loose (which poses a smother hazard).
Vital: Mylicon (but go dye-free and generic)

Try to find the generic version, and definitely get "dye-free." Otherwise, you'll be paying a lot and enjoying pink stains on everything you own.
Vital: Lots of pacifiers.
Just get a bunch. More than you think you'll need. Ditto for bottles, but we'll get to that.
Great: Diaper Champ
Simple design, and slightly less eco-disastrous than the Diaper Genie (which wraps each diaper in its own sack). As far as turd buckets go, I've been very happy with this one.
Great: Crib-side entertainment
Ours is a battery-powered jungle scene that lights up and plays music when you hit the button. (Amazon tells me it's called a "Fisher-Price Rainforest Peek-A-Boo Waterfall Soother." Vomit.)
It only runs for a few minutes, which is usually enough to knock the kid out. And I have to say, the music really doesn't bother me ... even after dozens of listens.
Great: A bassinet/cradle

That said, the kid doesn't really move around, so a laundry basket or dresser drawer (removed from the dresser, please) will do just fine.
Great: Dr. Brown's bottles (but hand-wash em)

Big caveat: Their clear bottles have been found to leach BPA, pleasantly described as "a hormone-disrupting chemical" that's been linked to premature puberty and cancer in lab animals. We had already bought ours when that study came out, so we're just careful about hand-washing the bottles themselves and using the dishwasher for the nipples and such.
There's supposedly a non-BPA model coming out, and there's also glass bottles if you don't mind the potential of your baby smashing it on the side of the crib and starting a bar brawl. (Karen has an awesome scar on her knee that has generally prevented us from seriously considering glass.)
Debatably great: Video monitor

I like that the monitor helps Karen relax, but I find it to be pretty pointless. Our house is very small, and I can hear Allison just fine from anywhere short of the backyard utility easement. Of course, if you have one of them fancy big houses with multiple floors and walls that actually inhibit sound, you'll probably want a video monitor.
Downside: You'll inevitably have nightmares about seeing zombies in the monitor. Or, if you click on the image above, you will now.
My favorite/most useful books: Happiest Baby on the Block, On Becoming BabyWise and Be Prepared: A Practical Handbook for New Dads.
We read quite a few books. You'll likely end up with most of the standards, but be sure to pick up the three I listed above. Happiest Baby teaches you how to calm a screaming kid. BabyWise teaches you a very successful sleep/eat schedule. Be Prepared is mostly just entertaining for dads, but it has some tremendously helpful advice (like the fact that it's OK to feel no emotional connection whatsoever when you're staring at your newborn).
Well, I hope all that helps someone out there. Maybe I'll do an update in a few months when I figure out what's worthwhile for toddlers. Oh, and of course you should all feel free to post your own findings and suggestions in the comments section.