My PICkit 2 Starter Kit arrived today. I'm surprised at how reasonable a cost it was, even compared to many of the built-it-yourself offerings out there. The integration with the Microchip MPLAB IDE sealed the deal for me.
It's a real pity Microchip don't produce a Linux version of MPLAB. Hopefully their acquisition of Hitech will encourage them to increase support for the Linux platform.