I finally sat on a panel for the first time last year at Wastelands and found the experience nerve racking, but ultimately enjoyable.

I'd be willing to sit on more panels, but it ultimately boils down to two things: Time And Interest.

For example, I've been asked in the past by friends to sit on panels, and haven't been able to because of work.