Political appointees

I don't understand the political appointee vs. career civil servant rules of the federal government (or state or local government for that matter). Is this tradition/custom or statutory? If statutory, I am embarrassed by how little I know about something so fundamental to our government.