Always up. If they have caps on them it saves space for more pens, if they don't the tip could become crushed against the bottom of the pot, therefor damaging the pen and causing a problem when using said pen.