A question about “attendee”

Why is that word, and not “attender”, used to refer to a person who attends an event? Usually, “-ee” is a passive suffix, referring to a person to whom an action is performed (e.g. appointee = someone who is appointed, nominee = someone who is nominated).