Does connecting cost me anything?

No. An OpenRouter account is free to create and free models cost nothing to use. You are never asked for payment details. Adding 10 credits on OpenRouter is optional and raises your daily free-model allowance from 50 to 1,000 messages, permanently.