rock climbing

my in-laws were in town the other day and wanted to go try one of those things and I turn them down because my workout was later that day. Do you think that I'm being ridiculous by picking weight training over my other Hobbies or is there a way to mix the two without it affecting your training...