question

Okay so I'm pretty positive tri delt is not for me. They have such fun diverse girls but I can't see myself ending up there. The only thing is they keep asking me out to lunch and to come to their events but I don't want to keep going if I know I don't want to end up there. What's a nice way to tell them? or should I not tell them at all?