If I have small frame can I build it into a meidum or large frame?

I weigh 118 I'm 5'9 24 yrs old. I eat as much as anyone else and I do not do drugs, I have always been small. Just recently started working out, I was told that I am unable to look like...Matt Damon,etc or similar because they have bigger frames. Is this true?