You'd really need to look at the structure under a microscope, though you might just see enough with a hand lens. If you can see distinct grains with a cement holding them together, that suggests sedimentary, or lightly-metamorphosed sedimentary. If you can't, you're really none the wiser - because it could be sedimentary but with cement and grains made of similar stuff. Under a microscope, viewing a thin section of the rock, you'd be able to see the crystals (and identify them) and how they are arranged (with or without a cement, with or without minerals indicating alteration or metamorphosis, and microstructures such as twinning or cleavage).