Not normal. Take it in to have it checked out..
Pads are held in by the 2 small pins at the top and bottom of the caliper pad opening. The pins are held in by the spring clip ( Gold element in center of caliper ) and the bolt in bridge ( big bolt in center ) The spring clip puts slight pressuer on everything to keep it all tight and quiet.