There are metal devices available from piano supply houses which have
"ears" to prevent the flange pins from working loose, but the fact that
the pin keeps working its way out, means that the bushing is worn, or
loose, or the pin is too small.  The best way would be to put in a
slightly larger pin.

Do not put glue of any kind on the pin ends.

Bruce Clark