I used to do quite a bit of segmenting in pens years ago, to speed up the progress it’s handy to be able to use CA glue otherwise the glue ups take ages.
The problem I found with thicker metals was even drilling slowly enough heat was generated to cause the glue to fail. I did have limited success using epoxy resin but again it tends to go soft when heat is generated.
I also found blanks made with thicker metals had a greater frequency to come apart when being turned.
By far the most successful were the ones I made from aluminium drinks cans the thin metal turns easily & very little heat is produced when drilling, I used to laminate the ally with black plastic to give greater effect like the one below.

- (114.97 KiB)
If possible I’d definitely suggest you find the thinnest brass you can, I only used to sand the surfaces of ally & plastic & they glued up fine, the laminations were glued with epoxy into a sheet which was then cut & glued to the blank with CA.
HTH