This one liner version only works with small user pools or the first page of larger pools:
aws cognito-idp list-users --region us-east-1 --user-pool-id us-east-1_abcdefghi | jq ".Users[].Username" | xargs -L1 aws cognito-idp admin-user-global-sign-out --region us-east-1 --user-pool-id us-east-2_abcdefghi --username