Here I'm interested in a use case of subscribers keeping a permanent connection open (24/7), but with negligible amount of messages. So I'm only concerned about price per connection, not price per message.
https://aws.amazon.com/api-gateway/pricing/
$0.25 per million connection minutes
That's $1 per 4 million connection minutes.