OK, I've changed settings as requested:
Within Users --> Manage --> Options:
Allow User Registration: No
New User Account Activation: Self
Send Mail to Administrators: No
Captcha: None
I then set CB options as requested. The Connect Reset error is back.
I then selectively turned off each option (Admin Approval, Email Checker, Email Confirmation, etc.) and tried again. In every case, I'm still getting the Connection Reset error.
That means, so far, I'm only able to get this to work with the Joomla registration system on and the CB System Plugin disabled, and then only with either no approval or self approval. But, yes, we are definitely narrowing this down and that's encouraging.
Answer about other 3rd party extensions. At this time, no. It's a new install of Joomla 4.1 with Community Builder added as the first thing. I plan to add one or two other extensions that claim to integrate with CB natively, but I have yet to install them. I wanted to get this much working first.
Thanks, also for the additional links on the reverse proxy. I think I have read through them before. That's how I was able to get a valid configuration with HAProxy, including the xforwardfor and cookie based sticky sessions (for when I scale out additional Web servers). The information they contain is great though, and I'd highly recommend these for others configuring reverse proxies as well.