Connect as in play games with them? I don't think so. Chat I think will work the same. All your friends will still appear in your friends list.
Did this solve your problem?
Sorry this didn't help.
Great! Thanks for marking this as the answer.
How satisfied are you with this reply?
Thanks for your feedback, it helps us improve the site.
How satisfied are you with this response?
Thanks for your feedback.
You can not party chat with 360 users. You can send them text messages, but not voice messages. You also can not open voice messages received from a 360 user on the Xbox One.