Yes, the relationship needs baby-proofing too