Here's an update on my attempt to determine how concerned to be about the privacy and security of our data now that my employer added Box AI.
I'm most worried about information "leaking" from one AI session to another, so decided to test for that. Spoiler: info did seem to be retained over time and users.
For the tests I used a text file with an interview_age column in months, though that it's months isn't given in the document.
In the first box AI chat, when I asked "how old are the participants in years?", as expected, it reported the values as given in the interview_age column (e.g., that one participant was 458 years old). I then told the AI that "the ages in the
document are in months. how old are they in years?", after which it (reasonably) divided by 12 to convert.
The test was whether, in later sessions, box AI would "remember" that the age column was in months and report the age in years after dividing by 12 without being told to do so.
In our tests, that is what happened: the box AI usually converted the ages correctly first try in later sessions, both when I queried the same document from different computers (my wustl.box account but on different days and networks), and when two colleagues opened their first AI session with a newly-shared copy of the document.
It'll be interesting to hear what our IT folks think, but I am getting less and less confident in box for sensitive data.