Feedback on AI Summarization: Favoring Data Over Insights
some feedback on the prompting for AI summarisation (either within Search or the Chat window): from the little iโve played around with either searching for data (using the AI search) or chatting with the data, iโve noticed that references seem to favour data (e.g. Interviews) rather than insights themselves. again, not sure how prevalent that is, but i would expect more references to insights, rather than data from our mental model: if one of the AI results links to 1-2 pieces of data (again, individual interviews, in most of our cases), that gives us much less confidence than if the AI results link to 1-2 insights (which tend to be based on multiple pieces of data). in the hierarchy of how we weigh confidence: data is the smallest unit and you need several piece of data to create an insight, and then you need several insights to have increased confidence in a wider pattern. tl;dr if weโre asking the AI to give us โbiggest pains for our customersโ and the AI only links to a handful of interviews, this is going to come across as mostly anecdotal evidence and wonโt give us much confidence in the results. ๐ง grain of salt: iโve played very little with the AI features, and this is a perspective limited to research done with interviews. if you use mostly surveys or other inputs, this might not be valid. โ my question is: in the prompting for these features, is there an emphasis on data, vs insights? or is this just a fluke?
