Has anyone else noticed that magic insights tend to use the same quotes in multiple insights? Especially insights created from titles. It is almost like itĀ“s only takes data from one note, and not the rest. Any ideas on why or how to get it to take all the data into consideration? Edit: I just asked contextual chat, here is what it said "I see the issue now. I've focused primarily on one note when creating insights rather than drawing from the full range of information available across both substantive interview notes. This has created unbalanced insights that don't reflect the complete picture."
Hi Andrea, Thanks for reaching out and providing this feedback. I've followed up with our product team for more information. In the meantime, can you share a few more details so we can look into this for you? Can you share examples of the insights and the data it is referencing? We'll need the browser URLs associated with each as well as access to your workspace, which can be actioned using the steps below:
Absolutely, I have been testing how we can auto add highlights and tags, and then create magic insights bases on that. The auto highlights worked great, but when I went to create magic insights based on titles, it only looked at one of the two interviews in the project, so it only got half of the information. It also reused the same highlights and wrote almost the same thing across almost all the insights. This told me that it wasnĀ“t very thorough in the creation of magic insights, so I asked contextual chat why, and it confirmed that the insight seemed like it only looked at one note, and that it wasnĀ“t very thorough. I then tried getting chat to suggest insight titles that would dig deeper, but it seems like the same error occurred. Also, the insights are all almost the same length, which seems weird. The URL is here for the insights page (the bucket called Nanna is the one we made first, the other one is the ones chat suggested) https://grundfos-insights.dovetail.com/projects/4qrYiILW8ZlqyIGsZMC6ye/v/6FXnWg32eDLWC7CD8Zi9tV
Thanks, Andrea, can you help me understand your flow? Are you:
Suggesting highlights
Asking Contextual Chat to create an insight for you from within the note?
Or are you creating a magic insight from within insights? https://docs.dovetail.com/help/docs If you could list the steps youāre taking that will be helpful!
As a workaround, Iāve found it helpful to use the old search summarization system to generate project highlights. I filter for the project I want to get help synthesizing and run the search summary on that (if I thoroughly tagged, then I run it on just the highlights) - historically the output has been pretty helpful. (This may or may not have changed with search updates)
Hi Jazmin, A little of everything, I will describe the steps š
Setting highlight key moments as "on". We have a global tagboard that is the standard, so tags are pre-made.
Uploading interviews - Get all transcripts auto tagged
Go into the Insights tab to create magic insight. Use the "generate from title" option to get insights based on questions.
Use contextual char to ask for any themes or potential insights we may have missed.
Evaluate the insights created
Thanks, Andrea. The browser URL you provided takes me to all of your insights, and you have Contacts restricted, so I can't see the names of the board. So, I am unable to look at the one called "Nanna". Can you provide the following: 1. The browser URL for each individual insight you generated using "Magic insights" with the Title prompt 2. The browser URL for each individual insight you generated using Contextual Chat 3. The browser URL of the data that the insight is using to generate the insight
Can you also clarify where in the product you are using Contextual chat? Is it within the insight that was created via "Magic insights"?
1. The browser URL for each individual insight you generated using "Magic insights" with the Title prompt: https://grundfos-insights.dovetail.com/insights/68vMwz2Cbmhnn9XrMGe5DA https://grundfos-insights.dovetail.com/insights/Ce6VRWHCRK4WLvAjZxdCv https://grundfos-insights.dovetail.com/insights/3Ajiv2WzDX4Rd7moJFILB3 https://grundfos-insights.dovetail.com/insights/3kdoze51ZxBljC8EFu2cr https://grundfos-insights.dovetail.com/insights/2IVfmWj5joHlwJeH19DpEv https://grundfos-insights.dovetail.com/insights/QFI78IxuA57tdFC2kvbt1 https://grundfos-insights.dovetail.com/insights/NYydfkdvlecGuaIyHYYLr https://grundfos-insights.dovetail.com/insights/7y9xfIIGhHTFzZOvrsLadX https://grundfos-insights.dovetail.com/insights/7jj0OLfXe2UZGyOUinhlQ5 https://grundfos-insights.dovetail.com/insights/1M51pUGWOxFyrDb72h44lb 2. The browser URL for each individual insight you generated using Contextual Chat: https://grundfos-insights.dovetail.com/insights/7CmbjuP8x5H4G3IyZ1DOOk https://grundfos-insights.dovetail.com/insights/3oCs4L79D7VNWLVEDBLfVU https://grundfos-insights.dovetail.com/insights/1SWKPd0FzLs1bADxy3Buv2 https://grundfos-insights.dovetail.com/insights/39SvTuAlbni8ddoDZDOFCo https://grundfos-insights.dovetail.com/insights/1keNZGxjvBGhhkmMEQzU8M https://grundfos-insights.dovetail.com/insights/7K39d6MxVmfYTo4NUqYmou https://grundfos-insights.dovetail.com/insights/1Xh90v7SaxoKfJZm29Otai https://grundfos-insights.dovetail.com/insights/4mLWyF4xfzPy0seh87mSSb https://grundfos-insights.dovetail.com/insights/19kKRjmmouOUT1B5PSWGoZ https://grundfos-insights.dovetail.com/insights/21LDgbGiNy8h8C0eHCrEG0 https://grundfos-insights.dovetail.com/insights/58n9fn05QFWEMChwjmJyCW 3. The browser URL of the data that the insight is using to generate the insight: https://grundfos-insights.dovetail.com/data/5yFvS3GyMlqUWd9XyUubHn https://grundfos-insights.dovetail.com/data/3D3awrerDdHrF5OL7uLsDV
Thanks, Andrea. There are only two notes in your project (which are the ones you linked). Magic insights created from a project will only use the data within your project. So, I'm a bit confused. Are you expecting it to generate using references from other projects? Trying to gather as much context as I'm escalating this to our engineers š
If you can you also clarify where in the product you are using Contextual chat? Is it within the insight that was created via "Magic insights"?
Hi Jazmin, I am expecting it to use both notes, and not only one on them, which is what it is doing š Contextual chat was used within Insights to look for any duplication of quotes within the Insights created, and in the data tab to look for additional Insights that we may have missed with the Magic Insights š
Can you also clarify the type of questions youāre asking contextual chat when:
searching for duplication of quotes
Asking for additional insights that may have been missed
This is the one being used: https://grundfos-insights.dovetail.com/data/5yFvS3GyMlqUWd9XyUubHn And the questions used are:
What data have you used for this insight?
Why are all the insights so similar? there are more highlights than this.
Why have you only focused on one note, when creating the magic insights? What can I do differently to make it less one-sided?
Could you give me 5-7 distinct themes that I could put into insights based on the two notes?
Is the data now drawing from the full range of information available?
Looking at the new insights, are we now covering the full picture?
Amazing! I've provided all of this information to our team so they can dig into this further š
