Milly Software
Insights›Engagement›Reading Your Store's Chat Conversations From Claude
Engagement··4 min read

Reading Your Store's Chat Conversations From Claude

The Milly Chat connector for Claude can list your store's conversations by period and rating and read any one of them, with email addresses and phone numbers masked. What you can ask, what's masked, and why there's deliberately no search box.

V
Viet Le
co-founder · Milly Software

The Milly Chat connector for Claude gives you the summary view: how the chat is doing, what shoppers ask, where it comes up empty. Summaries are where you start. Sooner or later you want the conversation itself: the one a shopper rated thumbs down, or the one behind a number that looks off.

Claude can find your conversations and read them, in your own Claude account. Here's what that covers, what is masked, and one thing it deliberately doesn't do. Reading conversations from Claude shipped on September 10, 2026.

Finding conversations

Ask Claude for your recent conversations and it lists them newest first. You can narrow the list two ways:

  • By period: the last week, the last 30 days (the default), up to a year, or a specific date range.
  • By rating: thumbs up, thumbs down, or unrated. Most conversations aren't rated, so "thumbs down this month" is usually a short, useful list.

Each conversation in the list comes with a short ID, the shopper's opening question, how many messages it ran to, its rating, and the page it started on. Claude returns up to 50 at a time.

Reading one

Point Claude at a conversation from the list and it reads the transcript turn by turn: who said what, when, and how many products were shown on each reply, plus the rating and the starting page. From there it's a conversation with Claude like any other. Ask what went wrong, whether the answer matches your policy, or what you'd change in your knowledge base.

Two details on accuracy. Very long transcripts are trimmed (past 40 turns, or past 2,000 characters in a single turn) and say so when they are, so Claude knows it isn't seeing the whole transcript. And a short ID that happens to match more than one conversation returns the candidates instead of a guess. Conversations that have expired under your plan's retention schedule aren't available here.

What's masked, and what isn't

Before a transcript leaves our side, text shaped like an email address or a phone number is replaced with a marker. Page addresses are cut down to the page itself, dropping the query string, which is where tracking tokens and pre-filled form values tend to sit. The transcript is then read in your own Claude account.

I'd rather be plain about the limit: this is pattern matching. It masks the two identifiers that have a recognisable shape. A name, an order number or a street address typed into a sentence isn't masked.

The connection is scoped to your store: asking for a conversation ID from another store returns the same "not found" as an ID that doesn't exist. Its conversation tools read; they don't change anything in your store.

The obvious feature to want here is "find the conversations that mention X". It's missing on purpose.

A text search has to run against the original messages, since the masked version can't match what was removed. Combine that with a count of matching conversations and you have a way to confirm masked details one guess at a time: how many conversations contain an address at a given email provider, then how many contain a particular first letter, and so on. Anything connected to your store could do that, and masking that can be undone by asking enough questions isn't much use.

For "have shoppers been asking about X?", ask Claude for your top questions or your knowledge gaps instead. Those aggregate what shoppers asked, which is usually the question you had.

Things to try

  • "Show me the conversations rated thumbs down in the last two weeks, and tell me what they have in common."
  • "Open the third one. Did the assistant get the return policy right?"
  • "Which pages did last month's unrated conversations start on?"

This shipped in v2.10.5. The Claude connector is available on our Enterprise plan. If you're connected, there's nothing to set up: just ask. If you'd like to get connected, reach out.

Frequently Asked Questions

Can Claude read my store's chat transcripts?

Yes, through the Milly Chat connector, in your own Claude account. Claude can list your recent conversations, filtered by time period and by the shopper's thumbs-up or thumbs-down rating, and then read any one of them turn by turn, with email addresses and phone numbers masked. The connection is scoped to your store.

Does Claude see shoppers' email addresses and phone numbers?

They're masked by pattern matching before the transcript leaves our side: text shaped like an email address or a phone number is replaced with a marker, and page addresses lose their query string. Pattern matching has limits: a name or a street address typed into a sentence is not recognised and is not masked.

Why can't I search transcripts for a word from Claude?

Deliberately. A free-text search runs against the original messages, and a count of matches could be used to confirm masked details a character at a time. For questions like 'have shoppers asked about X?', the connector's top-questions and knowledge-gap answers aggregate what shoppers asked instead of returning individual messages.

Try Milly Chat

Want to see how this fits your store?
We'll set up a working session.

Get it on Shopify →Talk to sales →