Skip to content

How to test a sequence

Test the sequence in the Test AI Agent panel

Section titled “Test the sequence in the Test AI Agent panel”

The panel runs the same matching and writes the same sequence replies as a real DM, but it sends nothing to Instagram.

Read the lightning label, not the reply. The panel answers every message, and Instagram does not. A reply with the label is a reply that Instagram would send. A reply without the label means that no sequence matched, and on Instagram the person would get nothing.

  1. Click Test AI Agent at the bottom right. A panel named Sandbox opens.
  2. Click the circular arrows at the top left of the panel. This clears the test conversation. Do this before every test. Without it, your next message continues the earlier test.
  3. Type a message as a person would write it, and press Enter.

The panel calls you Example User and calls the Agent Persona. When a reply belongs to a sequence, a lightning icon and Sequence: with the sequence name appear above it.

We sent five messages to the example. A second sequence, “Free guide request”, was also switched on. It sends a link when a person asks for a guide.

#Test messageWhat the Agent didWhat this shows
1hey where are you rn?Started Airport check. The reply began with the fixed line.The scenario matched without a keyword.
2oh nice, how long is your layover?Stayed in Airport check. The fixed line did not repeat.One action can last for several messages.
3btw can i get that comment guide?Stayed in Airport check and returned to the travel question.A running sequence keeps the conversation. “Free guide request” did not start.
4i don’t like planesSent nothing. The panel shows “Persona chose not to respond.”The Until part ended the sequence.
5can you send me the comment guide? i want more replies on my postsStarted Free guide request and sent the link.After one sequence ends, another can start.

The Sandbox panel after the first three test messages. Each reply has a lightning icon and the label Sequence: Airport check

Messages 1 to 3. All three replies belong to Airport check.

The Sandbox panel after messages 4 and 5. Message 4 has the answer Persona chose not to respond. The reply to message 5 has the label Sequence: Free guide request

Messages 4 and 5. The stop trigger ends the first sequence, and the second sequence starts.

The wording of each reply changes from test to test. Check what the Agent does, not the exact words.

How to read the panel:

  • The sequence label appears on every reply that belongs to the sequence. It does not mean that the sequence started again.
  • The panel does not show when a sequence ends. A reply without a sequence label means that no sequence is running, and Instagram would send nothing.
  • The panel cannot test Follow up or comment triggers.
  • Tests do not appear on the Messages page or in the sequence totals.

A first draft often does part of what you want. Change one thing, clear the panel, and test again.

Our first draft of the Then instructions ended after “You’re currently texting from an airport.” With that draft, the sequence ended after one reply. The second reply has no sequence label:

The Sandbox panel with the first draft. The first reply has the label Sequence: Airport check. The second reply has no label

First draft. The second reply does not belong to the sequence. On Instagram, the person would get no second reply.

We added two sentences: “Keep chatting with them about travel. This step is complete only once they tell you where they would fly to next.” The sequence now continues:

The Sandbox panel with the revised instructions. Both replies have the label Sequence: Airport check

Revised instructions. Both replies belong to the sequence.

Four techniques that worked in our tests:

  1. Put fixed text first and in quotation marks. The Agent then sends it once, at the start.
  2. Describe what the person wants, not the words that they use. A scenario such as “asks for your general location” also matches “where are you rn?”.
  3. Say when the action is complete. Without this, the Agent decides for itself, and it can end the sequence after one reply.
  4. Keep the scenarios of different sequences clearly apart. See the next section.

This check needs a second Instagram account. A sequence does not reply to messages that you send from the connected account itself.

  1. From the second account, send a DM to your connected account. Write a message that fits your scenario.
  2. Read the reply.
  3. Send a message that ends the sequence, so that the conversation is not left inside it. The example sends “i don’t like planes”.

An Instagram DM seen from the second account. The message hey where are you rn? is answered with a reply that begins The automatic DMs are working

The example on Instagram, as the other person sees it.

In the left menu, click Messages and open the conversation. A lightning icon marks the point where a sequence started, with the sequence name and a View run link. Each reply shows the sequence and the action that it belongs to, and the word Automated.

The Messages page with one conversation open. A label with a lightning icon says Airport check triggered. The reply below it is marked Airport check, Step 1: Airport chat, and Automated

A conversation on the Messages page.

The line under the label says “Commented”, also when the message was a DM.

On the Sequences page, click the arrow icon on the line of the sequence. The page shows how often the sequence started (Triggered), how often the Agent replied (Responded), and a Trigger Log with one line for each start.

The analytics page for Airport check. It shows Triggered 1, Responded 1, and a Trigger Log with one entry

The totals for the example after one real DM.

WordMeaning
AgentThe part of Sociable AI that writes and sends replies for one brand. You choose it at the top of the page. The screen also calls it “AI Agent”, “AI” and “Persona”.
SequenceA set of instructions for one kind of conversation. It has the parts When, Then, Follow up and Until.
TriggerThe description in the When part. A conversation that fits it starts the sequence.
ScenarioA trigger rule that describes what the person wants, in a sentence.
ActionOne entry in the Then part. It can last for several messages.
Stop triggerThe description in the Until part. A message that fits it ends the sequence.
PersonWhoever sends the DM or writes the comment. They do not have to follow your account. The screen sometimes says “follower” or “user”.
DMDirect message. A private message on Instagram or Facebook.
Brand VoiceThe setting that tells the Agent how to write in every conversation.
Connected accountA social media account that you linked to Sociable AI under Settings, then Integrations.

In Sociable AI, click Get help fast at the top right. You can also email contact@sociable.how.

Include these three details:

  1. The name of the sequence.
  2. The test message that you sent, and where you sent it: the Test AI Agent panel or Instagram.
  3. What the Agent did, and what you expected.

If a part of this guide is unclear, send the heading of that part to the same address.