To A/B test your Skool DMs, pick one message that goes to a lot of people, change one thing about it, split new recipients evenly between the two versions, and compare reply rates after each version has gone to enough people to tell them apart. The most useful test in most communities is the first message after the welcome, because almost everyone gets it. What to test first Start with the message most members receive. In order of impact, test: 1. The opener. "Hey [name], quick question" versus "Welcome in, [name]." 2. Question versus statement. Ending with a question almost always gets more replies, but test what kind of question. 3. Length. Two lines versus six lines. 4. Link versus no link. A link can pull people into a lesson, or it can make the message feel like marketing. 5. Timing. Day 2 versus day 4 for the same message. Change one of these per test. If you change the opener and the length at once, you won't know which one did the work. Pick one metric Use reply rate within 48 hours. It's simple to count, and a reply in a DM means a real conversation started. If your follow-up includes a link to a lesson, you can also track whether they started that lesson, but keep reply rate as the main score. How many sends you need Be honest about your numbers. If 20 people join a month, a test will take months to show a real difference, and only a big gap will mean anything. Rough guide, not a law: • Under 50 sends per version: only trust large differences, like 10 replies versus 25 • 100 or more per version: you can start trusting smaller gaps • Small community: test bold changes, not single words Running it by hand No tool needed to start: • Members who join on odd days get version A, even days get version B • Keep a simple log: date, member, version, replied yes or no • Review after each version has gone to your target number A testing log template • Message: day 2 check-in • Version A: "How's your first couple of days going?" • Version B: "What's one thing you hoped to get from this community?"