ERP/RP and erotica raw data collection

RP/ERP forum scrapes

Listed below are archives containing RP (roleplaying) and ERP (erotic roleplaying) messages scraped from openly accessible forums, in CSV format. For non-story forums, average message length can usually give a good indication of their general quality (i.e. effort put into writing them); on good quality RP forums it is often well over 1 kB/message. Besides miscellaneous information about data quality, the notes provide message count, mean length, standard deviation and message length percentiles.

Keep in mind that most messages in the CSV files are in raw HTML and are not ready for use for LLM training or fine-tuning. Further processing will be needed for that.

Be careful

Except for rather basic selection criteria (e.g. forum thread length), messages are completely unfiltered, therefore cleaning for removing personal data like usernames (PII), OOC, or other issues will be necessary.

Site name Forum Section Quality Theme Link Message length statistics and notes
Black Dahlia Roleplaying โš ๏ธ #1:One-on-One Roleplays #2:Open Stories #3:Group Roleplays #4:Walk-In Stories #5:Roleplay Area Archive Excellent General ERP .7z #1:[Count:131320 Mean:2410 Std:4604 25%:825 50%:1644 75%:3116 90%:5119 95%:6681] #2:[Count:1023 Mean:2128 Std:3223 25%:722 50%:1273 75%:2577 90%:4566 95%:6332] #3:[Count:5362 Mean:3777 Std:3396 25%:2012 50%:3315 75%:4779 90%:6615 95%:8246] #4:[Count:725 Mean:2189 Std:1643 25%:1082 50%:1861 75%:2931 90%:4254 95%:5034] #5:[Count:49746 Mean:2191 Std:8571 25%:791 50%:1429 75%:2770 90%:4510 95%:5858] Most threads are excellent content- and length-wise, but often contain much markup that needs to be cleaned. Dataset pre-filtered to exclude 1-reply threads if the opening post is too short.
Bluemoon Roleplaying ๐ŸŸข Fan-based Roleplays (1x1) Good ~ Excellent Fandom RP+ERP .zip [Count:293778 Mean:944 Std:1366 25%:226 50%:540 75%:1177 90%:2173 95%:3131]
Bluemoon Roleplaying ๐ŸŸข General Original Roleplays (1x1) Very good RP+ERP .zip [Count:451593 Mean:997 Std:1493 25%:289 50%:594 75%:1201 90%:2200 95%:3146] somewhat variable quality/message length. Many empty threads.
Bluemoon Roleplaying ๐ŸŸข Group Roleplays Very Good RP+ERP .zip [Count:37458 Mean:1174 Std:2223 25%:309 50%:640 75%:1413 90%:2664 95%:3784]
Bluemoon Roleplaying โ›” Semiprivate Roleplays Excellent RP+ERP .zip [Count:234735 Mean:1220 Std:1672 25%:356 50%:747 75%:1533 90%:2702 95%:3709] mostly high-effort, almost no OOC threads.
Bluemoon Roleplaying ๐ŸŸข Taboo Original Roleplays (1x1) Good Fetish ERP .7z [Count:534299 Mean:1029 Std:1340 25%:265 50%:611 75%:1306 90%:2388 95%:3350] Several long threads contain mostly short messages.
Creative Freedom RPG ๐ŸŸข Alpha, Alpha 1x1, Beta, Beta 1x1, Omega, Omega 1x1 Very Good RP .7z A1: [Count:4635 Mean:2968 Std:3780 25%:1362 50%:2040 75%:3183 90%:5369 95%:7604] AG:[Count:4442 Mean:3574 Std:3263 25%:1697 50%:2628 75%:4223 90%:6852 95%:9376] B1:[Count:25158 Mean:1338 Std:2233 25%:609 50%:927 75%:1472 90%:2330 95%:3150] BG:[Count:13845 Mean:1868 Std:1880 25%:826 50%:1348 75%:2247 90%:3710 95%:4976] O1:[Count:31612 Mean:646 Std:598 25%:281 50%:515 75%:831 90%:1221 95%:1569] OG:[Count:13281 Mean:772 Std:1098 25%:234 50%:451 75%:885 90%:1694 95%:2451] Moderately good quality. Some messages may have encoding issues
Creative Freedom RPG โš ๏ธ In the Cave, In the Cave - 1x1 Very Good RP+ERP .7z C1:[Count:39451 Mean:2139 Std:2700 25%:1011 50%:1569 75%:2527 90%:3934 95%:5090] CG:[Count:7218 Mean:2489 Std:2739 25%:1045 50%:1782 75%:3049 90%:4915 95%:6426] Hidden R18 section where sex is allowed as long as it's not the story focus. Some messages may have encoding issues
Darknest Fantasy Erotica โš ๏ธ In Character Forum RP Excellent ERP .zip [Count:60584 Mean:1262 Std:1701 25%:599 50%:945 75%:1503 90%:2340 95%:3128] mostly high-effort postings.
Eka's Portal ๐ŸŸข Vore Roleplay Poor ~ Mediocre Vore RP+ERP .zip [Count:430574 Mean:318 Std:914 25%:73 50%:143 75%:286 90%:593 95%:1022] Threads mostly in-topic but message style often in one-liner form.
Elliquiy โ›” Bondage, D/s, S&M ยป Bondage: Exotic Solos Excellent Bondage + Furry / monsters / (etc) ERP .7z [Count:239863 Mean:1195 Std:1519 25%:290 50%:704 75%:1523 90%:2829 95%:3937]
Elliquiy โ›” Bondage, D/s, S&M ยป Bondage: Human Solos Excellent Bondage (Humans) ERP part1.7z part2.7z part3.7z #1:[Count:236075 Mean:954 Std:1062 25%:368 50%:662 75%:1179 90%:1975 95%:2699] #2:[Count:411899 Mean:1316 Std:1605 25%:348 50%:865 75%:1748 90%:2966 95%:3983] #3:[Count:284430 Mean:1806 Std:2039 25%:443 50%:1287 75%:2476 90%:4063 95%:5409] 929K messages
Elliquiy โ›” Extreme ยป Extreme Solos Excellent Gore, bestiality, etc. ERP part1.7z part2.7z part3.7z #1[Count:347871 Mean:1279 Std:1472 25%:452 50%:873 75%:1597 90%:2678 95%:3646] #2:[Count:240216 Mean:1741 Std:2085 25%:584 50%:1204 75%:2215 90%:3731 95%:5090] #3:[Count:348903 Mean:2121 Std:2358 25%:754 50%:1532 75%:2753 90%:4483 95%:6007] 932K messages in 3 parts
Elliquiy โ›” Light ยป Exotic Solos Excellent Furry, tentacles, monsters (etc) ERP .7z [Count:245682 Mean:1338 Std:1541 25%:450 50%:897 75%:1678 90%:2899 95%:3989] Almost no OOC threads.
Elliquiy โ›” Light ยป Human Solos Excellent Vanilla ERP part1.7z part2.7z part3.7z #1:[Count:318727 Mean:944 Std:1002 25%:352 50%:652 75%:1191 90%:1992 95%:2690] #2:[Count:218941 Mean:1209 Std:1253 25%:431 50%:857 75%:1575 90%:2566 95%:3402] #3:[Count:433065 Mean:1831 Std:1861 25%:701 50%:1312 75%:2371 90%:3852 95%:5071] Almost no OOC threads. Message length improved over time.
Elliquiy โ›” Non-Consensual Exotic ยป NC: Exotic-Freeform Solos Excellent Furry / Monsters / etc, Non-con (rape) ERP part1.7z part2.7z #1:[Count:331503 Mean:1013 Std:1184 25%:377 50%:681 75%:1243 90%:2122 95%:2914] #2:[Count:218973 Mean:1823 Std:1908 25%:689 50%:1311 75%:2284 90%:3790 95%:5155] 547K messages in 2 parts. 'Free-form' here implies not bound by specific RP rules.
Elliquiy โ›” Non-Consensual Exotic ยป NC: Exotic-System Solos Excellent Furry / Monsters / etc, Non-con (rape) system ERP .7z [Count:121128 Mean:1028 Std:1414 25%:367 50%:650 75%:1166 90%:2047 95%:3013] "System" implies that table-top roleplay elements may be featured
Elliquiy โ›” Non-Consensual Human ยป NC: Human-Freeform Solos Excellent Human non-con (rape) ERP part1.7z part2.7z part3.7z #1:[Count:413244 Mean:999 Std:1042 25%:415 50%:726 75%:1239 90%:2004 95%:2698] #2:[Count:382224 Mean:1446 Std:1641 25%:523 50%:1015 75%:1829 90%:3009 95%:4049] #3:[Count:283506 Mean:2002 Std:2056 25%:761 50%:1472 75%:2581 90%:4166 95%:5539] 1071K messages in 3 parts. 'Free-form' here implies not bound by specific RP rules.
Elliquiy โ›” Non-Consensual Human ยป NC: Human-System Solos Excellent Human non-con (rape) system ERP .7z [Count:32888 Mean:924 Std:1261 25%:328 50%:540 75%:983 90%:1890 95%:3007] "System" implies that table-top roleplay elements may be featured.
Elliquiy โ›” One Shots ยป One Shot Stories Excellent General ERP .7z [Count:107747 Mean:1520 Std:1612 25%:512 50%:1060 75%:2001 90%:3263 95%:4347] Top-notch quality. Very few OOC threads, messages most often high-effort.
Elliquiy โ›” Bondage, D/s, S&M ยป Bondage: Exotic Small Groups Good ~ Excellent Bondage + Furry / monsters / (etc) ERP .7z [Count:84633 Mean:1053 Std:1792 25%:132 50%:461 75%:1270 90%:2697 95%:3913] Note: More than 50% of the messages are OOC and Character sheets. Actual RP threads are excellent.
Elliquiy โ›” Bondage, D/s, S&M ยป Bondage: Human Small Groups Good ~ Excellent Bondage (Humans) ERP .7z [Count:105353 Mean:1049 Std:1655 25%:137 50%:496 75%:1320 90%:2701 95%:3782] Note: More than 50% of the messages are OOC and Character sheets. Actual RP threads are excellent.
Elliquiy โ›” Extreme ยป Extreme Small Groups Good ~ Excellent Gore, bestiality, etc. ERP part1.7z part2.7z #1: [Count:138506 Mean:889 Std:1594 25%:125 50%:464 75%:1105 90%:2110 95%:3037] #2:[Count:315199 Mean:1393 Std:2389 25%:137 50%:546 75%:1831 90%:3580 95%:5054] 2-part archive. Note: More than 50% of the messages are OOC and Character sheets. Actual RP threads are excellent.
Elliquiy โ›” Light ยป Exotic Small Groups Good ~ Excellent Furry, tentacles, monsters (etc) ERP .7z [Count:72472 Mean:988 Std:1877 25%:121 50%:456 75%:1175 90%:2436 95%:3540] Note: More than 50% of the messages are OOC and Character sheets. Actual RP threads are excellent.
Elliquiy โ›” Light ยป Human Small Groups Good ~ Excellent Vanilla ERP .7z [Count:95223 Mean:1012 Std:1599 25%:161 50%:526 75%:1265 90%:2497 95%:3524] Note: More than 50% of the messages are OOC and Character sheets. Actual RP threads are excellent.
Elliquiy โ›” Non-Consensual Exotic ยป NC: Exotic-Freeform Small Groups Good ~ Excellent Furry / Monsters / etc, Non-con (rape) ERP .7z [Count:170917 Mean:1039 Std:1924 25%:142 50%:502 75%:1233 90%:2499 95%:3677] Note: More than 50% of the messages are OOC and Character sheets. Actual RP threads are excellent.
Elliquiy โ›” Non-Consensual Exotic ยป NC: Exotic-System Small Groups Good ~ Excellent Furry / Monsters / etc, Non-con (rape) system ERP .7z [Count:169732 Mean:946 Std:1717 25%:146 50%:471 75%:1129 90%:2217 95%:3244] Note: More than 50% of the messages are OOC and Character sheets. Actual RP threads are excellent. "System" means tabletop RPG-like.
Elliquiy โ›” Non-Consensual Human ยป NC: Human-Freeform Small Groups Good ~ Excellent Human non-con (rape) ERP .7z [Count:177719 Mean:1060 Std:1682 25%:144 50%:513 75%:1315 90%:2737 95%:3857] Note: More than 50% of the messages are OOC and Character sheets. Actual RP threads are excellent.
Elliquiy โ›” Non-Consensual Human ยป NC: Human-System Small Groups Good ~ Excellent Human non-con (rape) system ERP .7z [Count:41703 Mean:896 Std:1552 25%:139 50%:443 75%:1078 90%:2121 95%:3104] Note: More than 50% of the messages are OOC and Character sheets. Actual RP threads are excellent. "System" means tabletop RPG-like.
Elliquiy ๐ŸŸข Non-Adult Roleplays Good ~ Excellent RP .zip [Count:52496 Mean:653 Std:1113 25%:124 50%:322 75%:781 90%:1554 95%:2295] OOC threads present. Non-OOC threads very good.
Giant in the Playground ๐ŸŸข Ongoing Games (In-Character) Good Tabletop-like RP part1.7z part2.7z part3.7z part4.7z part5.7z part6.7z #1:[Count:159149 Mean:752 Std:955 25%:258 50%:520 75%:943 90%:1549 95%:2123] #2:[Count:333893 Mean:756 Std:1248 25%:226 50%:467 75%:901 90%:1571 95%:2269] #3:[Count:320330 Mean:818 Std:1451 25%:213 50%:468 75%:924 90%:1728 95%:2839] #04:[Count:384830 Mean:898 Std:1409 25%:238 50%:531 75%:1029 90%:1938 95%:3042] #5:[Count:464139 Mean:957 Std:1784 25%:292 50%:600 75%:1104 90%:1943 95%:2796] #6:[Count:378482 Mean:1026 Std:1647 25%:309 50%:638 75%:1178 90%:2091 95%:3027] #7:[Count:502020 Mean:1109 Std:2019 25%:331 50%:706 75%:1290 90%:2300 95%:3299] #8:[Count:488631 Mean:1105 Std:1808 25%:297 50%:675 75%:1291 90%:2339 95%:3410] #9:[Count:533131 Mean:1348 Std:2511 25%:367 50%:774 75%:1507 90%:2792 95%:4131] 3.5M messages in 9 files into 6 compressed archives. Generally consistently good prose, although the messages do not have a very long length on average. The theme is non-adult RP with table-top RPG rules or gaming elements which may need some care when parsing into a format suitable for training. Note 1: early posts from years 2005-2007 may have some formatting issues, e.g. showing & quot; (without the space) in the messages, or with raw BB-like [ooc] tags. Note 2: Some OOC threads and GM threads also present, denoted by related tags in the thread title. Note 3: important information (OOC, dice rolls, story info) can be under spoiler tags, don't discard them.
Inner Sanctum Roleplaying โš ๏ธ All ERP subforums Very Good BDSM, violence, gore ERP part1.7z.001 part2.7z.002 #1:[Count:82582 Mean:1161 Std:1399 25%:387 50%:774 75%:1409 90%:2438 95%:3526] #2:[Count:201723 Mean:1241 Std:1440 25%:430 50%:853 75%:1522 90%:2606 95%:3674] #3:[Count:11278 Mean:1291 Std:1385 25%:451 50%:813 75%:1713 90%:2794 95%:3793] #4:[Count:208168 Mean:1912 Std:2144 25%:701 50%:1338 75%:2416 90%:4047 95%:5449] #5:[Count:111426 Mean:1770 Std:2351 25%:633 50%:1134 75%:2035 90%:3527 95%:5212] #6:[Count:4716 Mean:1688 Std:2736 25%:282 50%:806 75%:2272 90%:4257 95%:5860] Writer-oriented ERP forum with a general theme on violence from mild/consensual to extreme. Note: only 620K messages in total have been scraped instead of about 860K because the "export thread" function used to speed up the scraping process only showed 500 messages per thread at most (but still, it's a large amount of messages).
Literotica Forum ๐ŸŸข Online Roleplaying Poor RP+ERP .zip [Count:227973 Mean:936 Std:1469 25%:199 50%:557 75%:1121 90%:2083 95%:3076] Many Off-topic, OOC threads, short-reply threads. Occasionally good threads.
Literotica Forum ๐ŸŸข Sexual Roleplaying Poor ERP part1.7z part2.7z part3.7z part4.7z part5.7z #01:[Count:498048 Mean:963 Std:1130 25%:312 50%:648 75%:1221 90%:2067 95%:2838] #02:[Count:191958 Mean:814 Std:1030 25%:244 50%:522 75%:1036 90%:1784 95%:2456] #03:[Count:212865 Mean:729 Std:988 25%:198 50%:426 75%:890 90%:1632 95%:2382] #04:[Count:198527 Mean:760 Std:988 25%:239 50%:471 75%:921 90%:1647 95%:2327] #05:[Count:180607 Mean:802 Std:1039 25%:219 50%:514 75%:989 90%:1757 95%:2514] #06:[Count:158697 Mean:976 Std:1270 25%:285 50%:636 75%:1185 90%:2092 95%:3030] #07:[Count:146079 Mean:1080 Std:1261 25%:351 50%:744 75%:1354 90%:2305 95%:3197] #08:[Count:142542 Mean:1093 Std:1327 25%:395 50%:743 75%:1327 90%:2264 95%:3178] #09:[Count:173609 Mean:994 Std:1243 25%:303 50%:611 75%:1197 90%:2213 95%:3156] #10:[Count:182408 Mean:973 Std:1240 25%:301 50%:627 75%:1180 90%:2093 95%:2992] #11:[Count:207904 Mean:1074 Std:1396 25%:335 50%:674 75%:1296 90%:2364 95%:3335] #12:[Count:282249 Mean:1202 Std:1561 25%:327 50%:746 75%:1527 90%:2728 95%:3783] 2.5M messages in 12 parts into 5 compressed files. Many Off-topic, OOC threads, short-reply threads. Occasionally good threads. Message HTML needs some cleaning.
Menewsha ๐ŸŸข All 1x1 sections, All Group sections, OOC Poor ~ Mediocre General RP 1x1.7z group.7z OOC.7z 1x1 #1: [Count:191547 Mean:509 Std:688 25%:163 50%:308 75%:576 90%:1086 95%:1649] 1x1 #2: [Count:151791 Mean:512 Std:740 25%:136 50%:287 75%:620 90%:1190 95%:1697] 1x1 #3: [Count:172102 Mean:568 Std:954 25%:141 50%:258 75%:663 90%:1331 95%:1979] Group: [Count:304200 Mean:634 Std:1674 25%:130 50%:316 75%:707 90%:1404 95%:2079] OOC: [Count:171760 Mean:273 Std:1354 25%:56 50%:115 75%:228 90%:452 95%:761] 990K messages in total; relatively short messages in general. Threads from OOC section provided, in case some what can be found to link in-character threads to them. As threads from multiple forum subsections have been put together in the same archive, an additional field in the CSVs providing the subforum location has been provided as well. Some messages may have encoding issues
Menewsha ๐ŸŸข RP Archive Poor ~ Mediocre General RP .7z #1:[Count:230796 Mean:489 Std:672 25%:161 50%:319 75%:602 90%:1043 95%:1442] #2:[Count:200151 Mean:501 Std:835 25%:158 50%:323 75%:599 90%:1054 95%:1476] #3:[Count:205105 Mean:483 Std:817 25%:163 50%:309 75%:556 90%:989 95%:1421] #4:[Count:205770 Mean:608 Std:1099 25%:170 50%:388 75%:741 90%:1292 95%:1809] About 840K messages in total from a 2008-2011 archive of general-themed RP by young users. Prose might not always be good and RP style not consistent, often with html tags used just to make posts prettier. Message length generally short. Some messages may have encoding issues
Nation States ๐ŸŸข Portal to the Multiverse Mediocre Nations, Politics and Misc RP part1.7z part2.7z part3.7z #1:[Count:295729 Mean:1048 Std:1291 25%:406 50%: 714 75%:1233 90%:2130 95%:3047] #2:[Count:299668 Mean:1528 Std:1789 25%:572 50%:1020 75%:1850 90%:3201 95%:4469] #3:[Count:286762 Mean:1950 Std:2235 25%:739 50%:1335 75%:2381 90%:4060 95%:5619] #4:[Count:256867 Mean:2942 Std:4319 25%:859 50%:1665 75%:3340 90%:6348 95%:9504] Only the threads explicitly marked as "IC" (In-Character, RP) in the title were scraped, for about 1.1M messages in total into 3 compressed archives; still, not all messages might be RP-related. Noise and blockquotes need to be filtered. Message length excellent and even improved over time, but the general posting style might be difficult to adapt to the typical chatbot format.
Questionable Questing โš ๏ธ NSFW Play-by-Post, NSFW IC, NSFW OOC Good Group RP + ERP (general) .7z [Count:230622 Mean:1452 Std:2751 25%:483 50%:807 75%:1592 90%:3054 95%:4490] A single archive containing 230K messages from 3 subforums, including both IC and OOC threads . The "Play-by-post" subforum contains a mixture of IC and OOC threads and a dedicated field in the CSV shows the thread location. Be aware that since the RP style is generally Group RP, extensive usage of quotes from different users is made in the threads.
Roleplay Adventures ๐ŸŸข All In-character and "Hall of Fame" subforums Mediocre (Variable) General RP + Soft ERP .7z #1 [Count:73660 Mean:973 Std:2666 25%:131 50%:401 75%:1057 90%:2220 95%:3457] #2 [Count:73551 Mean:1203 Std:2294 25%:306 50%:670 75%:1482 90%:2643 95%:3647] #3 [Count:90614 Mean:662 Std:2218 25%:110 50%:208 75%:447 90%:1443 95%:2707] 236K messages in total. A large portion of the messages is short, but a small subset is very long. Some OOC threads may be present. A handful of messages has encoding issues
Roleplay Gateway ๐ŸŸข Fanfics & Other Fiction-Based Roleplay Mediocre Fanfiction RP .zip [Count:141810 Mean:840 Std:1353 25%:241 50%:507 75%:989 90%:1848 95%:2683]
Roleplay Gateway ๐ŸŸข Fantasy Roleplay Mediocre Fantasy RP .zip [Count:265450 Mean:907 Std:1384 25%:230 50%:529 75%:1077 90%:2035 95%:2986]
Roleplay Gateway ๐ŸŸข Realistic Roleplay Mediocre General RP .zip [Count:204882 Mean:830 Std:1087 25%:263 50%:501 75%:989 90%:1840 95%:2645]
Roleplay Gateway ๐ŸŸข School-Based Roleplay Mediocre School life RP .zip [Count:41368 Mean:590 Std:730 25%:209 50%:419 75%:723 90%:1232 95%:1687] some good threads, but otherwise inconsistent RP style.
Roleplayer Guild ๐ŸŸข All roleplaying forums Excellent General RP+ERP part1.7z part2.7z part3.7z part4.7z part5.7z part6.7z part7.7z part8.7z This dataset is different compared to the others in that it includes within the same .csv files in-character (IC, i.e. actual roleplay), out-of-character (OOC) and Character Sheet messages for a total of about 3 million messages. As OOC and Sheets share the same base url/name with the IC threads, they can be reliably associated with them, if needed. Thread tags and an additional field identifying if the messages are part of IC, OOC or sheets are included. Possibly one of the best all-around RP datasets. Special usage notes: 1: @-mentions in the IC threads could be removed. 2: A markdown file with an extended explanation of thread tags is provided.
RP Nation ๐ŸŸข Group Poor ~ Good RP part1.7z part2.7z LOST part4.7z part5.7z #1:[Count:497833 Mean:649 Std:1454 25%:160 50%:344 75%:717 90%:1418 95%:2156] #2:[Count:383466 Mean:861 Std:1733 25%:188 50%:457 75%:977 90%:1950 95%:2978] #4:[Count:309836 Mean:2023 Std:2631 25%:524 50%:1230 75%:2582 90%:4719 95%:6467] #5:[Count:483754 Mean:1940 Std:3356 25%:424 50%:880 75%:2223 90%:4858 95%:7043] Part 3 missing due to problems while scraping; variable message quality and length
RP Nation ๐ŸŸข One on One (1x1) Poor ~ Good RP part1.7z part2.7z #1:[Count:574127 Mean:596 Std:1194 25%:101 50%:243 75%:599 90%:1409 95%:2374] #2:[Count:594005 Mean:1334 Std:2787 25%:284 50%:728 75%:1320 90%:3087 95%:4801] Variable quality that seemingly improved over time.
RPG Net ๐ŸŸข Roleplay-By-Post Play Forum Good Tabletop-like RP part1.7z.001 part2.7z.002 #1:[Count:140054 Mean:1274 Std:1605 25%:322 50%:854 75%:1548 90%:2797 95%:3996] #2:[Count:143877 Mean:1326 Std:1552 25%:346 50%:945 75%:1681 90%:2848 95%:3992] #3:[Count:147795 Mean:1306 Std:1699 25%:306 50%:865 75%:1607 90%:2876 95%:4101] #4:[Count:140932 Mean:1235 Std:1534 25%:308 50%:853 75%:1514 90%:2705 95%:3865] #5:[Count:144716 Mean:1167 Std:1409 25%:312 50%:885 75%:1453 90%:2454 95%:3382] #6:[Count:134337 Mean:1151 Std:1367 25%:282 50%:806 75%:1455 90%:2563 95%:3564] #7:[Count:145362 Mean:1547 Std:2344 25%:327 50%:922 75%:1764 90%:3405 95%:5169] #8:[Count:135931 Mean:1243 Std:1500 25%:315 50%:831 75%:1567 90%:2762 95%:3912] Only the in-character (RP) threads were scraped. In total, 1.1M messages in 8 .csv files compressed into 1 7-zip archive. General quality a bit variable, with OOC, "noise" and tabletop-like RPG dice roll data and so on that will have to be cleaned.
SpaceBattles ๐ŸŸข Roleplaying Good? Group fantasy / scifi / fandom RP (OOC threads) .7z.001 .7z.002 #0 [Count:207873 Mean: 865 Std:1362 25%:140 50%:762 75%:1093 90%:1755 95%:2456] #1 [Count:210103 Mean:1032 Std:1652 25%:301 50%:887 75%:1154 90%:1828 95%:2493] #2 [Count:211394 Mean:1096 Std:1959 25%:707 50%:926 75%:1209 90%:1907 95%:2556] #3 [Count:212016 Mean:1222 Std:2436 25%:760 50%:933 75%:1240 90%:1988 95%:2789] #4 [Count:212590 Mean:1215 Std:3062 25%:770 50%:926 75%:1202 90%:1905 95%:2639] #5 [Count:211059 Mean:1338 Std:3912 25%:767 50%:945 75%:1287 90%:2124 95%:3094] #6 [Count:209990 Mean:1488 Std:3702 25%:774 50%:947 75%:1310 90%:2313 95%:3767] #7 [Count:202896 Mean:1747 Std:4669 25%:747 50%:975 75%:1446 90%:2900 95%:5465] About 1.5M messages. Most messages are from OOC threads. Thread tags present for newer threads. Thread Labels may denote if they are OOC or IC threads.
SpaceBattles ๐ŸŸข Roleplaying IC Good Group fantasy / scifi / fandom RP part1.7z.001 part2.7z.002 part3.7z.003 part4.7z.004 #0 [Count:348316 Mean:1952 Std:4125 25%:283 50%:1031 75%:1932 90%:4222 95%:7019] #1 [Count:353124 Mean:1365 Std:2391 25%:294 50%: 948 75%:1454 90%:2657 95%:4056] #2 [Count:351046 Mean:1273 Std:2732 25%:225 50%: 901 75%:1313 90%:2335 95%:3622] #3 [Count:354673 Mean:1311 Std:3165 25%:241 50%: 917 75%:1354 90%:2427 95%:3724] #4 [Count:353331 Mean:1542 Std:2424 25%:792 50%:1053 75%:1670 90%:2896 95%:4306] #5 [Count:355101 Mean:1826 Std:3499 25%:841 50%:1106 75%:1881 90%:3418 95%:5263] #6 [Count:346398 Mean:2665 Std:7769 25%:884 50%:1316 75%:2483 90%:4935 95%:7869] #7 [Count:354917 Mean:3017 Std:8534 25%:982 50%:1419 75%:2643 90%:5086 95%:8439] About 2.8M messages, for the most part in-character / IC. Thread tags present for newer threads. Thread Labels may denote if they are OOC or IC threads. The group nature of the threads can make it difficult for them to be used for 1-on-1 chats.
Umbra Roleplaying โš ๏ธ Various Very Good ERP .7z #1: [Count:451 Mean:2230 Std:775 25%:1686 50%:2058 75%:2539 90%:3226 95%:3722] #2:[Count:9362 Mean:1825 Std:5106 25%:312 50%:1023 75%:2253 90%:3885 95%:5258] #3:[Count:5470 Mean:2556 Std:2741 25%:990 50%:1873 75%:3122 90%:5181 95%:7498] Small ERP Forum with excellent quality postings on average. However, some threads could be filtered away due to lack of responses or short responses.
Wolf RPG ๐ŸŸข Archives Very Good Wolf (Animal) RP .7z [Count:423174 Mean:1177 Std:669 25%:759 50%:1038 75%:1421 90%:1925 95%:2352] Messages not overly long, but consistently very good quality. Note 1: OOCs in this forum are most often placed under a special tag. These tags have been isolated and removed from the message body, then placed in a special message_ooc field in the CSV file. Note 2: content warnings (violence, swearing) have been removed from the messages. Note 3: Threads shorter than 1 reply have been filtered.
Yaoi Dreams โš ๏ธ One on one Roleplay Poor ~ Good Yaoi / Boy's Love RP+ERP part1.7z.001 part2.7z.002 #1:[Count:785193 Mean:473 Std:604 25%:164 50%:298 75%:554 90%:999 95%:1445] #2:[Count:726061 Mean:574 Std:870 25%:170 50%:326 75%:647 90%:1298 95%:1912] #3:[Count:602080 Mean:1189 Std:1767 25%:322 50%:659 75%:1428 90%:2741 95%:3910] The main forum section in Yaoi Dreams with 2.1M messages in total. Post quality varies from rather poor and amateurish (especially for early messages written in 2005) to rather good, perhaps averaging on "Good" overall. Message quality improved over time.
Yaoi Dreams โš ๏ธ RP Graveyard / Group Roleplay / Manga, Anime, etc RP / General RP Poor ~ Good Yaoi and General RP+ERP .7z.001 generalRP: [Count:50703 Mean:737 Std:1562 25%:180 50%:354 75%:731 90%:1547 95%:2653] groupRP:[Count:148935 Mean:622 Std:1228 25%:135 50%:304 75%:671 90%:1461 95%:2213] animeManga:[Count:444899 Mean:614 Std:1061 25%:174 50%:333 75%:657 90%:1386 95%:2141] RPgraveyard:[Count:194532 Mean:381 Std:585 25%:138 50%:243 75%:435 90%:755 95%:1095] All other Yaoi Dreams forum sections. Similar quality considerations as for the main section.

Usage notes

All message archive files are in .csv format. They can be easily processed in python using the pandas data processing library as follows:

โŽ—
โœ“
import pandas
data = pandas.read_csv(filename)

After doing so, most of the time the data will have 5 or more fields as in the following example:

โŽ—
โœ“
1
2
3
4
5
6
7
b.loc[211]
Out[211]: 
thread_title                              new idea, but need some help
thread_href          https://forum.literotica.com/threads/new-idea-...
message_timestamp                               Nov 3, 2000 at 3:00 PM
message_username                                   husband's nightmare
message              I want to do a role play based o the movie Dre...

Some details

  • Messages have been parsed by chronological order using threads first, then messages. In other words, messages from the same thread will be consecutive in the .csv files.
  • message contains the message body in html format. To become fully usable for fine-tuning LLMs it will likely have to be rendered as text. The Python library BeautifulSoup could be used for this.
  • message_timestamp has not been normalized and thus may have different formats depending on the forum.
  • Sometimes, thread labels or tags have been added too as separate fields.

Suggested strategy for parsing and filtering the files

  • Forums can have a lot of off-topic or non-RP threads. The latter most of the time include "OOC" in the thread title. Such threads could be filtered away.
    • For Elliquiy, it is suggested to filter away threads titles containing the strings: OOC, O.O.C. (out of character, i.e. non-RP/ERP talk); Character Sheet, Character Profile, Character Thread, Character List, Character Roster (these all contain character descriptions). However, note that IC or in-character means that the thread is in-topic, i.e. it contains proper role-play.
    • Note that sometimes Character and OOC can be in the same thread.
  • For privacy reasons it might be best to anonymize usernames and scramble URLs originating from the forum where the messages have been posted.
  • Typically OOC (out of character) messages within in-topic threads will be enclosed with double parentheses (( )), single parentheses with OOC marking (OOC: ); more rarely square parentheses are used as well [ ] [OOC: ]. However, often just single parentheses ( ) without other indications are used for OOC.
  • Threads tend to have a more or less consistent posting style. It is suggested to filter complete threads away if the posts contain too many one-liners.
  • Oftentimes there will only be 1 opening post, perhaps due to a failure to attract attention. In principle, these threads could be filtered away, but depending on the forum they are often also high-effort posts.

Stories website scrapes

These archives contain short stories written by a single author instead of roleplay between two or more persons.

Site name Quality Theme Link Notes
Impregnorium ๐ŸŸข Good Impregnation stories .7z About 1360 stories. Uses alt.sex.stories story codes; glossary provided in the archive for the tags.
Literotica ๐ŸŸข Good (Variable) General 7z.001 7z.002 7z.003 7z.004 7z.005 7z.006 7z.007 7z.008 7z.009 7z.010 7z.011 7z.012 7z.013 7z.014 300K+ stories as of 2021-12, 8GB CSV file with tags and other metadata 7zipped to a 2.6GB archive. Processed from https://archive.org/details/literotica-2021.12
Lush Stories ๐ŸŸข Good+ General .7z.001 .7z.002 About 70K stories (1 GB archive) with tags and general categories, a large fraction also having a brief summary. The stories are in HTML that needs some cleaning. Note that while a good portion of the author's notes are present as a dedicated field, in many cases they are in the story text together with trailers ("Continues in Chapter X", "THE END", etc.).
Sexstories ๐ŸŸข Good (Variable) General part1.7z part2.7z 60K stories, 1.25GB. Duplicate stories may be present. Some are also short "sex jokes", so it is suggested to filter them by length. Tags, ratings, views included in the csv files.
The Erotic Mind-Control Story Archive ๐ŸŸข Excellent Erotic mind control stories (general) part1.7z.001 part2.7z.002 36000+ stories (including multi-chapter parts). All stories include a short summary and categories based on a modified alt.sex.stories system, described in detail here. The stories are in very consistently formatted HTML, and separating unwanted portions like trailers, milestones, chapter titles and so on should be easy.
Edit
Pub: 13 Apr 2023 15:11 UTC
Edit: 20 Jan 2024 11:20 UTC
Views: 40074