I've been working on something for a couple of weeks, test it if you want.
User lookup is not a thing yet, if you know the ID's you can put it in manually.
We hope you enjoy using it. yiff.party operates on a non-profit basis, and as such, all the server expenses are paid by our users. We don't want to run ads or infect you with crypto miners. We depend on users like you to keep the site running, and to preserve years and terabytes of amazing content—some of which is no longer available from its original creators!
Because of the nature of the site, many users are reluctant to donate. That's OK! yiff.party was created so everyone can enjoy the content we host without any restrictions or paywalls. But if you value the service we provide, and are able to, we—and our users—would be tremendously grateful if you considered making a donation.
So far, approximately $182.48 has been raised out of our target of $280.00. We're about 65% of the way there! Please note: this tracker is updated manually—don't worry if your donation doesn't show up immediately!
yiff.party's server costs are due on the last day of each month. So, we need to meet this goal before 31 January!
At this time, yiff.party can only accept donations in numerous cryptocurrencies. Please select a currency below to display the relevant donation address.
Due to the nature of sites like yiff.party, it is very difficult to find payment processors who will accept clients like us. If we were to accept donations via PayPal, it wouldn't take more than a day for someone to submit an abuse report and get our account frozen. Until a viable way of accepting monetary donations becomes available, cryptocurrency will remain the only option.
There are many resources available on how to purchase crypto. For Bitcoin, check out bitcoin.org's page on buying Bitcoin for a list of methods. For beginner Bitcoin users, yiff.party recommends using an escrow service such as LocalBitcoins.
Anonymous 01/07/20(Tue)03:25:11 No. [R]
I've been working on something for a couple of weeks, test it if you want.
Anonymous 01/07/20(Tue)11:22:49 No. [R]
This seems quite promising, keep up the good work op
Anonymous 01/09/20(Thu)05:13:46 No. [R]
Seconded that, it is better for people to invest their time in P2P architectures instead.
Anonymous 01/09/20(Thu)06:53:43 No. [R]
Sky 01/09/20(Thu)20:19:39 No. [R]
Well this is brilliant, I've just spun up a VM for it and it's looking pretty good. I was planning on using it to download my own stuff, so for now I might just use the importer-test file. It's only pulling down 9 images right now then (what I think is) cleanly exiting but I'm guessing that's just for testing, although I haven't been able to see any such variables yet (I am a bit of a brainlet though, could just be scraping everything from 2020)
Thanks for all the hard work, hopefully this can be the yiff.party clone we've all been looking for.
Something something if it could import and host yiff.party scrapes, well, I'm getting ahead of myself there. You've done a fantastic job so far, keep up the good work!
Anonymous 01/09/20(Thu)21:08:13 No. [R]
The server ran out of space and killed the Docker container. It should be fine now, will look for longer term solutions that don't involve saving everything to /tmp
Anonymous 01/09/20(Thu)21:15:18 No. [R]
ye, importer-test only scrapes from the first page by default for testing purposes. You can change the limit at the counter check at the very bottom, or you can just remove it.
Anonymous 01/09/20(Thu)23:30:52 No. [R]
Ah, thanks, working perfectly now.
This is seriously a godsend, I was just about to look at scraping YP of a creator I'm about to stop contributing to, this is infinitely better.
Even though most people don't give a shit, saving the comments would be a nice feature to implement at some point, but I'm really not fussed.
Anyway, thanks again for everything. I'm glad YP no longer has a monopoly on archiving Patreon.
Anonymous 01/10/20(Fri)01:03:46 No. [R]
load more button doesn't work
Anonymous 01/10/20(Fri)01:44:29 No. [R]
Probably a database querying issue, will look into it.
Anonymous 01/10/20(Fri)02:09:04 No. [R]
Looks cool, would like to see more of it.
Anonymous 01/10/20(Fri)06:02:19 No. [R]
What does this do that yiff.party doesn't?
Anonymous 01/10/20(Fri)06:51:47 No. [R]
It is FOSS, you can help the developer add features if you learn to code.
Yes, instead of dealing with YP's closed source bullshit we can actually build our future, one line at a time.
And Patreon can readily study your tricks to develop countermeasures.
Anonymous 01/10/20(Fri)14:08:57 No. [R]
nocoder spotted. If you can't code you can't add support for Fantia, Fanbox and others as well, and people can patch problems faster than Admin.
same can already be said for YiffParty, it is just that Patreon put no effort into stopping us in the first place because of legal ramifications (see the entitled artist thread)
Any attempts of having countermeasures either uses:
browser/API fingerprints (website's code is public, workarounds are easy assuming they don't change layouts),
browser/API speedbumps/limiters (can be defeated by more scraper machines/accounts, "strength in numbers"), or
file fingerprints (PrimeLeap failed because it has easy workarounds like denoising and EXIF removal)
If you were to say that the first point is an issue, it applies to YiffParty as well. "If it can break Kemono, it WILL break YP."
Anonymous 01/10/20(Fri)15:22:29 No. [R]
Load more button fixed, Cloudfront wasn't forwarding shit correctly.
There are no "tricks." The Patreon API is publicly accessible and hasn't changed in years, there are command line tools made in 2016 that still work. They don't give enough of a shit to intentionally break scrapers.
It's open source. Anyone can fix bugs and add new features and scrapers instead of waiting for me to do it, and if you don't like how I run things, you can fork the project and make your own site. A monopoly is impossible.
Anonymous 01/10/20(Fri)15:36:05 No. [R]
Yes. I myself am adding Fantia and OnlyFans next, but anyone with programming knowledge can add Fanbox.
Anonymous 01/10/20(Fri)18:28:42 No. [R]
>There are no "tricks."
then why does your scraper require a captcha solver lol
Anonymous 01/10/20(Fri)20:18:20 No. [R]
Fantia? So another case where 99% of the artists uploaded only have free plans imported? Wouldn't it be better to have an importer that yiff doesn't have alongside onlyfans? Or is this because you only know how to add those 2 alone? In that case then it's understandable.
>you can add your own scraper if you learn to code!
>UHHH HEY OP CAN YOU ADD X SCRAPER?
Anonymous 01/10/20(Fri)21:43:17 No. [R]
I know how to add more of course, was just considering Fantia to achieve feature parity with YP. But if its' implementation will mostly be a waste, I won't bother.
Thinking about Fanbox and SubscribeStar.
Anonymous 01/10/20(Fri)22:34:00 No. [R]
Neat. Fanbox is the most popular japanese paywall site since it's connected to Pixiv, doesn't have the nigh-useless free plans like Fantia does so it won't have the same issues yiff has with it now where you don't even know if an artist has paid stuff imported without manually checking everyone each time. I'm subscribed to a bunch of artists on fanbox so I can help with importing.
Anonymous 01/10/20(Fri)23:11:33 No. [R]
>there are command line tools made in 2016 that still work.
Speaking of, does anyone know of any scrapers that grab everything, comments included?
So far the only ones I've seen all grab everything else, but yiff seems to have the only one that grabs comments.
Fuck, I was working on a similar implementation, but I'm really glad we had the same idea with asynchronous scraping. I might implement an offline solution instead (scraping directly from front-end elements) for easier importation.
Anonymous 01/11/20(Sat)04:20:36 No. [R]
Anonymous 01/11/20(Sat)05:17:18 No. [R]
Thots r life 01/11/20(Sat)05:49:36 No. [R]
If there aint any thots then don't expect me there
Anonymous 01/11/20(Sat)08:52:40 No. [R]
Please, PLEASE no thots
Anonymous 01/11/20(Sat)09:06:44 No. [R]
Why would you host this on AWS?
Anonymous 01/11/20(Sat)12:16:48 No. [R]
>same can already be said for YiffParty,
Yiff.Party isn't open source, so it can't be studied nearly as readily.
>The Patreon API is publicly accessible and hasn't changed in years
Countermeasures don't end at the API.
>They don't give enough of a shit to intentionally break scrapers.
They managed to cripple Yiff.Party just from Admin's OpSec fuck-ups. It'd be even more crippled now had Yiff.Party been open source.
>It's open source. Anyone can fix bugs and add new features and scrapers instead of waiting for me to do it, and if you don't like how I run things, you can fork the project and make your own site
For its potential to act on Yiff.Party's flaws, the last thing Kemono.Party needs is a big OpSec failure waiting to happen. It'd be better to vet and recruit trusted developers and rethink how the public participates in Kemono.Party's development.
Anonymous 01/11/20(Sat)23:30:29 No. [R]
Every time YP importer died it was because cloudflare was improving their bot detection algorithms, not because patreon was implementing any counter-measures against YP. They don't give shit about scrappers, their only move in response to them was the addition of upfront payments so people can't get the content without actually paying for it. I've been working on my own patreon scrapper for years so I know what I'm talking about.
Anonymous 01/12/20(Sun)03:20:38 No. [R]
Exactly, at least support multiple hosts at the same time to prevent shutdowns, and please for the love of god implement P2P for caching or backup.
> They managed to cripple Yiff.Party just from Admin's OpSec fuck-ups. It'd be even more crippled now had Yiff.Party been open source.
> For its potential to act on Yiff.Party's flaws, the last thing Kemono.Party needs is a big OpSec failure waiting to happen. It'd be better to vet and recruit trusted developers and rethink how the public participates in Kemono.Party's development.
"Given enough eyeballs, all bugs are shallow" ~Eric S. Raymond, The Cathedral and the Bazaar (1999)
If that is true then a lot of people in this thread are retarded.
Anonymous 01/12/20(Sun)18:41:41 No. [R]
New update, search added. Please tell me if there are any bugs.
> please for the love of god implement P2P for caching or backup
Looking into options for this.
Anonymous 01/12/20(Sun)22:22:14 No. [R]
>embedding inline images directly from Patreon
Not only are you leaking IPs, you're also leaking the identity of the person who imported a specific post. Those token hashes also expire after a while.
Anonymous 01/12/20(Sun)23:31:28 No. [R]
That was an oversight on my end, will push a fix as soon as possible.
Anonymous 01/13/20(Mon)14:33:29 No. [R]
>Every time YP importer died it was because cloudflare was improving their bot detection algorithms
The importer had its share of hiccups prior to Cloudflare's actions, so it can't honestly be said that Cloudflare was responsible for "Every time" the importer broke.
>"Given enough eyeballs, all bugs are shallow" ~Eric S. Raymond, The Cathedral and the Bazaar (1999)
Shallow enough for Patreon to exploit. Let's not neglect basic OpSec and ruin a (potentially) good thing.
Anonymous 01/14/20(Tue)15:17:19 No. [R]
search doesn't work for anything other than "iryanici"
"load more" button doesn't work
Anonymous 01/14/20(Tue)16:22:33 No. [R]
So how do we get back to bot scrapers working, and no longer needing to rely on generous patrons for import/uploads?
Anonymous 01/14/20(Tue)17:12:42 No. [R]
Anonymous 01/15/20(Wed)03:21:03 No. [R]
Finally, someone actually doing something instead of whining. Nice work. Though if you manage to split the community then both sites would probably die...
Anonymous 01/15/20(Wed)10:04:59 No. [R]
Which is why we need a link system that binds the two sites together...
Thots r life 01/15/20(Wed)17:49:05 No. [R]
If u include models and thots then consider me in for donations. Otherwise I aint coming to ur site
Anonymous 01/15/20(Wed)22:12:03 No. [R]
No and good riddance. I'm not paying to store e-whores.
Anonymous 01/16/20(Thu)09:33:19 No. [R]
Anonymous 01/16/20(Thu)14:03:42 No. [R]
>Though if you manage to split the community then both sites would probably die...
Anonymous 01/20/20(Mon)19:55:07 No. [R]
A bit of an update, since I haven't committed to the repository in a while.
The inline image update should be pushed today; sorry for the wait. I've been working on transitioning the entire program to MongoDB which is why development has been choked a little. It's clear Kemono's time with NeDB is up. Data loss issues have happened multiple times, and I am overall looking for more reliable options. It requires a significant change to the existing codebase, so it'll be a while.
Also, Fanbox is incoming, but I need test data. If someone could dump https://www.pixiv.net/ajax/fanbox/index into a Pastebin, that would be great. Need postListOfSupporting and supportingPlans specifically.
Anonymous 01/20/20(Mon)19:55:50 No. [R]
*err, i mean someone who actually pledges to people on there. empty data would be useless.
Anonymous 01/23/20(Thu)21:58:24 No. [R]
Thanks to the person who dropped the data in the Mumble. Going to start implementing.
Anonymous 01/26/20(Sun)08:50:21 No. [R]
who this is kemono.party????
Anonymous 01/26/20(Sun)16:23:52 No. [R]
More like YP but actually tries to git gud instead of shitting everywhere.