Saved RDF threads - thank you

[Hermit]

wouldn't waybackmachine or a similar archive have the forum saved from a few weeks back?

For reasons that were never explained the Richard Dawkins Foundation decided to be excluded from being mirrored by the waybackmachine a year or two ago.

[Agi Hammerthief]

wouldn't waybackmachine or a similar archive have the forum saved from a few weeks back?

For reasons that were never explained the Richard Dawkins Foundation decided to be excluded from being mirrored by the waybackmachine a year or two ago.

that wasn't around the same tme that Search stopped to work properly?

[NineBerry]

Status update:

All downloads are finished. I have:

79,507 threads with
2,274,472 posts by
26,581 different users

All the data is kept on the partition, where I also keep my porn (because this is my biggest partition). So, you can be certain, the data is safe

Here is an automatically generated list of the threads I have: http://www.neunbeere.de/rd.net/Threads.html (5.5 MB)
Here is an automatically generated list of the users I know: http://www.neunbeere.de/rd.net/Users.html (1.5 MB)

The links to User pages already work(soon, are now being uploaded), so you can see what threads every user has participated in, but the actual threads are not there yet.

---

Here is what I will do next:

1. Adapt the actual forum files to fix internal links and remove content that is not needed. The code for that already exists, now it just needs to process all data. This might take up to a day or a bit more.
2. Then package everything together and give to anyone who wants it.

I will offer all data together as one big download archive. I estimate, this will be at 400-600 MB.

The unpacked version will be at approx. 4 to 6 GB. I don't have a server with enough space or bandwidth to host the unpacked version. But whoever has the capacities can take my archive, unpack it and host it on his server. This way, people could browse the forum to read threads and also link to threads. Also, this way, google could then index the content and one could use Google Search to search the site.

[Valden]

Status update:

All downloads are finished. I have:

79,507 threads with
2,274,472 posts by
26,581 different users

All the data is kept on the partition, where I also keep my porn (because this is my biggest partition). So, you can be certain, the data is safe

Here is an automatically generated list of the threads I have: http://www.neunbeere.de/rd.net/Threads.html (5.5 MB)
Here is an automatically generated list of the users I know: http://www.neunbeere.de/rd.net/Users.html (1.5 MB)

The links to User pages already work(soon, are now being uploaded), so you can see what threads every user has participated in, but the actual threads are not there yet.

---

Here is what I will do next:

1. Adapt the actual forum files to fix internal links and remove content that is not needed. The code for that already exists, now it just needs to process all data. This might take up to a day or a bit more.
2. Then package everything together and give to anyone who wants it.

I will offer all data together as one big download archive. I estimate, this will be at 400-600 MB.

The unpacked version will be at approx. 4 to 6 GB. I don't have a server with enough space or bandwidth to host the unpacked version. But whoever has the capacities can take my archive, unpack it and host it on his server. This way, people could browse the forum to read threads and also link to threads. Also, this way, google could then index the content and one could use Google Search to search the site.

Fantastic!

Confused on the download bit. No torrent then?

[NineBerry]

Confused on the download bit. No torrent then?

I have never used bittorrent to distribute my own files, only to download stuff. So I would first need to find out how that works and I am too lazy to do that.

I will make the archive downloadable via dropbox, that's the easiest way for me. Then anyone can download the archive, create a torrent version or put it on his own server, and so on.

[Valden]

Confused on the download bit. No torrent then?

I have never used bittorrent to distribute my own files, only to download stuff. So I would first need to find out how that works and I am too lazy to do that.

Boooo!

I will make the archive downloadable via dropbox, that's the easiest way for me. Then anyone can download the archive, create a torrent version or put it on his own server, and so on.

I'm not very comp savvy, so I've no idea what a dropbox is. But that's okay, whatever is easiest for you!
Thanks again for doing this!

[GrayToneS]

Yeah says it does not exist..too bad I did not think to grab it earlier - got the complete Climate News 115 pages..

"Too bad"???
Its a fucking CATASTROPHE those pages are missing!!!

Re: Scientific videos thread. The version I captured has 2 pages. Maybe one of the persons who got their accounts deleted were main contributors to that thread, so that their posts are gone now?

Initially there were over 120 posts, with no single contributor accounting for more than a roughly estimated 5% of the entire thread (although alot of the posters from the first few pages I noticed weren't active in the short year I was a member), the large majority of posts were multiple video links, or links to sites with hundreds of videos. No way I could roughly estimate the hours of educational films ranging from nuclear fusion/fission, green tech, climate shifts, geology, DNA/cellular structure, evolution, physiology, the workings of jet engines, aerodynamics, cosmology, big bang, string theory, fluid dynamics, psychology, philosophy, mathematics, or just about anything else you could mention or couldn't even imagining mentioning; one could spend a lifetime going through the compilation of videos posted on that single thread.

And now they've dwindled all that into less than 20 posts of a page that "does not exist"????

The thread has been deleted in the meantime on the forum. I wonder why. Who would do that?

Hitler.

[Skylarking]

The thread has been deleted in the meantime on the forum. I wonder why. Who would do that?

Hitler.

Funny because it's apt; sadly so.

[fuck you & fuck your god]

Status update:

All downloads are finished. I have:

79,507 threads with
2,274,472 posts by
26,581 different users

All the data is kept on the partition, where I also keep my porn (because this is my biggest partition). So, you can be certain, the data is safe

Here is an automatically generated list of the threads I have: http://www.neunbeere.de/rd.net/Threads.html (5.5 MB)
Here is an automatically generated list of the users I know: http://www.neunbeere.de/rd.net/Users.html (1.5 MB)

The links to User pages already work(soon, are now being uploaded), so you can see what threads every user has participated in, but the actual threads are not there yet.

---

Here is what I will do next:

1. Adapt the actual forum files to fix internal links and remove content that is not needed. The code for that already exists, now it just needs to process all data. This might take up to a day or a bit more.
2. Then package everything together and give to anyone who wants it.

I will offer all data together as one big download archive. I estimate, this will be at 400-600 MB.

The unpacked version will be at approx. 4 to 6 GB. I don't have a server with enough space or bandwidth to host the unpacked version. But whoever has the capacities can take my archive, unpack it and host it on his server. This way, people could browse the forum to read threads and also link to threads. Also, this way, google could then index the content and one could use Google Search to search the site.

FYI--the user page reports my thread total at 1883, RDnet says 1888. Losing 5 of my posts is not important, but thought it might be useful info.

FYI--the thread link crashes firefox, even after saved to disk and opened from there, but opened fine in chrome.

I will put archive up when I get it, be happy to if that will be of use.

[anthonzi]

All the data is kept on the partition, where I also keep my porn (because this is my biggest partition). So, you can be certain, the data is safe

Glad to hear it I wouldn't want to lose any of that data either!

Confused on the download bit. No torrent then?

I have never used bittorrent to distribute my own files, only to download stuff. So I would first need to find out how that works and I am too lazy to do that.

Uploading your own torrent is actually fairly simple! It just requires a few clicks in the torrent client, picking the appropriate directory, and copy-pasting the tracker address.. Most of the mainstream torrent search engines have instructions on how to do it. You've already archived an entire forum. You should have no problem figuring it out. But if you don't think you can do it someone else can always make one once they get a copy.

Did we come to a consensus about how private this archive is supposed to be? Because I would recommend putting it on a public tracker so that as many people as possible could get their hands on it with the least amount of hassle.
P.S. wouldn't mind if you uploaded some torrents of that porn you have as well.

[fuck you & fuck your god]

All the data is kept on the partition, where I also keep my porn (because this is my biggest partition). So, you can be certain, the data is safe

Glad to hear it I wouldn't want to lose any of that data either!

Confused on the download bit. No torrent then?

I have never used bittorrent to distribute my own files, only to download stuff. So I would first need to find out how that works and I am too lazy to do that.

Uploading your own torrent is actually fairly simple! It just requires a few clicks in the torrent client, picking the appropriate directory, and copy-pasting the tracker address.. Most of the mainstream torrent search engines have instructions on how to do it. You've already archived an entire forum. You should have no problem figuring it out. But if you don't think you can do it someone else can always make one once they get a copy.

Did we come to a consensus about how private this archive is supposed to be? Because I would recommend putting it on a public tracker so that as many people as possible could get their hands on it with the least amount of hassle.
P.S. wouldn't mind if you uploaded some torrents of that porn you have as well.

I have little experience with torrents, is it such that everyone just turning it on (downloading?) from one site will work well enough, or is it such that it is more efficient to get a few complete copies out there and then let loose the torrent downloading?

[anthonzi]

I have little experience with torrents, is it such that everyone just turning it on (downloading?) from one site will work well enough, or is it such that it is more efficient to get a few complete copies out there and then let loose the torrent downloading?

Seeding (uploading) it immediately from the original source (1 machine) is usually the most efficient way to do it (assuming the technology is working properly).

As an example, let's say that Nineberry shares the .torrent file on this forum, and 4 people run it on their torrent clients. Each of them will receive unique chunks of the file, and each will have 1/4 of the file by the time Nineberry has uploaded a full set of the data. The recipients will then share among themselves to complete the parts they are missing. In theory Nineberry could then turn off his own client, stop seeding, and the torrent would still be "alive" and well (as long as the recipients keep sharing). So unless there is someone we know has an excellent upload rate, there really is no benefit to picking who gets the file first.

Anyone who happens to have downloaded directly or gotten disks can also easily contribute to the torrent by running the .torrent file and point it to the directory where their complete (and unadulterated) file is saved.

[hackenslash]

If several people have the torrent seeded, then users can download from multiple locations, each location seeding a portion, meaning quicker download and less strain on the seed.

[tortouse]

thank you fuck you and your god. i'm just starting to come to terms with the "How can anybody feel that strongly about something so small?" socially retarded attitude which threatens to wipe out years of the clearest thinking. my brother warned me years ago that dawkins had lost the plot. i guess the creator (dawkins) felt spurned, left behind, totally bemused and superseded by the child (forum) it had created and so sort to bring it back to day one of creation.

i feel so much better and in debt to you and all who are working to save as much as possible. hoping you (we) succeed.

[Matthew Shute]

Fantastic!

My mere 1730 posts will now go on in some form. More important is the content of those forum-participants to whom I looked in awe, some with around posts 10,000 of high-quality philosophical and scientific content. As long as the data is safe, there is possibility of re-publishing it somewhere on the internets eventually.