Posted: Sunday, February 19, 2012 by Tyler Durden in Labels: ,

http://lifehacker.com/5601586/how-to-get-started-with-usenet-in-three-simple-steps

How to Get Started with Usenet in Three Simple Steps

Usenet is a wonderful service for finding and downloading digital media, giving you speed and reliability you won't find with other file-sharing options—like, say, BitTorrent. Here's a quick guide on setting up and getting started with Usenet.

An Introduction to Usenet

What is Usenet?
Rather than dive into a full history of Usenet, let's talk about how it's relevant to you. Usenet was originally designed as a bulletin-board service, and so there's a ton of text content available on Usenet, but once binary newsgroups made their way into Usenet, it quickly became a popular place to find any sort of files that interest you. A site called Newzbin started indexing the binaries available on Usenet and creating the NZB file format. An NZB file is basically the Usenet equivalent of BitTorrent's torrent file, in that when you download an NZB, you're simply downloading a file that points to files available on Usenet. Applications supporting the NZB format can use them to make downloading Usenet binaries a piece of cake. In this guide, we're going walk through how to set up Usenet access, configure a newsreader, and then find NZB files so you can get the content you want.
Regarding the First Rule and Other Issues


There are two controversial issues attached to writing about Usenet: 1) the first rule of Usenet is that you don't talk about Usenet, and 2) it's commonly used to download copyrighted material. Before getting into the how-to portion, we thought it important to address these topics.
People have kept quiet about Usenet to avoid bringing unwanted attention to it, hoping it doesn't suffer the same fate as, say, Napster. Because Usenet hosts all kinds of files, including copyrighted works, it's a potential target for the hammer of the MPA/MPAA, RIAA, etc. Back in October of 2007, the RIAA launched a copyright infringement lawsuit against Usenet.com and more recently, the MPA won a case against Usenet binary search engine Newzbin. With these large content rights organizations abundantly aware of Usenet's existence, it seems silly to pretend we're still protecting it through silence.
In regards to the fact that Usenet can be used as a means of acquiring copyright works, we leave that up to the individual user. We're going to look at how Usenet works and what you can do with it, leaving the choice of usage entirely up to you.

Step One: Choosing a Usenet Service Provider

Unlike most file-sharing services nowadays, Usenet is not peer-to-peer. While in rare cases you might get some poor level of access through your Internet service provider, you're going to want to pay for Usenet access that will actually prove useful. Currently I use Newshosting, several more (and potentially better) choices exist, such as GigaNews and Astraweb. These are all good options, but you can choose whatever Usenet provider you'd like. When comparing providers, here are a few things you'll want to look at:

  • Days of Full Binary Retention - With massive amounts of data being added to Usenet servers every day, it can't all be stored forever. Retention is the number of days you're guaranteed to have access to a file after its original posting date. Most providers offer something around 200 days, and in most cases that's sufficient, but there will be circumstances in which you'll want access to older data. A year is usually sufficient for most people, but some providers (like GigaNews) offer very high retention rates as high as two years. It's important to check the type of retention advertised. Some providers will separate their binary retention from their text retention when their text retention number is significantly higher (for example, GigaNews retains binaries in full for 1,048 and text for 2,900 days).
  • Monthly Transfer - Generally measured in GB, this is the the allotment of data you can download for the month. In most cases you're going to want a plan that offers unlimited transfer, but most Usenet service providers offer plans with data caps generally ranging from 5 to 50 GB.
  • Connections - Every Usenet service provider caps the number of simultaneous connections you can make at a single time through your account. This is relevant for a couple of reasons. First, most of the files you'll download are split into parts and you may want to download those parts concurrently, as this can often be faster than downloading one file at a time. The number of connections you pay for is directly related to the number of files you can download at a given time. Also, if you want to use your account from different locations at the same time or share your account with someone else, you can split up the number of connections between locations so only one account is needed. Personally, I use eight connections at a time, but my account includes 20. Generally, no matter what type of account you choose, you'll end up with a sufficient number of connections—if not more than you'll ever need.
  • Security - In most cases SSL and other security options cost extra but may be something you want to consider. If you want to take any extra measures to encrypt the data moving between your Usenet service provider and you, make sure you take a look at what each provider offers you, as various security options are available with most.
  • Support - While it's unlikely you're really ever going to need to contact support, it's good to know it exists with a decent response time. Generally the contact method is only via email, but that should be good enough so long as they promise to get back to you within a day.
  • Cancellation and Trial Periods - When trying out a new provider for the first time, make sure you can easily cancel your account without incurring any fees. It's best to not pre-pay for several months (or years) of service ahead of time until you've tested out the waters for a month or two to make sure the provider will work well for your needs.
Once you've chosen a provider and completed the signup process, there are a few pieces of information you're going to need before moving on. First, get the server address (i.e.: unlimited.newshosting.com) and port you'll need to connect. This information should all be easy to find from your service provider. If your account includes SSL, make sure you get a port number for SSL and standard access. After that you'll just need your username and password, which you'll presumably know since in most cases you'll have chosen them yourself.

Step Two: Setting Up Your Usenet Client

More Than Just Downloads
How to Get Started with Usenet in Three Simple StepsWhile this section is going to mainly cover using the free, open-source Usenet clientSABnzbd+ to download binary content, if you plan to use Usenet for reading newsgroups as well, you'll want a proper Usenet client.Unison is a great (but not free) option on the Mac. A free newsreader is The unPoster, plus many email clients can serve as newsreaders as well. On Windows you have several free choices, including The unPoster and Grabit. On Linux, two options are Pan and KLibido.
...Or Not
If you're just in it for the binary downloads and couldn't care less about the text-based Usenet content, SABnzbd+ (from here on, we'll refer to it as SAB) is what we'd recommend you use. But SAB isn't the only download helper out there. Ninan and URD are similar options, and there are several platform-specific Usenet binary downloaders that help make the process easier. There are too many to cover and since SAB is our favorite, that's what we're going to concentrate on here.
Setting Up SABnzbd+


SAB runs on Windows, Mac, and Linux because it's basically a collection of Python scripts. It runs as an application, but you control it from your web browser—either on your local computer or, if you've set it up, from any web browser via a remote connection. Before we go any further, you'll want to download it.
Setting up SAB is really easy, especially now that SAB walks you through the process with its new setup wizard. SAB's site has a great quick setup guide but we'll give you the short version (you can see more details in the video above):
  1. Launch SABnzbd+ and, if it doesn't do it for you, go to http://localhost:8080 in your web browser.
  2. Select a language, then a theme. After that we'll get to the important stuff.
  3. In the Access Options screen you'll be asked if you want SAB to be remotely accessible or just accessible on your local network. Enabling remote access will give you some other neat options that we'll discuss later. If you do, be sure to set a username and password for security purposes.
  4. Next is Server Setup, where you'll need the server information you set aside from before. Here you'll enter your Usenet service provider's server address, the corresponding port, whether SSL is on or off, and your username and password. This is also where you set the number of connections you want to use. (Remember, when you signed up for Usenet service your provider gave you a finite number of connections to use—you can enter any number up to that maximum here.)
  5. Index Site Options is the final screen to fill out, but we haven't discussed content yet so you can skip this for now.
  6. You're done! Restart SAB and it'll be ready to go.
Fine-tuning SABnzbd+


How to Get Started with Usenet in Three Simple StepsOnce you've completed SAB's basic setup, you've still got a few more things to do. SAB comes with a ton of settings, and we're going to explore some of the most useful ones. First, visit SAB athttp://localhost:8080 (unless you set it up elsewhere) and click Config. Beneath Config, click General. First you'll find the configuration for the SABnzbd web server. A little ways down, in that category, is the API key. It'll be a long alphanumeric string and won't be terribly useful to you at the moment, but copy it and put it aside. We'll be using that later.


All the way at the bottom you'll see a setting called Cleanup List with a couple of file extensions filled in. Much of what you download will come with superfluous files and SAB will automatically delete them during processing if their extensions are specific here. My list is .nfo, .sfv, .nzb and .srr. As you find files in your downloads that you don't need, you can add their extensions here.
Moving on to the next Config sub-category,Folders, you'll find options to set where your downloads go. SAB will default to a Downloads folder on your main hard drive, but you can set it to any path you want. If you set it to a path that, in part, doesn't exist, SAB will create the necessary folders. When setting a custom download path, be sure to set theTemporary Download Folder and the Completed Download Folder. Generally these folders are called Incomplete and Complete (respectively) and reside in the same parent folder. You don't have to do it this way, but that's how it works by default. You'll also find an option to set aWatched Folder. Although we'll look at easier methods, one way to easily add downloads to SAB is by downloading NZB files (more on this in the next section, but basically NZB files are file pointers—the equivalent of torrent files for Usenet) to the Watched Folder and SAB will pick them up automatically. (Point this to, say, a folder within file-syncing app Dropbox, and you've got a really simple way to remotely download new files. Not bad, but we'll detail a better option below.)
The next sub-category we want to look at is Switches. There may be several things you want to look at here, so check them all out. Whether or not you want to turn something on or off here is mainly going to be your personal preference.
We'll skip the Servers sub-category as you've already set this up. We'll also skip SchedulingRSS, and Email but feel free to explore them on your own. Index Sites is basically what we skipped during the initial setup of SAB, and we'll skip it again here, but make a note as we'll be coming back later. In Categories there really isn't much to do, but should you want to make a new category that SAB doesn't cover you can do that here.

In the last config sub-category, Sorting, you can do some pretty neat things with the organization of your downloads. There are a couple of sorting options, but the best is your option for television episodes. Tick the Enable TV Sorting box to get started and then fill out the sort string below. In most cases it'll already be filled out for you, but you may want to change it. You can use this to sort episodes however you'd like. Here's one example:
Sort string:
%sn - Episode %s%0e - %en.%ext
Output:
Show Name - Episode 105 - Episode Name.avi
You can also enable movie sorting and sort downloads by date. How you sort is entirely up to you and your personal preferences.

Step Three: Finding Content

Now that you've set up SAB, it's time to give it something to download. SAB downloads and processes files via NZBs, which are pointers to binary content on Usenet. Because most binaries on Usenet are split into several pieces, NZBs allow you to download a single file that holds the location information for every piece. SAB takes this file, downloads all the pieces it points to, then assembles them into the file you want so you don't have to do any of the heavy lifting. Finding NZBs isn't hard to do, but there are a few things to understand before diving in.
Newzbin created the NZB format, but, as mentioned earlier, it lost in a trial against the MPA and no longer exists as it once was. It's current incarnation is limited to members of the previous site. The other popular Usenet binary search site is NZBMatrix, which some prefer to Newzbin anyway. Both sites require that you pay for the sort of premium access you're going to want, but the cost is pretty minimal. Newzbin operated on a weekly credit model, where you'd pay very little (around $0.50) per week to download NZBs. NZBMatrix will allow you to download a few NZB files for free with limitations, but for $7, you get a premium NZBMatrix account that's good for ten years. This gives you access to an API key and will let you integrate more closely with SAB. (Note: you may also need your SABnzbd+ API key for better integration with NZB search sites.) If you sign up for either site, you'll want to enter your credentials (and your API key in the case of NZBMatrix) in the Config - Index Sites section of SAB. If forking over any more cash for Usenet isn't appealing to you, you can also try using free options like NZBs.orgBinsearch, orNewzleech.

If you have access to Newzbin or have signed up for NZBMatrix, however, you have more options in how you acquire content. Rather than downloading NZBs, you can use SAB's add-ons to facilitate downloads with less effort. For example, nzbstatus (Firefox) and SABconnect++ will both monitor your SAB queue and also add SAB download buttons to Newzbin and NZBMatrix so all you have to do to add a download to SAB from one of these sites is click one button. Even better, if you've enabled remote access to SAB you can queue up downloads using this method regardless of whether you're on your home network or not.

Another cool add-on that requires remote access is the myNZB iPhone App. For £1.79 ($2.99 USD), you can search Usenet index sites and add downloads to your SAB queue from your iPhone. NZBdroid and SABDroid+ are options for Android, but they're not yet as mature in their development as myNZB.
With your search sites set up for easy use, you're all set. Now you can take advantage of Usenet.

Extra Stuff



This guide just scratches the surface of what you can do with Usenet. There are other great projects like Sick Beard that add a lot of awesome new features to your setup. We'll be covering more Usenet tools going forward, so stay tuned.
If you have any Usenet tools or suggestions, share 'em in the comments!
RELATED STORIES
DISCUSSION THREADS
Am I the only person that is getting kind of tired of LH basically telling people how to download software/movies/games illegally? Yes, I know this information can be easily had elsewhere, but does it really need to be on here? Regardless of all the, "we will leave it up to the user to decide" comments, I feel like LH is still condoning piracy. Doesn't it seem just as bad to tell someone HOW to break the law than it is to do it yourself? What good for our computing hobbies can come from this article? There may be a few people that this is relevant toward that have not heard about it before. However, I am willing to venture that the majority of people whom put this article to use will not use it for that purpose. I understand the point of these articles is to tell the user new ways to share and transfer legal data. Why show Usenet then? Isn't bittorrent enough? Maybe I am just in a bad mood today, I don't know. It just seems like this is the type of content I do not want to see on LH anymore. Write your XBMC articles, those are great. Talk about programs like SABNZB+ and Sickbeard. Please, just stop showing people how to download illegal content.
Seeräuber Jenny approved this comment
Don't know whether I agree with you, but I believe enough in free speech in this context to let others judge.
Personally, I tend not to download illegal material. There were a couple of songs in the late 1990s, but I've since bought them on iTunes.
@adam.chance: Here, here! It's incredibly tiresome to hear such bullshit as "I'm not going to condone X, but I'm more than willing to give detailed instructions." Statements like that are simply and obviously hypocritical.
@adam.chance: So you're not into piracy? You must be rich. I'm sorry, but in order for me to start my business, I needed to have a top notch web dev suite. I downloaded CS5 Master Suite. There is no way I, as a college student, could have paid for it.
PS: I did pay $300 for CS3 MS a long time ago, but didn't feel it was right to have to pay again for CS5.
@adam.chance: Articles teaching people to get stuff for free (or in this, a very low cost) brings in web traffic. Web traffic brings in $$. For instance Giganews was mentioned 3 times while Astraweb just once even though the latter only has ~1% shorter retention time.
I understand the free speech argument and I agree with you 100% on it. I guess what I was saying wasn't that LH should not post something that is . . . taboo? (I know that is not the word I want to use). LH can write whatever they want and they are correct when they state that it is in the hands of the users to decide. I know LH is in the business of writing articles that will bring in readers . . . I was just hoping that LH would take the high road in these situations and not make it any easier for people to pirate material.
@adam.chance:
LH mostly posts about software and to do's. Dude, the name of the blog is life HACKER, as in HACKING.
And it's a blog dude, you want some serious legal stuff then RSS the NY tech blog area lol.
Your argument runs into wall when you consider people like the RIAA and MPAA have essentially been doing the same thing.
I mean, sure, they're champions against piracy, but they come out with reports that say stuff like:
"People have been using torrents to get material in high demand without having do pay for it"
Is that any better?
Plus, it's not LH's responsibility what people do with Usenet. It's actually a powerful tool if you want to use it for legitimate purposes.
Especially now that the DMCA has been revised, you never know.
[not condoning downloading illegal content in any way, just playing Devil's Advocate]
@adam.chance: That is a very valid point. While this might sound unusual, I'm not really a fan of piracy either. The reason I think this sort of post needs to exist is to promote the existence of on-demand media services that aren't (yet) legally available.
Usenet costs money, so if you're using it you're not necessarily opposed to paying for content. With BitTorrent and most other options, you're not paying at all. I think the reason to call attention to the use of a service like Usenet is that people are actually willing to pay for this, and the reason for calling attention to piracy-aiding tools in general is to make it clear that many people are not satisfied with the current non-piracy options. While there's never going to be a legal Usenet, especially for how little it costs, I have hope that there will be better offerings down the line if there's enough of a push to demonstrate that there are people willing to pay for this type of service. It's going to be awhile before something like that happens, but I don't think we'll make much progress if we don't point to the risk people are taking for a great method of content acquisition. It should be better, it should be reasonable priced and that should be known. I know not everyone will agree with this but that's one reason why this article exists.
@adam.chance: If this were an article on a handgun on some blog would it be any different? Some model of handguns are used to rob liquor stores and the same model can be used for home defense or competitive shooting. It's up to the user to decide how to use what they have.
If someone wants to download pirated material will Lifehacker stop piracy single-handedly by not writing the article or will the pirates find another way? Doing a Google search there were 33,300 hits for Sickbeard and 86,500 hits for SAB so I would assume 1 or 2 of those is for Lifehacker, so shame on them, the cat is out of the bag now.
@Adam Dachis: Your argument to Adam.chance is flawed, in addition to showing the self-serving nature of the article itself.
Let me explain it with a very similar (and true) story...
When I was a kid, we used to sneak onto the school playground to play. This wasn't allowed after school hours, but we did it anyway because there was nowhere else around that had as much cool equipment. One day, one of the kids got in trouble with his parents for going over there. He tried explaining that we did it only because we were all bored and liked to play on the merry-go-round, slides, etc. His parents called my (and everyone else's) parents, and we all got in trouble. The parents tried to get the school to allow after hours play, but that didn't happen. They then tried (so I'm told) to get a park in the neighborhood - never happened.
In the end, all that happened was that a well-wishing set of parents got us all kicked out of the playground. Nothing else. Was that their intentions? Doubtful. Did they really care whether we were bored? Doubtful. Did they think about the possibility that their actions would do nothing useful, but only make a situation worse? Doubtful.
The school ended up putting a locking gate on the playground fence, and police would check the playground on patrols.
The moral of this story is that intentions have absolutely no influence on cause and effect.
@TadGhostal: I don't think that's a comparable situation. Ignoring that you're dealing with a different topic entirely (maybe I'm assuming incorrectly, but it sounds like the park was closed because there was no one to watch the kids), if they'd extended park hours it would've cost money whereas Usenet is an example of how money can be made by applying a similar model when creating a legal means of content distribution. If you want an anecdotal example of how promoting something that can be used for illegal purposes can actually help, take a look at the recent legalization of phone jailbreaking and DVD ripping. We've written quite a bit on those topics, all with good intentions, and the gate ended up unlocked in the end.
@Adam Dachis: How closely my anecdotal story appears to relate to/differ from the topic is a matter of where you focus.
The point of my story was that the playground was like UseNet - something that everyone enjoyed. Sure, we were breaking rules, but no one was getting hurt, and everyone was happy. The cost of making that playground "legally" acceptable is an entirely different (and irrelevant) discussion. The crucial piece of info was that, through the well-intentioned deeds of one kid's parents, the entire issue was made pointless, because the playground was shut down.
To be more direct, your intentions, which you've stated very clearly, won't mean jack-squat to the people who end up losing UseNet over the attention that articles like this draw to it. No one's saying that UseNet is "a big secret", but as you well know, the media thrives on the smell of blood - and you've just dumped a big 'ol bucket of chum in the water.
What irritates me is that you did it on purpose, in some naive attempt to what, make Hulu better?
@TadGhostal: I understand you're saying the playground is like Usenet--I just don't think it is. Nobody's going to lock up Usenet because they don't want to spend the money to keep it open later or because they're concerned (perhaps unnecessarily) about the safety of kids using it after hours. It works as a comparison on a high level, in the sense that it's something that matters to a group of people and was shut down (although Usenet would actually need to be shut down because of this and other articles to be correct), but when you look at the actual specifics of the story it doesn't really relate.
But what it comes down to is that we really just don't agree. I think this sort of thing can help make positive change and I don't think there's as large of a risk as you do. Even if you're right that this article has the power to mark the end of Usenet as we know it, the wonderful thing about the Internet is that something new always comes to replace the old in a time of need. For decades, so many services have been shut down with others rising up in their place. While I definitely do not want Usenet to go I don't believe this article is going to help bring it down. I don't believe it's going anywhere for awhile, and if I'm wrong there will be something else to take it's place. The risks did not seem high to me, and so writing this to share a useful toolset with others and demonstrate that it's a method of content distribution that people are willing to pay for seemed reasonable to me. I know you and others disagree with this, so I'm not saying it to try and change your mind but to explain where I'm coming from.
@TadGhostal: Honestly, if Demonoid (or any other tracker, including private ones) hasn't been shut down, I doubt Usenet will be. Demonoid is way more public by comparison and has been around for much much longer.
Pretty much, Usenet would be damn near impossible to take down without changing some laws first:
Even if it were at risk, doesn't a risk have to be taken to gain anything? You risk your life (at low odds) every time you step out of your house. Sure, maybe a few powerful people may read the article, but plenty more who are supporters will read it, too.
Hulu is not the only one with the right idea. Netflix has a great content distribution service. Plenty of people pay for it solely for the streaming, I'm sure. Companies don't realize (or don't care) that media is moving more and more to computers. They're going to need to utilize that and keep up with Netflix and Hulu, or they're going to be history. Honestly, I don't need my cable company anymore. If someone were to provide a paid-for service for my computer that didn't have commercials (or had a very little) and had relevant content (not 300+ channels of a) garbage or b) repeat channels), I would pay just as much if not more than what I'm paying my cable company for that service. And I guarantee I'm not the only one.
Eventually, someone will step up and make a product if enough people show interest. Maybe even this article or even one of these comments will spark the motivation in some young entrepreneur. Who knows?
@adam.chance: Agreed, and this from a former Usenet leecher. Then I grew up and realized that content providers actually deserve to get paid for their work. I'm guessing that's asking a bit too much from some people here who will find some way of rationalizing their pilfering ways. But, it's just rationalizing. No two ways about it.
But your basic point is germane: there's no reason Lifehacker needs to be in the business of promoting or facilitating theft. Disappointing...
@adam.chance: If all laws were good laws, I would agree with you. However, law and morality can differ greatly, so there will always be laws worth breaking.
In many countries, including the Australia, Great Britain, and the United States, copyright and IP laws are poorly conceived, out-dated, enforced in a discriminatory manner, unjust, and sometimes downright abusive.
I would not frequent a website that published instructions on how to do things I believe are wrong, but when law is wrong, I'm not bothered by illegality.

0 comments :