Archive for the ‘Thoughts’ Category
Wednesday, September 11th, 2013
This article was originally written for and published at The New Tech on July 9th, 2013. It has been posted here for safe keeping.
On January 11th, Aaron Swartz passed away. If you’re not familiar with who he was and what he did, take a minute right now and look him up. A lot of focus was put on the circumstances of his death along with what he accomplished in life, and this seems to overshadow something that stood out to me: how to handle his legacy. Specifically, how he wanted his legacy to be handled.
Swartz created a simple web page in 2002 about how to handle things if he were to be “hit by a truck.” Who would take over his website? Where would his source code end up? He created an electronic will. The idea of a will is nothing new. Most people create a document outlining how their assets will be divided up when the time comes- it just makes things operate more smoothly. But what about in the electronic world? Surely we mark who will get our house but what about who gets our website? It sounds amusing to think about or even entertain the idea. We allocate or physical property, things that can be defined in dollars and cents, but hardly consider our intellectual property.
If you haven’t had a Facebook friend pass away yet, you’re likely in the minority. It’s sad, of course it’s sad, but it needs to be talked about. If you have ever had a Facebook friend pass, you may observe a cycle where his/her profile is used first as a memorial and then eventually deactivated all-together. These are my experiences. I understand and empathize with the feelings of the family in these circumstances, but to me this seems a little like burning all of a loved one’s possessions with the ease of a single mouse click.
These are the two ends of the spectrum.
It’s important to let go and move on, but it’s also important to remember and honor. In a basic sense, I apply the same fundamental ideas towards the death of a person as I do towards that of a technology. Most are quick to push the old out of thought, but the few make a move to preserve. I preserve. It’s just my nature.
Swartz’s situation resonated with my own beliefs. If I were to be hit by a truck tomorrow, what would happen with my stuff? My digital stuff. I run a fair number of websites, I rent a VPS and a dedicated server, and I have bills, Amazon S3, service subscriptions. If I go, they eventually do too.
I’d like to tell you that I have a contingency plan, but I don’t. I haven’t reflected fully on the logistics of it. Could I think of people to take over my digital stuff after I’m gone? Of course, but would they want to? When someone dies and it becomes your responsibility to handle their belongings, it’s not typically a drawn out process. You keep some stuff, you toss some stuff, but you don’t normally end up with something that needs to be maintained and worked through. Websites take a fair amount of time and money. Storage, while getting cheaper, is still expensive for the hobbyist. There’s unavoidable maintenance.
That said, I would hope that my online persona remains long after I do. Forum accounts, Facebook information, Twitter posts, etc. should survive as long as possible. I want everything to be available to anyone who needs it. Hand over my source code and pick apart my log files.
Open source my life.
If I’m not going to work on it anymore, I’d like to give that ability to anybody who is interested.
To have these things removed, stripped from the world, is just nonsensical to me. Someone’s interesting and original work disappearing because nobody knows how to or doesn’t want to handle handle it? Nothing upsets me more than something like that. It’s akin to tearing pages out of every history book. In our modern world, people are quick to think that things last forever. Digital artifacts can go missing overnight.
We shouldn’t be worried so much anymore about having something embarrassing stored online forever, we should be more worried about something important disappearing tomorrow.
Tuesday, April 30th, 2013
I’d like to think that I have something of a second nature when it comes to whether or not there is a documentary made or in production for any of my disjointed hobbies and interests. It’s not one of those skills you showcase in your job interview, but I seem to have this knack for religiously crawling the web in search for films I think I’d enjoy. Surprisingly, and to my great pleasure, a lot of these fringe interests I posses already have films about them. Awesome. However, there are a few that simply do not- or, have a film that doesn’t satiate my particular appetite.
So, for my sanity, I made a list of the topics I’d personally like to see filmed. And, in some cases, some topics I’d probably find gratification in filming myself.
Written below is that very list. Think of this more as a way of me getting the thoughts from my head to paper as opposed to a list of full-bodied explanations and fleshed-out ideas.
Demoscene. There are already a few demoscene documentaties out there. For example, The Demoscene Documentary is about the demoscene in Finland and Moleman 2 is a demoscene documentary focusing mainly on Hungary. While these are in fact good films, they each have a specific scope. From what I gather, the demoscene can be radically different from country to country, making it difficult to understand as a whole when only presented with a few of its parts. I’d propose an episodic piece showcasing the demoscene in a variety of countries – each country having its own segment. While these existing documentaries have touched on Finland and Hungary, there are still Germany, USA, Denmark, and Norway to consider (and probably others).
Bitcoin & Digital Currency. We’ve all heard of Bitcoin by now, especially as it makes waves at it’s current high value. However, Bitcoin itself has an interesting past and makes an interesting statement. If you do any detective work about how Bitcoin came to be, you will be sucked up into a mysterious story about how nobody knows the identity of the creator or what happened to him. The conspiracy theories are vast and plenty. We also touch on the interesting issue of an unregulated worldwide currency, governments attempting regulation, bitcoin-mining malware botnets, attacks on exchanges, etc. How about how crazy some people go with their mining setups? Dozens of caseless computers fillied with graphics cards- a cyberpunk daydream turned reality. How about using FPGAs and these new ASIC rigs? Now, that’s just bitcoin. There are numerous other digital currencies out there such as the newer litecoin, or even e-gold (Created in 1996). Digital currency has been around longer than most people think.
Cypherpunk. The cypherpunk movement does for cryptograhy what the cyberpunk scene did for personal computing. While cypherpunks have been around for decades, the interest within the scene has been renewed and pushed towards the mainstream more recently. Going back to “A Cypherpunk Manifesto” and the cypherpunk mailing list, we see early discussions of online privacy and censorship, paving the way for Bitcoin, Wikileaks, CryptoParty, Tor, 3D-printing of weaponry, etc.
Usenet. Started in 1980, Usenet is a system for users to read and post messages. Usenet can be seen as the precursor to internet forums, and is much like a Bulletin Board System in theory except it is distributed among many servers instead of a central authority. As time goes on, Usenet continues to grow in bandwidth usage, now generating terabytes of traffic a day. This is mostly through binary file transfers as opposed to messages. Despite many main ISPs deciding to remove Usenet access from their internet services, many still seek out paid access.
Pirate Radio UK. While Pirate Radio USA and Making Waves do a fantastic job at covering pirate Radio in the US, I haven’t seen much of an effort to show off pirate radio in the UK. From what I’ve gathered, there are an uncountable number of pirate radio stations across the pond, and it’s a different game when compared to the US. At the peak of pirate radio’s popularity, there were near 600 stations active in the UK while there are presently 150, mostly based in London. Here’s a mini piece from Vice.
Darknet. Not in regards to file sharing. More covering the darknet as a blanket term for an independant or ad-hoc network with some sort of disconnection from the internet. Considering topics like Hyperboria and CJDNS, Tor and the Deep Web, Meshneting for fun or necesity, Tin-Can, and so-on. As the hardware becomes less expensive and more devices have networking abilities, creating a scalable network becomes a more achievable task.
Dyson. I feel that James Dyson doesn’t get as much credit as a revolutionary engineer as he deserves. Dyson focuses on improvement: taking the wheel and making it better. No pun intended, but his first success was the creation of a fiberglass wheelbarrow that used a ball instead of a wheel. Afterwards, he famously created over 1000 prototypes for a new vaccuum cleaner using cyclone technology after noticing problems with his Hoover. Dyson repeatedly uses creative thinking and pulls inspiration from unlikely sources.
Raspberry Pi. While the Raspberry Pi was not necessarilly a unique and new concept, it was certainly one of the most well executed. We have seen other incarnations of plug computers such as the Beagleboard or the Sheevaplug, but the Raspberry Pi’s addition of integrated video sets it apart. And, at the price of $30, makes it incredibly affordable. Many would argue that what makes the Pi so special is the community that has formed around it, and not necessarily the hardware that ties it together. Everyone stretches their imagination and expertise: if it can be on the Pi, it should. Aside from the community, the Raspberry Pi Foundation has been done an incredible job at cultivating the technology and inspiring the next generation of young programmers and hardware hackers.
Kickstarter. There have been documentaries in the works that focus on crowdfunding, but I’m not as interested in the crowdfunding movement as much as I am in Kickstarter the company. While Indie GoGo has been around for a longer time, they do not seem to be held together as tightly. Kickstarter seems like not only an interesting company, but one that holds itself, and those who utilize its services, to a high standard.
QUBE. Here’s an odd one for that likely nobody has heard of. QUBE was the first interactive TV station, started in 1977 in Columbus, Ohio. Residents who subscribed to the cable service received a device that looked something like a calculator that allowed them to communicate back to the station during shows. Aside from the interactive feature, QUBE was on the forefront of pay-per-view programming and special interest content. QUBE soon went bankrupt and dissolved in the early 1980s. As a bit of an aside, I think I actually tried contacting the webmaster of that site a while back to ask if I could get a copy of the “QUBE DVD” for archiving but didn’t get a reply. Let’s hope he/she runs Webalizer or Google Analytics and sees some referrer traffic. Maybe it’ll be enough to spark a conversation.
So here ends my list. While the majority of these ideas are feasible, I can’t help but think a few might end up slipping too far and too fast into obscurity before their time. Other ideas on here might be too early in their lives. Doing something now, or even within the next decade, would only show a small part of the eventual picture.
Do I expect any of these to be made? Not particularly. But you never know.
Everyone gets lucky once in a while.
Friday, March 29th, 2013
If you collect as many things as I do, you end up with some stuff you’re not supposed to have. In this case, I’m not referring to stuff that is illegal or stuff that is unreleased. I’m talking about other people’s stuff. Personal stuff.
In a broad sense, the whole used market is a little bit bizarre when you look at it abstractly. As we live in a disposable culture, anything someone might buy has its own story. You don’t know how many hours were put into that dusty SNES with a five dollar sticker on it. How it contributed to sibling rivalries or became an item to bond over with the girl next door. We’ll usually never really know the extent of these stories.
Sometimes we accidentally inherit the stories.
In Philadelphia, there are many little second hand shops that line the grid-like streets. Tucked into corners, away from the tourist traps, these stores don’t feel like your normal thrift shops. These places lean a little more towards collectibles: antique books, crates of records, obscure (but not rare) VHS tapes- you get the idea. Some of these shops also sell photographs, but not of any famous attractions or curios of the city. They’re family photographs. Weird pictures of people posing outside their houses, sitting with their pets, or just acting goofy. Private pictures. Who would have ever thought they’d end up at a store somewhere?
So every one in a while, I buy a few. I have them scattered along the edges of my bedroom mirror. Who are these people? I’ll never know.
This concept doesn’t simply apply to pictures. From one auction, I got a lot of around thirty 7-inch tape reels. While a lot of them were simply recordings of the radio that could be played back for hours, some of them appeared to be homemade recordings. One I remember in particular appeared to be a recording of some sort of part, complete with almost unintelligible voices and faint background music. Something never meant to get out this far. A memory I own that isn’t mine.
Home movies are another area. On occasion, I’ve purchased VHS camcorders with tapes still inside. Rarely though will I find something captivating. Usually, there will be a short video of a newborn baby or the typical “I’m testing out the camera” tape where people pan around their living rooms.
Occasionally though, I’ll find something more interesting.
One flea market I frequent in Delaware usually has a lot of vendors from house clean-outs. They’re easy to spot: Giant rented truck with several dozen cardboard boxes packed full of everything imaginable. No rhyme or reason here: folded up clothes, kitchen appliances, weathered books, etc. Almost as though a family was packed away into boxes to be sold for five dollars a pop. Anyway, while most of these boxes are filled with junk, I’ve found my fair share of interesting objects from them. At one point, I came across a box of hand-labeled VHS tapes. I didn’t know what exactly they were, so I took them home and played them. I found myself with what appears to be recordings of an amateur band (or several) from the mid 1990′s.
So what did I do with them? After setting them to the side for some time, I decided it was best to transfer them and let people see them. Currently, I have one already online with more on the way. Here’s a link to go watch it. Who are these people? What’s the name of the band? I have no idea. The band might be named “Triple X” but nothing seems to enforce that. Maybe I’ll run across something as I keep going, or someone will stumble upon this video and recognize it. There’s a lot more footage to look through.
So this gives you something to think about. Be mindful of those little personal artifacts that you keep around. Those memories frozen in time. Who knows where they will end up one day.
And who knows if some 20-something punk will eventually put them on YouTube.
Wednesday, December 19th, 2012
Two weeks ago, a beggar approached me while I was washing my hands in the bathroom of a train station. He went on to tell me a story about his troubles and how he needed some money. I of course gave him a few dollars and we both went on with our days. The whole situation was eerie. Going to school in the city, I end up dealing with a broad range of people in any given day. This was different.
If you’re like me, then you spend a considerable portion of your day dissecting. Whether it be conversations you had last month with someone, physically dismantling a piece of hardware, or deconstructing an abstract idea- the method is the same. So as I walked up to my train platform, I couldn’t help but pick apart the scenario bit by bit.
Here’s a little run-through of what happened. I go to wash my hands. As I soap them up, a man comes over and says, “hey man, how you doing?” I return the pleasantry and go about washing my hands. He then starts up a story, just believable enough to hook you in. I get told that he’s here with his daughter and he’s been here a few days trying to get back home but the tickets cost $57. Last night, he was hit in the face with a gun (he shows me the bloody gash on his nose) and he wants to get out of this city. He reaches into his jacket and pulls out a stick of deodorant to show me that he’s trying to stay presentable and, in his words, not lying to me. I tell him I’ll give him a few bucks as I walk over to the hand dryer and hand over a little cash. He asks if I can spare ten dollars, I tell him no can do, and he rushes out of the place before I can even put my wallet back.
All of this happened in about 30 seconds. He made three dollars.
Let’s break it down now. The first thing that seemed a little off was that he showed up when I was the only one in the place. The way the bathroom is set up, he must have came from the stall area. Could he have been waiting until I was the only one left? Why he picked me is a mystery. I wasn’t dressed nicely in any sense of the word, and considering the place fills with business men in suits every few minutes I’m an odd choice. I don’t look like I have much walking around money. Moving on, he initiated the conversation in a friendly matter and did so as I was soaping up my hands. I couldn’t leave right then and there, I had to get the soap off my hands so I was essentially trapped for him to tell his story. The train ticket price is accurate, and we’re in the male restroom so his daughter doesn’t need to be around. That checks out. He’s dressed in reasonably worn clothes, nothing tattered but nothing too new. He looked a little scruffy, so that would be able to work with his story of being here a few days. The gun story raises a few questions. We’re in a relatively safe part of the city with police everywhere, for about 12 blocks in each direction. So if he was trying to get home, where did he get assaulted? Did he get robbed? If he got robbed, why would he spend money on deodorant? Either way, when a man approaches you out of nowhere in a confined bathroom, says the word “gun,” and then reaches into his jacket you tend to go along with what he says and not call him out on the spot. Next, he said that he wasn’t lying to me. If you ask me, that’s a pretty good sign that he is. His asking for more money is something I deal with on a daily basis from beggars and the homeless, so no surprise there. Lastly, his getaway was swift just as more people came into restroom.
At this point, you’re wondering why I’m bringing this up.
Under normal circumstances, I would just dismiss this as a normal random incident. However, as I reflected on his story I remembered one from two years earlier right outside the same building. Different guy, similar story. This guy, I passed once and he was talking to someone. When I came back around that way an hour or so later, he picked me to talk to next. He told me a story about how his daughter is in the hospital and he’s been stuck in the city for days. He’s just trying to get home so he can get cleaned up. As he started to get emotional, he asked me if I could spare, in his words, four to five dollars. I gave him a few bucks and he thanked me profusely before walking away. He’s in the city, so I will guess his daughter is at the nearby Children’s Hospital. However, why is he outside of this train station? The hospital has a train station two blocks away, while this one is about 10 blocks away. I saw him earlier, so I couldn’t have been the only one to stop for him in the last hour, and local train tickets are only between $4 and $8.
This started to get me thinking about social engineering more than I had in any recent time. Less am I seeing the traditional beggar simply asking for change and more am I getting a well rehearsed story. If we look back, the confidence trick has been used for decades to coax the unsuspecting into giving anything from money to information. Most people have cons aimed at them everyday, but shrug them off as they’ve now become part of everyday life.
But, is there anything we can learn from the creative ways beggars ask for money?
The things these stories had in common are the points to pay attention to. Starting with the approach, the wanting party makes the first move and starts the story out in a friendly way. This will hook in the target because they are wondering why they are being approached, and a guy with a smile can’t be bad right? The story then has an emotional element that makes the target want to help the wanting party. The story itself is well rehearsed, which makes it sound more natural. Speed is also crucial here as the wanting party will say everything he needs to before losing interest from the target. The wanting party will then identify exactly what they want and ask for it from the target specifically. Then after getting something, they make the clean getaway before anyone has a chance to think about what just happened.
We can draw parallels here with traditional stories of social engineering. If you think about any instance of phone phreaks calling up the phone company, you’ll see the same flow. They initiate a conversation politely and bring up a scenario that makes the telco worker want to help them out. They explain the issue swiftly and focus on the information they want. Whether they get what they want or not, they close the conversation quickly and move on.
It’s essentially the same set of fundamentals.
If anything, this whole scenario just got me thinking a little more on psychological manipulation. Hopefully, the next time you’re approached and asked for money, you’ll be thinking a bit too.
Monday, August 6th, 2012
This article was originally written for and published at The New Tech on July 8th, 2012. It has been posted here for safe keeping.
So maybe you want to be an archivist but don’t know where to start. I don’t claim to be an expert, but I have learned a few things going down this path that I can share. Let’s break this up into two main sections: digital media and physical media. No matter what you are archiving, you should first pick out what you’re going to save. You don’t have to put too much consideration into this step. You can be passionate about a subject you wish to preserve, be helping a group of people, or doing it for the hell of it. Archiving is at it’s base both a way to ensure survival and a way to fill a hole left forgotten.
In the digital world, you’re going to be focused on downloading, storing, and uploading. Let’s start with downloading as you’re going to want to get your hands on some media. I started on a Windows computer, downloading directly with a browser. You can get your hands on some stuff simply with a DownThemAll plugin and a lot of free time. For streaming content I turn to the video downloader plugin for Firefox or Replay Media Catcher. This lets you pull videos from all your sites like Vimeo or Youtube. Sometimes things aren’t as easy as clicking a file to download it. You may have to use download sites, ftp servers, Bittorrent, or something less standard. You never know. Get to know how to use jdownloader, an ftp client like Filezilla, and a Bittorrent client like uTorrent. You might find a whole slew of content on some obscure site and you need to have the tools to dig it out. Moving on to more Unix-like systems, learn all you can about wget, curl, grep, and bash scripting. I’m not going to cover how to use all of these tools, but with a little practice there are few things you can’t get when you use them in tandem. You would be surprised how simple it is to whip up automated processes that do everything you want with just a few sophisticated commands. Also, be on the lookout for more specified tools. For example, I found a fantastic tool for downloading Youtube videos called youtubedl. If there is something out there to be downloaded, there is usually a tool for the job.
When you get the data, you’re going to need to hold it. I was originally downloading everything locally, and still like to keep local copies of data I retrieve. Always keep your data on at least two drives, and preferably buy your drives in pairs so you can easily stick with this rule. You can never have too much storage. I currently have 15TB locally just for storing archived media. When it comes to other storage mediums, I’m not easily swayed. Data tape is expensive to adopt, and cloud storage lacks stability. In earlier days, I had only an 80GB drive, so I would back up to DVD+Rs. A lot of people will tell you that your burned media will go bad after about 6-10 years, but I have yet to have a disc become unreadable. I will say that I’ve had a lot of luck with Verbatim discs. I would coaster many discs by other brands when burning, but have only ever had one Verbatim fail on me. Stick with what your budget is, the price of hard drives are only going down, but if you’re a kid on a budget a spindle of DVDs can help in a pinch. Also, keep an eye on solid state drives. While I have yet to adopt them, they are the new thing in mass storage, though the price is still a bit steep.
So now you want to share your data. You have many options to consider. I’ve been using The Internet Archive most recently to place files which should be saved. Depending on your content, this may not be the best option for you. A few of the techniques I mentioned before to download from can be good options for quick data dispersal. For example, setting up a torrent for your files can be done in minutes, and fast FTP/HTTP servers can be rented for however much money you want to spend. The main points here though are longevity and redundancy. You want your files up for a long time, and you want them to stay online somewhere if one server takes a tumble. While torrents alone are terrible for longevity, they are great at getting data out fast. Combine this with a server, or a data hosting/streaming service and you have some type of redundancy. Always make sure your data is accessible.
So now you might want also want to save physical media. This can be as easy or as difficult as you want it to be. Saving your physical media is best done by making it digital. The shelf life of digital data is only going up these days while physical media like paper or tape only degrades. While I’m a fan of my physical media, transferring it to a digital format is the best way to share it and keep it alive.
When dealing with publications or photographs, you can generally get good results digitizing them with a decent scanner. I happen to be a fan of Epsons, but anything around $100 these days should be able to give you decent quality scans. As always, read the reviews just to make sure. If you’re feeling a bit more crafty, you can try your hand at creating a book scanning set-up. This can easily copy all of your publications quickly. After you make your scans, you can perform any type of compression you wish, and even take the resulting image files to assemble a PDF.
Video can also be challenging to save. Whether it be VHS, Laserdisc, or even DVDs, things can get messy. When dealing with your older analog media, you can find devices to digitize them. For example, you can get a capture card like a Canopis ADVC, or any number of DVD recorders on the market. There are also a slew of other little gadgets to clean up the video along the digitizing process. After you get the video converted, you can compress the raw capture down with a codec such as h264 to make the file more manageable.
Audio can be viewed in a similar fashion to video. You can easily pipe a tape or record player into a receiver and feed the output to a nicer sound card. Here, audio can be captured using a program like Audacity and saved as a lossless file or compressed with something like Vorbis or MP3.
With something to drive you, a little know-how, and a lot of time, you can easily start archiving the media in your world. Though it may be daunting at first, you can easily build as you go. Start small, and end up saving big.
Friday, July 6th, 2012
This article was originally written for and published at The New Tech on June 8th, 2012. It was a collaboration between Moonlit and myself. Enjoy
– Famicoman –
I think I’ve always been an archivist. A vital ally in the digital world. I’m the guy that saves a file from six years ago and pulls it up when people wonder whatever happened to it. I’m the guy who is going to make sure you can still find The New Tech episodes in 20 years, whether anyone would want to or not.
Some might call me a hoarder. Technically, by definition, they are correct. But just like how the word “hacker” has been usurped and manipulated by mass media, so has this term. The word conjures up television-tinted images of people living in trash and debris. It isn’t always like that. Things I save are organized, studied, and shared with the world, not rotting away in some closed off building. Not sealed from the world. If anything, I save because these items may be important to someone else. I’m not always part of the equation.
One could argue that you’re born with an archivist instinct. My philosophy has always been that to be able to look forward, we must look back. Besides digital data, I collect physical artifacts of our technological past. You can learn a lot about Blu-ray by looking at Betamax. This resonates in all archiving. There will always be someone wanting to know how we got to where we are, and hopefully he isn’t left with puzzled faces.
My digital archiving habits started with the world of internet video. In the beginning, I was maxing out my DSL connection and throwing videos up on to Google Video. That later evolved to the IPTV Archive and ultimately my current efforts with archiving Revision3 and a wider range of digital content.
Archiving isn’t an easy task. It isn’t just plucking files off of a download page. It’s mastering wget. It’s manipulating URLs. It’s fighting tooth and nail with a server for weeks, months. It’s talking to people, some of whom don’t want to be talked to. It really stops becoming a hobby and starts being a mindset. You begin to look at things differently, communicate differently, prioritize differently.
When I started out with the IPTV Archive, things were simpler. I could just go download episodes from show sites and be on my way. Now, I get to sites that don’t want to be downloaded in their entirety, and are definitely not set up to be. For example, last year I worked on backing up portions of good.net. After a while, they’d lock me out of their servers and the only way to keep downloading was to get a new ip address or wait the block out. This year with Revision3, their CDN throttles me, which ultimately just means I’m going to be waiting longer for their files. For whatever reason, corporations are not fans of someone downloading their entire library of material. Some entities are set up with commercial content, meaning eyeballs are numbers. If you mirror their content, they don’t get as many viewers and less viewers mean less money. In this light, I’m an enemy. I’m a thief. More importantly, I’m a necessity. Without me and those like me, entire cultures could be snuffed out like a flame. Many already have. It’s a strange feeling when you’re contacted by a show creator asking if he could download his episodes from you.
Archiving someone’s digital work is a weird concept to get your head around. Think if you were approached and someone wanted a copy of your entire website. Every little detail becomes theirs to thumb through, spread to others, and replicate for years after you’ve brought the original down. It’s weird, but it’s necessary. When someone years down the road says, “Man, I wish I could watch some old Revision3,” I’ll be there to say, “Here is a copy of all their content. Ever. Enjoy.”
It would be wonderful if it was all as easy as hitting a button and someone’s site downloads for you, but it’s never that simple. Most websites are not designed to be cloned so readily. They lack internal organization. When you peel back the layers, you’d be surprised to see how clumsily some large sites are maintained and held together with rubber bands and paper clips. Out of convenience, we can pull up the Revision3 example again. So many episodes are mislabeled, so many links are dead, the formats for each episode can vary at will, and there are so many episodes and full shows that are just outright gone to the point that if you had no prior knowledge, you wouldn’t know them to have ever existed. It feels like someone ripping pages out of a book and passing it off as if nothing happened.
You have to be one part resources, one part nice guy, one part detective, one part historian and one part hacker. You have to learn about the missing files, you have to track them down, you have to communicate with others who may have them, you have to have the storage and bandwidth to get them, and you have to do it all no matter what is trying to stop you. You have to do all these things, be all these people, at the same time. Sometimes, you have to do it as quickly as possible.
After you gather everything, there is always the question of how to preserve it and disperse it. You have to keep the files up, and make sure they’ll stay up. More importantly, you need to make sure that people can get to them without jumping through hoops. I’ve tried everything on this front. Torrent sites, ftp drops, streaming services, etc. but have ultimately cemented my toolbox with archive.org. For the uninitiated, the Internet Archive is a non-profit digital library offering permanent data storage. It’s big, and it’s growing every day. Anyone can upload content provided it’s licensed to be distributed openly. It makes things easy when I can be bringing things in through the front door, and flipping them right out the back to archive.org.
Digital archiving is a brutal but rewarding process that most people don’t see on the front lines. The next time you’re going to put something up online, take a minute to think about it. Your files are going to live much longer than you could imagine. You might as well make it easy for them to.
– Moonlit –
I’ve been a wannabe archivist for some time, but through a mixture of altruistic and less altruistic means, which just so happen to coincide.
On one hand I can’t bear the thought that there is so much recent history that may be, or in some cases already is, needlessly lost forever. Whether it be hardware, software or media, much of what is produced today has no vision for the future, it’s created, it’s used and, ultimately, it’s destined to be lost to whatever forces may eventually whittle its existence down to extinction. Failed storage media, the thought that “if I delete it, somebody else will still have it” or even just plain old waning interest in a flash in the pan which is no longer relevant tomorrow.
On the other hand I find it somewhat distressing that the content I grew up with, much of which came from TV rather than the internet, is very difficult to find. It’s just that little bit too old to have been swept up by a thousand torrent sites or archived to the ever expanding YouTube. It appears to me to exist in a narrow void between content old and popular enough to have made its way to public release via VHS or DVD as a nostalgia trip for the previous generations and the modern piracy scene, who will capture and upload almost anything as pristine digital clones of the broadcast content we enjoy.
Luckily, the two often overlap, so one can be the driving inspiration to accomplish both. But as long as the end result is shared, I don’t view the selfishness of the latter to be a problem. In fact it could very well be a boon, because if everybody was selfish enough to demand copies of the content they thought they’d lost, it means that content still exists, and given that everybody likes different things, meshing all that together would create a patchwork of content from that point in time.
Now, I’ve erred somewhat on the side of piracy so far, but I don’t mean to imply that I’m only interested in commercial media, or indeed in breaking the law. Before moving on though, I’d like to say that I think it’s a collossal shame that in order to capture and preserve certain parts of their lives, we often have to resort to methods which might seem unsavoury to those who disseminate that content. I don’t think it’s unreasonable to suggest that there are indeed large archives these days maintained by large media producers and broadcasters, yet those of us the content was created to be viewed by have no access. Whether that be through music or video clip copyright and licensing issues, laziness or cost, it’s still a great loss to us, and will continue to be until such a time that the content is opened up. This history should not suffer for the sake of a few contracts and a slew of many-digit bank balances. Please, somehow, let this content see the light of day again.
Whew. Got a little bit heavy there. User-created content, there’s a good place to jump to. Podcasts and video podcasts exploded in the mid-2000s along with the proliferation of high speed broadband and cheap consumer cameras. The trouble is, many of those shows had small numbers of fans who, along with the creators themselves, have moved on and left behind their content. This is an important chunk of internet history to me, it got me involved in a large percentage of what I do and who I speak to every day. That’s why I tried my best to help Famicoman build the IPTV Archive when we originally began trying to preserve this stuff. With my pitiful upload speeds and meagre hard drive space, which was frustrating enough, I helped transcode and re-host piles of videos. Those videos were then uploaded to DivX’s Stage6 video hosting site, all neatly encoded in DivX format, with their own special DivX player plugin. Then they took the service down. After countless weeks of pulling down videos, transcoding where necessary, uploading back to Stage6, straining my resources as I went, it was all for naught. Once bitten, twice shy, as they say, and since then I’ve been very wary of trying to do it again, but I’m slowly getting back on the horse. Lesson learned: redundancy. Redundancy and backups. Everywhere. Never rely on any single service to host this kind of stuff, it might be gone tomorrow.
Things get a bit weird somewhere in the middle of those two areas of content, though, with companies like Revision3. They began as a show, or later a couple of shows, which very much fit into the user created content model, a couple of guys with a camera drinking and talking out of their arses for 20-30 minutes. But then it changed. It became the Revision3 we have today, the corporate ad-driven sludge that could very well have been taken direct from the TV and uploaded wholesale to the internet. I’m not against making a profit on content, but stop sucking the soul out of it, it feels like it’s hurting the product. But I’m not here to rag on content creators, my point here is that no matter how poor, tasteless or boring I believe the content or its presentation to be, it still deserves to be archived. What’s crap for me might be gold to somebody else, and it’s not my job to curate history in the making. If I even began to try I would doubtlessly decide that something which later turned out to be pivotal in the future was actually the naffest thing to ever grace a visual display. I believe Jason Scott made a similar point about the preservation of GeoCities. Yes, it might be full of weakly written, poorly laid out, eye-damaging animated horribleness, but it’s historical weakly written, poorly laid out, eye-damaging animated horribleness. It’s a snapshot of what the internet was at that time, and as such it should not be forgotten. So go forth and grab it, grab it all, because as hard as it might be to believe, one day it will all be gone.
Thursday, June 14th, 2012
Online betas have always been a weird concept to me. Everyone gets hung up on the fact that they’re trying out the cool new thing, but few really think about exactly what they’ve got themselves involved with in the grand scheme of things.
I’ve been a member of a few online betas. Traditionally, those ones where you get invited by others who get invited by others, who- you get the idea. Initially, I can recall some of the bigger ones such as the Google Projects like Gmail, Google Voice, Google Wave, Google Plus, and Google Music (re-branded as Google Play). Other oldies like Pownce and Joost also stand out. In the last year, I’ve got into a few more such as Bottlenose, Spotify, Turntable.fm, Canv.as, and Letterboxd. So, let’s talk a bit about them.
Beta sites have both a cool factor, and a historic one. You have to admit, it can be awesome to be part of a new up and coming internet haven. You get in before all of your friends, you hand out invites as soon as you get them, and feel like a part of the action when really you’re just cementing the site. Some of these services actually turn out to be pretty cool. For example Pownce, comparable to Twitter (or more a Twitter on steroids), was a neat concept wherein you and your friends could share messages, files, and events online. Google services, specifically Wave with its far-out concept, have always been focused at changing the way you interact online. Joost was interesting in that it was one of the first services to use P2P technology to stream videos, doing so fairly well.
Joost’s use of P2PTV Technology
So we have these works of technology thrown up for a handful (relatively) of people to see, and share with others in a semi-exclusive fashion. These sites can often be gimmicky, but there are also some great unique ideas here. Often, they don’t take off. For every successful project like Gmail, I can think of a half dozen that lasted a few years and disappeared to the point where you’d be lucky enough to find someone who remembers any of them. If in five years I bring up how I was an early invitee to Google Wave, someone will probably accuse me of making the name “Google Wave” up. This frightens me a bit.
Here is where the historic perspective comes in. There were all these interesting concepts out there that just up and folded for one reason or another. One reason sites run betas is to use you as a guinea pig. Don’t feel violated or anything, many bigger sites do the exact same thing and you’ve probably never even realized. You navigate from page to page and little metrics start being generated on some back end interface that report how long you stay on a page, what links you click, etc. ”Beta” isn’t always a marketing word or tied to getting advanced access to a site. Yes, it can be both of those things, but it importantly represents the fact that you are in a testing ground and are undergoing the experimental procedures. A lot of people will offer feedback or outright complain about the service they are testing, and the company can either adapt or die. When they die, they’re gone. Most of these online niches are up for a few years, with the hype and buzz of their exclusivity, and end up vanishing overnight before ever hitting their full potential.
We can use this as a learning experience. I find some of the betas I’ve participated in recently are services I enjoy. Turntable.fm allows a bunch of people to come together in a virtual room and play music for each-other, taking the complexities out of online DJing and adding a rich social aspect. You can’t get the same feel from an Icecast server no matter how hard you try. Bottlenose tracks all of your social networking updates, generating statistics and even a “newspaper” from them. Letterboxd brings back the long lost Netflix friends feature in full force, so you can keep track of what your friends are watching and just how much they like it. What’s a better way to get mass movie recommendations?
My Bottlenose “Sonar”
These services are fun, and I hope they stick around. Even if they don’t, they become bricks in this strange failed beta wall and are akin to those little toy fads most of us were suckered into as children. Some of the older concepts for these sites still pop up again here and there. Joost’s P2P streaming might have been a little advanced for 2007, but now there are dozens of P2P video streaming sites and applications that you can download and use. Of all the ideas for this websites, some are just duds from the start, but others are simply ahead of their time.
Don’t be surprised if your friend messages you at 2 in the morning with an invite to a site that feels an awful lot like one you were part of six years ago.
Though the sites may die, their ideas don’t. They’re just in the process of being recycled.
Thursday, June 7th, 2012
Shinmaryuu is one of my oldest internet friends. The concept of “internet friends” was weird for me to wrap my head around at first, but is almost second nature to me now. I met Shinmaryuu online in 2006. It’s scary to think about that when you cut right down to it. Most of the people I talk to every day are those who I’ve met in the last two years, but internet ties are strong for some reason. There’s always a connection. There is always some web presence that you can hunt for if you master your search engines and old stomping grounds. There’s a beauty to that kind of interaction, but always the fear that it might one day be supplanted with an email from a long lost address bouncing back to your account
Shinmaryuu and myself were both regulars of the Hak.5 community and quickly became friends. We shared a general love of technology, in one form or another, as well as independent media. Back when I was just figuring out what an internet television show was, Shinmaryuu was deep into the scene and even developing his own audio/video content under the banner Random Acts of Anarchy (The video episode of which I still have).
Over the years, we’ve always had each others’ backs. Shinmaryuu contributed an article to the first issue of the Analog.5 ezine I cobbled together (painfully) in 2006. When Stage6 went under and The IPTV Archive went down with it, Shinmaryuu offered a helping hand and even gave the idea of hosting videos on blip.tv where they are to this day. He featured my video show Obsoleet on his Library of Geekdom website, and even ended up contributing a show segment to it (in episode four to be precise). We may not talk as much these days as we used to, but we still go back and forth through twitter and some other channels of communication here and there, talking of the good old days and what’s on the horizon. In all, we’re very similar. We are both content creators, but focused on community and creativity instead of the draw of money and power. You can track Shinmaryuu’s efforts from sXe 13 to Torn Red Sweatpants to Wicked 13 Productions, and in all those years he is still standing for producing the best content that he can. You can’t say the same for most people.
With my newest project on saving Revision3, Shinmaryuu and I have been chatting casually on a few topics, and a few days ago I inquired about some of the content he had collected in the past. I was sure that most of the stuff he initially saved had long since been lost to the troubles of unresponsive hard drives and disc rot, but I was pleasantly proven wrong. We got to talking, and he was kind enough to send me over a little care package of indie content spanning years and dating back to before I was putting bits in proverbial buckets.
What am I going to do with all these lovely discs? Archive them of course, and share them with everyone. Share them with you. All in good time, and all in proper form with disc images and cover/insert scans. Anarchivism.org will feature the Shinmaryuu Collection (working name, haha ) provided the discs are all out of print to the point that you can’t get your hands on them anymore (though I’ll link back to all the content creators I can find). The discs in general are not only beautiful in their physical nature, but by what they represent. Every hand cut booklet and labeled disc reflect the hard work of content creators before. They were here, and now their work has been shared with me.
So to Shinmaryuu, I offer the deepest thank you. Some things I thought I would never see have fallen gracefully into my lap, and I couldn’t be happier.
These days, Shinmaryuu is still going on strong. You can check out his website, Wicked 13 Productions, or head right to his youtube profile to see all the great videos he is putting out. Check out his content and leave him a comment, or send over a friendly shout on Twitter.
Tell him Fami sent ya.
Thursday, May 31st, 2012
Every once in a while, I find out a cool way to add some functionality to a standard piece of tech I have by feeding it some custom firmware. Custom firmware might be one of the most overlooked ways of enhancing your devices. Don’t let the idea of running third party software scare you. Though you do run the risk of bricking your tech, most of the procedures for installing custom firmware are well documented and take a matter of minutes.
Here are some of my favorites.
I have always had good luck with Philips brand DVD players for reliability, and most of them also tend to support DivX, which I also like. Anyway, most of these DVD players have region free codes, so you can hit some buttons on your remote and instantly play discs from any region. Taking this a step further, you can also find custom firmwares for your DVD players that you can flash via USB or a disc. These firmwares give you more options for subtitles, longer file name display, volume control, display options, CEC functionality and more.
If you have a Philips DVD player, check out this site for some excellent custom firmwares by vb6rocod. If you have another brand, do some Google searches. You never know who is out there messing with DVD players.
As I mentioned in previous articles, I have a Canon 600D. And as I also mentioned, I am a huge fan of the Magic Lantern firmware. The Magic Lantern firmware is atypical in the way that it doesn’t replace the stock firmware. Instead, it runs along side it offering an expansive selection of new features such as HDR video, increased shutter control, and other little gems like microphone levels. Something else that might comfort or annoy you: Magic Lantern runs off your SD card. So, you have to format each SD card you have the way ML wants you to. A pain, but it also ensures that if you need your (or not your) camera to appear stock, you can just pop out the card and be good to go.
The Magic Lantern firmware is available for most Canon DSLRs. While Nikon and Panasonic camera lines don’t have anything as advanced as ML, people are working on firmwares for Nikon cameras. Who knows where things will be in another six months.
About 2 years ago, I put Rockbox on my dying iPod Video. After a while, a bunch of little glitches in the Apple firmware got to become a daily annoyance and there were no updates in sight. Rockbox is simply fantastic. I can add files without having to go through iTunes, I can include my FLAC or Ogg files without needing to transcode, Last.fm support is included, I can completely customize my GUI. Rockbox is not just for your old iPod. It supports a slew of devices from the Archos players to the iRiver. Another little side benefit of having an iPod Video is that I can boot and run either the Rockbox firmware or the stock firmware if I ever needed as there is enough memory to include both of them. I haven’t yet, but it’s good to have that option.
If you are anything like me, you simply amass wireless routers overtime. Okay, you’re probably not like me, but who doesn’t have a WRT54G of some generation somewhere in their house? Why would anyone want to run custom router firmware? The options of course. You can turn a cheap $5 Linksys router from a yard sale into a fully functional high-end device. For example, maybe you want usage graphs, ipv6 support, advances qos, overclocking, daemons, higher TX power, etc.
I currently run an early WRT54G with Tomato and an original Fonera WAP with DD-WRT. If those don’t suit you, check out OpenWrt.
There are tons of other devices that can run custom firmware that I just haven’t got around to toying with or don’t have to play with. For example: the PSP, iPhone, AppleTV, WDTV, etc. all have the capability of running custom firmware to run third party applications and homebrew software. Some other platforms have the ability to work around or through stock firmware such as the original Xbox, Wii, and others. While I still use my softmodded Xboxes once in a while and my letterbomb’d Wii, they aren’t true custom firmware installations (and not the easiest processes either).
Simple hacking of your everyday technology can be a great way to add life to your aging toys, and make the experience of some of your newer ones much more enjoyable. So, load up the SD card and get acquainted with the secret menus. And please, don’t remove the drive before the update is complete.
Sunday, January 8th, 2012
I have a handful of reel-to-reel players. As an extension of this, I also happen to have around fifty or so reels to accompany the players. For the past few years, they haven’t been doing much besides serving as over-sized paper weights. Over the past couple months though, I have been recording things on to them. Music to be specific, all sorts of music.
I’ve been recording whole albums onto the reels of quarter inch magnetic tape. At 7.5 inches per second, the quality is pretty much indistinguishable from the MP3 player I record them from. At 45 minutes per side of tape, I can put at least one album per side (in most cases).
Why do all this? I like the process. It can be a bit of relaxation to string up a tape on a machine and hit the play button, watching the reels hit tension and hearing the music wind up. Also, it’s not the easiest thing to find pre-recorded music on reels. You can most likely find some jazz or easy listening albums on tape, but rock-oriented music is hard to get and can fetch a high price if you are lucky enough to locate it. As more collectors get at the harder-to-find tapes, recording yourself is pretty much the best way to go if you want your equipment used for anything other than show.