TwitBeeb 3

Posted by barnoid Thu, 22 Oct 2015 11:39:00 GMT

TwitBeeb
TwitBeeb on test at Bristol Hackspace, photo by John Honniball.

TwitBeeb is a BBC B microcomputer (vintage 1981) from which you can Tweet.

The Beeb itself was my main computer until 1994, I taught myself to program on it. A few years ago I pulled a rather scuffed up BBC out of a skip at Sussex University and took it home. Inside it had an add-on ROM board with several programs in ROM chips including a serial terminal emulator called Termulator. This allows it to connect to other computers via its serial port and for everything typed on the BBC's keyboard to be sent to the other computer which sends responses back to be displayed on the BBC's screen. It acts as what used to be called a "dumb terminal", just handling the input and output while a more powerful computer does the actual work. This was quite a common way of doing things back when computers were room-sized. Several terminals would connect to a large shared computer, possibly over phone lines using modems.

My first tests with the Beeb terminal involved connecting it to a Linux server using a cable I made from this recipe. It was a bit tricky to find 5 pin domino DIN plugs and note the warning about marking the top because you can plug them in either way up. I ran a text-based web browser called Lynx on the server via the BBC terminal and pointed it at Twitter. Termulator was not very good at handling the full Linux terminal and browser, it tended to crash and you can't use the arrow keys which makes using Lynx awkward. I did manage to send one tweet.

More recently, I got my hands on a Raspberry Pi. While considering what to do with it I remembered my BBC terminal experiments. Given that the Pi is cast from the same mould as the BBC, in terms of their educational intentions, they seem like an obvious pairing. They share a common heritage, in that the Raspberry Pi's ARM processor was designed by some of the same team who worked on the BBC Micro. I also enjoy the fact that in this case the terminal is physically far bigger than the vastly more powerful computer it connects to.

Some spec comparisons:

BBC Micro (Model B)Raspberry Pi (Model B)
Release Date1st December 198129th February 2012
CPU6502 2 MHz (8 bit)ARM1156 700 MHz (32 bit)
RAM32 KB256 MB (262144 KB)
StorageNone in this instance, except the 16KB ROMs containing the OS and terminal software.2 GB SD card

Twitter BBC early experiment.
The first experiment with the BBC B and Twitter via Lynx.

So due to Termulator's problems handling a full text-mode browser and because that would have been too complicated for use on the stand at an event like a Makerfaire I wrote my own specialised kind of Twitter client. The BBC's OS has a set of special bytes that you can send to control things like text colour and cursor position, I used these to make it pretty. It reminded me of the kind of programs that I used to write when I was 11, it was kind of odd to be doing that stuff in Ruby rather than BASIC.

Here is the code, on Github. It searches for a hashtag and displays some results on the screen below the title. At the bottom of the screen it shows a prompt very much like the BASIC one, you type your tweet there and press Return to send it. The hashtag is appended for you. The code stops you typing too many characters.

For TwitBeeb's first public outing at Derby Mini Makerfaire I had the Pi talking to the Internet using a USB Wifi dongle. I set up the network by connecting to the Pi's serial console from my laptop using a USB to serial converter and a Sparkfun level shifter. When the network was working I connected to the Pi with ssh and moved the USB to serial converter to the Pi and connected the serial end to the BBC (minus the level shifter). I then started Termulator on the Beeb, put it in BBC VDU mode and started the twitbeeb script on the Pi. I used the command line to redirect standard in and out for the script to the serial port device, having first set it to run at 4800 baud and several other parameters using stty.

It was quite popular at the Faire, mostly as a spectacle though. People were reluctant to come up with a witty tweet on the spot. It tweets from the @twitbeeb account, you can see people's tweets there. Most confusion came when there was a need to find the "delete" key, and also "@" hidden in plain view on a key of its own.

Update!

21/10/2015

Since its public debut at the first Derby Mini Maker Faire in 2012, TwitBeeb has been on show several times. I'm about to show it again at the fourth Derby Mini Maker Faire.

Here are some of its outings:

TwitBeeb at Brighton Mini Maker Faire 2012
TwitBeeb at Brighton Mini Maker Faire 2012, photo by Hollie Lubbock.

Bristol Raspberry Jam - August 2012

I set it up in the demo room with a bunch of other people's projects, then went off to watch some talks. About 20 minutes later someone came over to tell me that my project was on fire. It turns out the capacitor in the BBC's power supply had failed, as they will do after 30 years. Those capacitors are partly made of paper so they make a lot of smoke when they fail. It didn't get used much that day.

Brighton Mini Maker Faire - September 2012

Having replaced all the power supply capacitors, I showed Twitbeeb on the Bristol Hackspace stand at Brighton Mini Maker Faire 2012.

Bristol Mini Maker Faire - March 2013

The next outing was the first Bristol Mini Maker Faire, with a few tweaks to the code to make it compatible with Ruby 1.9.

This happened:

TwitBeeb and Eben Upton at Bristol Mini Maker Faire 2013
TwitBeeb and Eben Upton at Bristol Mini Maker Faire 2013.

Eben and Liz Upton of Raspberry Pi fame were the special guests at the Faire. I had a brief chat with Eben and he seemed to like TwitBeeb.

Bristol Hackspace for BV Open Studios - June 2013

Between the last show and this one Twitter decided to close down their old API. So I had to scramble to basically rewrite my API code the day before this event.

Derby Mini Maker Faire - October 2014

I implemented some new features for this outing. When idle it now automatically reloads the tweets (previously someone had to press Escape to trigger this) and it cycles between tweets, a screen of self description and the Derby Mini Maker Faire logo.

Bristol Mini Maker Faire - August 2015

On the Bristol Hackspace stand again at the second Bristol Mini Maker Faire. Swindon Hackspace had a lovely Teletype typing out tweets nearby, so people were able able to use TwitBeeb to send it messages.

Oh really?!?

There's more!

David James Lennon has created a TwitBeeb twin using my code from Github! He will be showing it this Saturday (24th October 2015) at the RISC OS London show, which happens to be the same day the original TwitBeeb will be at Derby Mini Maker Faire.

His TwitBeeb tweets to @burrBeep. I've added a new tweet search page to the rotation that displays the result of a search for that Twitter handle. Hopefully we'll be able to get some inter-show chats going.

I've added a few other nice features, including word wrapping for the tweet list. When I implemented word wrapping for Ode, my terrible poetry generator that I wrote on my BBC (the same one) when I was about 13, it consisted of about 120 horrible lines of BASIC. This time it's basically just one regular expression. What a difference 20odd years experience and a computer science degree can make!

Taking TwitBeeb to shows has become easier over time as I've gradually improved its reliability. Nowadays it's pretty much at the ideal point where once it's connected to the network it can be left to its own devices. It's nice to chat to people about it still though. What happens often at a Maker Faire is that a parent of about my age with small children in tow will spot TwitBeeb and say "Look kids! This is the computer I used at school!". The children will look nonplussed and may attempt to poke and swipe things on the screen before mashing the keyboard. Meanwhile the parent realises that it's actually showing real live twitter and asks how it works.

I expect I'll continue to take TwitBeeb to events, as long as the Twitter API keeps working at least. I'd like to take it to the big Maker Faire in Newcastle next year, and maybe to EMF Camp 2016 as well, if I can keep it dry.

Meteonome

Posted by barnoid Tue, 26 Aug 2014 21:37:00 GMT

Meteonome is a musical weather station and a platform for making music based on weather readings.

Its sensors are:

  • Barometric pressure (SCP1000)
  • Humidity (SHT25)
  • Temperature
  • Light level (Adafruit GA1A12S202)
  • Wind speed (Cup anemometer)
  • Moisture detection (rain) (conductive thread)
  • Noise level (also rain mostly) (piezo sensor)

It produces OSC packets two or three times per second containing:

  • /meteonome/barometer/pressure

    Barometric pressure in mbar, the extremes are probably 850 to 1050 or so. Possibly most interesting to look at whether the value is changing as that indicates a change in the weather.

  • /meteonome/barometer/temperature

    Air temperature in Celsius, sensor built into barometer.

  • /meteonome/hygrometer/humidity

    Air relative humidity (percent), sensor seems to go up to 102%.

  • /meteonome/hygrometer/temperature

    Air temperature in Celsius, sensor built in to humidity sensor, seems to differ from the other one by a couple of degrees.

  • /meteonome/light/light

    Light level reading, from 0 to maximum of 1023, overcast is about 500 or so. Note: Meteonome's lighting is picked up by this too, up to about 100 - 200.

  • /meteonome/wind/rev_count

    Rough revs count of cup anemometer since last read.

  • /meteonome/wind/revcountavg

    Moving average of last 100 anemometer reads.

  • /meteonome/rain/wetness

    Conductivity between two lengths of conductive thread, 0 to 1023, about 330 is fairly wet, probably higher for actively raining. Dew is about 10 - 20. Occasionally goes to 1 or 2 when dry due to noise.

  • /meteonome/rain/noise

    Average of several thousand readings of a piezo sensor which should pick up rain noise. It's not very sensitive, might produce tiny numbers in heavy rain.

OSC is commonly used for exchanging data between music oriented software and hardware. For instance in Pure Data the OSC documentation is here: http://en.flossmanuals.net/pure-data/network-data/osc/

Recent Developments in BBC B Hacking

Posted by barnoid Fri, 16 May 2014 21:39:00 GMT

BBC B running 2048

I've recently been experimenting at the Hackspace with UPURS and UPURSFS. These unfriendly strings of letters amount to a cable that links the BBC's User port to my laptop via a USB to serial converter, two ROMs that go in the Beeb and some Perl code that runs on my laptop. The upshot of which is that I can access parts of the filesystem of my laptop as if they were floppies on the BBC.

How it works

The cable and one of the ROMs are the UPURS part. The purpose of which is to allow the BBC's user port to be used as a fast serial port, much faster than the RS423 port on the back. It comes with a bunch of commands for shipping disk, tape and ROM images back and forth, but I was more interested in not having to use any of those.

UPURSFS works by using the Tube protocol over this serial link. The Tube protocol is usually used for communicating with second processor add-ons over the dedicated port on the bottom of the BBC. It basically diverts operating system calls and sends them to the second processor to handle. So nearly all operating system (* commands) and filesystem commands (not BASIC) are passed over to the computer on the other end of the serial link. The upshot of which is that you can implement a remote filesystem and access data stored on a modern computer directly from the BBC. No need for a floppy drive.

John at Bristol Hackspace was able to burn the two EPROMs for me and I made up the cable. We were able to verify that the ROMs work by the presence of their names in the output of *HELP. Having connected the cable, my next test was to upload the BASIC ROM by typing *UPXROM E (in this case) and observing the result in the serial terminal running on my laptop. The word "Roger" towards the end confirmed I was seeing the right stuff.

Next I downloaded the Perl TubeHost code. I set up a directory that will represent a disk and created a file in it called "test" containing the text "hello there". I modified the TubeHost code to look at that directory and then ran it with the option -U. Then by holding the U key and pressing Break on the BBC I put it in UPURSFS mode. I then typed *DCAT and my disk appeared. I typed *DIN 5 0 to select it and then *. to list its contents. There was my "test" file. I typed *TYPE TEST and "hello there" appeared on the screen. Success.

I wanted to try some real software, so I downloaded the SSD image of Eben Upton's version of 2048 that he recently implemented to observe 50 years of BASIC. I'd been wanting to try it on a real BBC since I saw it. I unpacked the SSD into my disks directory using MMB utils. Handily TubeHost respects .inf files that contain BBC file metadata. I was able to get the disk listing on the BBC so I typed CH. "2048" only to see the dreaded "Bad Program". It turns out that my serial link is not all that clean, occasional bytes are going missing or getting corrupted. It may be because I'm using the wrong type of USB to serial converter or it could be something else, it needs some debugging. As the corruption is random I figured I'd keep trying and hope for a try where nothing important gets broken. It took five or six goes.

So we played some 2048 (albeit with corrupted fonts). Ian got to 1024. The concept is proven, just need to iron out the kinks in the serial link.

Christmas Twitter Tree Lights 2

Posted by barnoid Sun, 22 Dec 2013 16:05:00 GMT

I recently bought a string of 50 individually addressable RGB LEDs from Embedded Adventures and so had to decide what to do with them. I decided it would be festive if they could reflect Twitter's current feeling about Christmas.

So I started Googling sentiment analysis and quickly discovered that Stanford University's Natural Language Processing Group has released the source and data for their sentiment analyser. When fed a sentence it outputs one of "Very negative", "Negative", "Neutral", "Positive" or "Very positive". It's pretty good but it's trained on movie reviews so it's not quite so accurate on tweets about Christmas. For example "Christmas time is defo the best time of the year !!" is classed as very negative.

The sentiment analysis is fairly slow. Much slower than the rate that the tweets come in, so I'm using beanstalkd for queueing. The tweets come in from the Twitter streaming API (filtering for "christmas" and "xmas"), get cleaned up, @usernames removed, hashes removed from hashtags, URLs deleted, then put in a queue. My desktop computer is the fastest in the house so it runs four instances of the sentiment analysis, pulling tweets out of the queue, processing them, pre-pending one of N, n, -, p or P and sticking the result in a second queue.

Raspberry Pi controlling the lights.
Raspberry Pi controlling the lights.

The lights themselves are controlled by a Raspberry Pi. They are connected to the SPI pins via a level shifter from Sparkfun. The pins on the Pi all work at 3.3V while the lights need 5V hence the shifter is needed. I'm using a fairly recent Raspian. To enable the SPI device /dev/spidev0.0 I removed the "blacklist spi_bcm2708" from /etc/modprobe.d/raspi-blacklist.conf. Then I just need to write a byte each for red, green and blue for each LED to the device file.

So the code on the Pi reads from the second queue, and shifts an LED on to the chain with a colour based on the initial sentiment letter: red for negative, green for positive, white for neutral, bright cyan for very positive and bright orange for very negative. The sentiment analysis processing can't keep up with the rate of incoming tweets so I've had it skip every other tweet.

The result is quite a pretty light display, though it's hard to say whether or not it's successful in reflecting the opinion on Twitter of Christmas.

The Code

This is the code that streams tweets from Twitter, cleans them up and puts them in a queue. It uses the tweetstream and beaneater gems.

#!/usr/bin/ruby

require 'rubygems'
require 'tweetstream'
require 'beaneater'

TweetStream.configure do |config|
        config.consumer_key       = "SECRET"
        config.consumer_secret    = "SECRET"
        config.oauth_token        = "SECRET"
        config.oauth_token_secret = "SECRET"
        config.auth_method        = :oauth
end

beanstalk = Beaneater::Pool.new(['localhost:11300'])
tube = beanstalk.tubes["tweets-in"]

count = 0

TweetStream::Client.new.track('xmas', 'christmas') do |status|
        tweet = status.text
        tweet.gsub!(/@.+?($|\s)/, "")
        tweet.gsub!(/^RT /, "")
        tweet.gsub!(/https?:.+?($|\s)/, "")
        tweet.gsub!(/[^\w\d \(\),\.\?\!\-\'\:\$\&\;\+]/, "")
        tweet.gsub!(/&/, "and")
        tweet.gsub!(/&.+?;/, "")
        if count % 2 == 0 then
                tube.put(tweet)
        end
        count += 1
end

beanstalk.close

This is the code that pulls tweets out of one queue, feeds them to the sentiment analyser and puts them in another queue with the result.

#!/usr/bin/ruby

require 'rubygems'
require 'beaneater'

beanstalk = Beaneater::Pool.new(['192.168.1.4:11300'])
tube_in = beanstalk.tubes["tweets-in"]
tube_out = beanstalk.tubes["tweets-out"]

IO.popen("./run_sentiment", "r+") do |sent_io|
        # Wait until the sentiment analyser has printed its startup text
        while not sent_io.readline.match(/EOF/)
        end

        while true do
                tweet_job = tube_in.reserve
                tweet = tweet_job.body
                sent_io.puts tweet
                sentiment = sent_io.readline.chomp
                case sentiment
                when "  Very positive"
                        sentiment = "P"
                when "  Positive"
                        sentiment = "p"
                when "  Neutral"
                        sentiment = "-"
                when "  Negative"
                        sentiment = "n"
                when "  Very negative"
                        sentiment = "N"
                end
                puts "#{sentiment} #{tweet}"
                tube_out.put("#{sentiment} #{tweet}")
                tweet_job.delete
        end

end

This starts the sentiment analyser telling it to accept input on STDIN. This is referenced as run_sentiment above.

#!/bin/bash

cd stanford-corenlp-full-2013-11-12
java -cp "*" -mx5g edu.stanford.nlp.sentiment.SentimentPipeline -stdin 2>&1

This code runs on the Pi, controlling the lights.

#!/usr/bin/ruby

require 'beaneater'

class Led

        attr_accessor :r, :g, :b

        def initialize(r = 0, g = 0, b = 0)
                @r = r
                @g = g
                @b = b
        end

        def out
                return "#{@r.chr}#{@g.chr}#{@b.chr}"
        end

        def to_s
                return "%02X%02X%02X" % [ @r, @g, @b ]
        end

end

LED_V_POS = Led.new(0,128,255)
LED_POS = Led.new(0,64,0)
LED_NEUTRAL = Led.new(8,8,8)
LED_NEG = Led.new(64,0,0)
LED_V_NEG = Led.new(255,128,0)

beanstalk = Beaneater::Pool.new(['192.168.1.4:11300'])
tube = beanstalk.tubes['tweets-out']

leds = []
50.times do
        leds.push Led.new
end

File.open("/dev/spidev0.0", "w") do |spi|

        while true do

                job = tube.reserve
                s = job.body[0]
                case s
                when 'P'
                        leds.unshift LED_V_POS
                when 'p'
                        leds.unshift LED_POS
                when '-'
                        leds.unshift LED_NEUTRAL
                when 'n'
                        leds.unshift LED_NEG
                when 'N'
                        leds.unshift LED_V_NEG
                else
                        leds.unshift Led.new
                end
                job.delete
                leds.pop
                #p leds

                50.times do |k|
                        spi.write leds[k].out
                end
                spi.flush

        end

end

Twitter Reflecting Christmas Tree Lights Controller

Posted by barnoid Sun, 22 Dec 2013 14:36:00 GMT

Twitter Reflecting Christmas Tree Lights Controller
A project to make a string of Christmas tree lights that reflect the current state of Twitter’s opinion about Christmas. More here: barnoid.org.uk/christmas-twitter-tree-lights

Twitter Reflecting Christmas Tree Lights

Posted by barnoid Sat, 21 Dec 2013 21:46:20 GMT

A project to make a string of Christmas tree lights that reflect the current state of Twitter’s opinion about Christmas. More here: barnoid.org.uk/christmas-twitter-tree-lights

Derby Mini Maker Faire 2013 Complete

Posted by barnoid Sun, 24 Nov 2013 14:05:42 GMT

From 10:45 unitl 17:30.

Derby Mini Maker Faire As it Happens

Posted by barnoid Sat, 23 Nov 2013 13:08:02 GMT

From 10:45am until 1pm at the second Derby Mini Maker Faire. Shot with my BeagleBone Black powered remote controllable time lapse camera.

Photobooth Mains Switches

Posted by barnoid Sat, 26 Oct 2013 12:40:46 GMT

Photobooth Mains Switches
This is the mains switching for my Halloween themed wedding photobooth. More information here: barnoid.org.uk/halloween-wedding-photobooth

Photobooth Control Box

Posted by barnoid Sat, 26 Oct 2013 12:40:00 GMT

Photobooth Control Box
This is the control box from my Halloween themed wedding photobooth. More information here: barnoid.org.uk/halloween-wedding-photobooth