The High Scalability blog posted a link to Facebook’s new posts search system and the Facebook Notes written about it by a member of the engineering team. One of the sections mentioned the Wormhole publish/subscribe system that they developed to push data across multiple data centres in near real time. At a very basic level, […]
Category Archives: Programming
How not to build a messaging network
This talk was originally given at the lightning talks session of the Oxford Accu group. The updated slides are on my account on Slideshare. These are the fleshed out notes of a talk that I gave that evening based on experiences and experiments. It does contain some responses to questions and points raised. It is […]
A quick skim into mining Twitter data
This is a variant on the text prepared for a short talk at the Open Science evening at the Oxford e-Research Centre on Wednesday 27th November. Peter Murray-Rust also spoke at the event on the AMI software and the Chemical Tagger. This is a brief talk about some work that I have been doing in […]
Of darkened cameras and ghosts
Sometime ago, I was chatting with Alex Butterworth (currently working with Oxford ASPIRE project on the Box of Delights project) as I had bumped him into again by accident. I had recently read Beatrice Hitchman‘s novel Petite Mort or, a little death and had the notion of Pepper’s Ghost in my head. Doing some research, […]
Using Redis as a store
A few months ago I started on a work project to do some work on social media imports for a CRM. The idea was to query a contact’s Twitter stream, if it existed, and show it to screen. I updated the existing module to prevent it re-querying Twitter immediately so that the IP address was […]
More STOMPing with Drupal and Bean
Recently I scratched an itch and posted a module onto Drupal.org as a sandbox. It is perhaps slightly misnomered in “Bean Stomp” which is its development name. It is an integration of Jeff Mesnil’s Stomp over WebSockets JavaScript library which allows real time updating of a page without polling or similar overhead. I had been […]
Using RPC/Encoding on an Apache Camel route
I have been looking at Apache Servicemix for an integration project recently to route messages between services in different network zones and written in different languages together. The CXF project which is used to set up and wire together web services provides many methods of doing this and can either build a service from its […]
Reflecting on log driven programming
Antirez recently posted about “Log driven programming is a real productivity booster” on his blog. He mused on using notes to keep focus on the what your doing at the moment. Personally I’ve always preferred notebooks or the back of envelopes if that is the only thing to hand. His point still stands though. It […]
Showing error messages and redirecting in SugarCRM
I was working on applying some rules to SugarCRM this week. The logic hooks have allowed this to be build in before saving or deleting a file. Thinking about the UI and the actions, I wanted to create a set of redirects which would show an error message if something could not take place. Normally, […]
Parsing ActiveMQ statistics to check on queue health
In my last post about monitoring ActiveMQ, I looked at various advisory queues. I also mused on the possibility of reading the stats from the queues and topics and parsing them so that if issues occur, they can be dealt with quickly rather than waiting for an issue to be reported. Although this information is […]