Weeknotes: Drupal, NoSQL and data

It has been an interesting week which  I would rather forget. However I am not and it made me rethink quite a few assumptions. On the plus side, I’ve managed to write some of the documentation for the portal and map the processes which need to be coded next week. The major thing that I


Node, Twitter and storing data

I’ve been meaning to get into doing some work using Node.js for bits and pieces. Node offers some serious possibilities for server side programming without using cron jobs, creating event driven programmes that reduce load on the CPU (not using cron jobs) and for more agile and responsive backends to be created. After a conversation


JISCMail to migrate to new platform

I see from Twitter that JISCMail announced that they have funding for another year which is a good thing (in the Sellars and Yeats sense). It does mention that they are migrating onto a new platform (though it is inferred keeping the current mail system) but does not mention what this might be. The statement


Weeknotes: Storing and cleaning data

This week has been soft launching a CRM system for the Janet project. Hopefully these would be just user bugs but it has highlighted some interesting data cleaning issues. These are going to be inherent in the exchange of data between two or more systems, especially when one is a long-term pre-existing one. This has


Weeknotes: Open Correspondence toolkit and converting XML into JSON

I’ve been quiet for a bit though generally because I’ve been quite busy on projects and exploring ideas. After Book Hackday, I’ve written a post about beginning to develop the Open Correspondence toolkit for the Open Knowledge Foundation’s Notebook blog. I was also contacted regarding converting the TEI XML pages into JSON, which I am


Hacking the book – a quick overview of Book Hackday

I  went to the Book Hackday on Saturday that was supported and organised by the Creative Industries iNet; Electric Bookshop; Geekcamp; idno; Free Word; and Perera. I’d been looking forward to this event, though with some trepidation. It sounds like I took the sensible option of walking from the bus stop over to Clerkenwell but I do like walking


Bouncing like a bunny – initial thoughts on RabbitMQ

As part of the synchronisation part of a project, I’ve been trying to integrate systems together with a messaging system. This is not a trendy decision but one based on scalability and flexibility at the core. I wrote a micro-messaging server for my previous job which was dealing with a few hundred messages per day


CouchDb and Documents

I’ve been have a pre-Book HackDay hack at home (in between cat wrangling duties!) to use Couch DB in managing documents. Since it is a document centred database, no surprise there, but I’ve looking at it from the perspective of creating a system to allow to create their own documentation and make notes against the


Book Hackday and using Node with Redis

I’ve bumped into Marcus Povey in a few places but the last time was at the Oxford Geek Night. He kindly pointed me in the direction of Paul Squires of Perini when he heard that I wanted to organise a text hacking day. Paul is one of the people behind Book Hackday this coming Saturday


Scripting announced for Redis

I’ve just come across this blog post via the Redis Google group by Salvatore ‘Antirez’ Sanfilippo on introducing some scripting into the Redis key-vaue datastore. I’ve played around with Redis again as part of a logging system, having used it as a really basic queue system in a previous life. I may not play with