woensdag 19 maart 2008

Some numbercrunching.

Today we will do some numbercrunching. Basic statistical nonsense, only for the people who are interested. First some current numbers:

- Itemcount: 93,445.
- Daily items: around 4,000 during weekdays, around 2,500 during the weekends.
- Feedcount: 183.

Our short-term (within two weeks) target is a feedcount of 250 or higher.

With this target we can calculate some future numbers:

- Daily items: 5,480 during weekdays, around 3,425 during the weekends.

Our search index currently measures 65.4MB which is a nice number. We also have 6.2% of items with the exact same title meaning they were taken from press lines or copied from each other. Over three-quarters of our index are items which describe the same event or story but are from different sources.

We currently index 2.8 items per minute from all around the globe. We have feeds in 13 languages from 21 countries.

What do all these numbers mean? They show our growth, in two-weeks I will post this post again with the new numbers, we can then show some cool growth statistics and we can make this a two-weekly event showing our progress in numbers.

We are planning to go into public beta when our index hits 250.000 items which we consider to be a crititical mass to offer enough data. At our current indexing rate the 250.000 items mark will be reached in and around 6 weeks and 2 days, sooner if we keep adding feeds and sources.

We'll see.

zondag 16 maart 2008

iPhone's and optimalisation.

The last few weeks have brought us a steady stream of improvements to the site, expect us to go private beta soon, pretty soon.

One of the big chances we did is our static content distribution. All javascript/stylesheets and images are now hosted on another domain. This domain handles all caching, gzipping and everything else to ensure you load as little kilobytes as possible. Using a second domain for serving static content also allows your browser to open up more concurrent connections which boosts loading times.

After these improvements we have achieved an 88% improvement in the size of the frontpage which is now only 2 - 5 kb, depending on the article sizes, to load if you have a primed cache (meaning you visited the site before). This is quite an achievement we are proud of!

On the domain we can also scale very well. We currently only host on Amsterdam based servers Our technology allows us to open up more servers around the globe and make sure you load content from the server which is the closest to you which also adds to improved load times.

The big news however is we are steamrolling ahead in deployment of one of our most promising branches. The mobile one.

We are developing an iPhone specific version, as well as a really simple ticker for older browser phones, a psp-version and an advanced version for the likes of Nokia phones or Opera based phones. All these versions are optimized to work on small screens and make the most of you mobile.

More on this, very soon. For now that's all the improvements we've made in the past two weeks. Stay tuned for more updates.

P.S. We have moved to blogger. We have done this to be able to keep our weblog running even if our servers become unreachable, which we don't expect as our servers have a 100% availability rate at the moment of this writing.

maandag 3 maart 2008

OpenSearch

Today we have added OpenSearch descriptions to our Feelibri search engine. This means you can now add our fabulous search application to every modern browser (Firefox, IE7 and so on) and can search from the easy premise of your search bar.

We also did some nice improvements. For example, if you like to keep track of your searches you can enable logging to your account (if you do not do this your searches will not be attached to your account). On the search history page you can then see how many links you visited and which of your searches became hot. We even supply you with a RSS or Atom feed of your latest searches. Just for the fun of it.

So nice stuff, we also improved error handling of the entire site and we passed the 40.000 items in our index mark!