Ted Leung on the air
Ted Leung on the air: Open Source, Java, Python, and ...
Tue, 06 Jan 2004
Presentations at a distance
Today at the Chandler staff meeting we were trying something new, little demos of what we've been working on. I was supposed to talk about the unit testing work that I've been doing on the Chandler repository. I attend the staff meeting via telephone, a disembodied voice to the rest of the group, although I would have flown down for today's meeting and a stopover at Macworld ;-). Today there was something wrong with the technology. I could hear what was going on, but nobody could hear me. Bad news for making a presentation. So when it came time for me to talk, and it became clear that the phones were busted, we yanked an IRC channel up onto the laptop being used for the demos and projected it. I then made my remarks via IRC. I've yet to go to one of those conferences where there's an IRC backchannel being displayed while someone is speaking, but I guess this is what happened next. It was weird to be typing and hearing audio reactions while it was happening. I guess if I had thought a little more clearly we could have fired up the iSights, but I don't know how loud the sound would have been. As the price of things like iSights comes down, I hope that we'll see more interesting applications of this technology to decentralized software development. Too bad Apple didn't announce the rumored multi person iChat AV today.

As far as the details of what I talked about: I've got tests for most of the repository API, there are a few areas that still need to be done. This should help us "keep the bar green" as we make additional changes to the repository, and will help us to find repository problems faster. Also, the tests are a decent set of examples for how to use the repository API's.

The other thing that I've been working on is a stress/performance test for the repository. Right now it consists of a bunch of RSS feed data that I downloaded onto disk and then jam into the repository. As a first cut it is interesting because it turned up some bugs. There's also a bit of work left to be done here to make real performance tests that yield commit throughput rates and so forth. We also need to do tests of different usage scenarios. But as of a few days ago, we can read about 700 RSS feeds (~20MB), containing almost 11000 RSS items and commit them into Chandler without falling over. I'm in the process of assembling a much larger set of RSS data - about 20000 feeds, that should get us closer to the state of the repository when someone has been archiving their RSS data.

[23:36] | [computers/internet] | # | TB | F | G | 2 Comments | Other blogs commenting on this post

Danny,

Here's the pointer to my test code:

http://cvs.osafoundation.org/index.cgi/osaf/chandler/Chandler/repository/tests/TestPerfWithRSS.py

that code is ripped and modified from ZaoBao which is a simple RSS Aggregator, whose source is here:

http://cvs.osafoundation.org/index.cgi/osaf/chandler/Chandler/parcels/OSAF/examples/zaobao/

Right now the data model for RSS barely includes all the data in an RSS 2 style feed.  It also doesn't take any advantage of features in the Chandler data model such as bidirectional references or text large objects. Probably what needs to happen is that we need to expand the data model to include information that is specified in Atom feeds as well as using bidirectional references.  For some pieces of Atom data, you'd like a way to reference data in other Chandler parcels like the contacts/address book.  Also, keep in mind that RSS aggregation isn't my official job responsiblity -- I just needed a convenient and plentiful source of data to stuff into the repository.  Stuart Parmenter, who owns Zaobao is using it as a testbed for our Agent/Event framework, and we hope to use it as good example application.

If you'd like to start a discussion on this, dev@osafoundation would be a great place to do it.

Also is there a place where we could find out about what you are doing?  I googled and tried searching your blog, but nothing leapt out.
Posted by Ted Leung at Thu Jan 8 01:33:04 2004

You can subscribe to an RSS feed of the comments for this blog: RSS Feed for comments

Add a comment here:

You can use some HTML tags in the comment text:
To insert a URI, just type it -- no need to write an anchor tag.
Allowable html tags are: <a href>, <em>, <i>, <b>, <blockquote>, <br/>, <p>, <code>, <pre>, <cite>, <sub> and <sup>.

You can also use some Wiki style:
URI => [uri title]
<em> => _emphasized text_
<b> => *bold text*
Ordered list => consecutive lines starting spaces and an asterisk

Name:


E-mail:


URL:


Comment:


Remember my info?


twl JPG

About

Ted Leung FOAF Explorer

I work at the Open Source Applications Foundation (OSAF).
The opinions expressed here are entirely my own, not those of my employer.

Creative Commons License
This work is licensed under a Creative Commons License.

Now available!
Professional XML Development with Apache Tools : Xerces, Xalan, FOP, Cocoon, Axis, Xindice
Technorati Profile
PGP Key Fingerprint
My del.icio.us Bookmarks
My Flickr Photos


Syndicate
RSS 2.0 xml GIF
Comments (RSS 2.0) xml GIF
Atom 0.3 feed
Feedburner'ed RSS feed

< January 2004 >
SuMoTuWeThFrSa
     1 2 3
4 5 6 7 8 910
11121314151617
18192021222324
25262728293031

Archives
2006
2005
2004
2003

Articles
Macintosh Tips and Tricks

Search
Lucene
Blogs nearby
geourl PNG

Categories
/ (1567)
  books/ (33)
  computers/ (62)
    hardware/ (15)
    internet/ (58)
      mail/ (11)
      microcontent/ (58)
      weblogs/ (174)
        pyblosxom/ (36)
      www/ (25)
    open_source/ (145)
      asf/ (53)
      osaf/ (32)
        chandler/ (35)
        cosmo/ (1)
    operating_systems/ (16)
      linux/ (9)
        debian/ (15)
        ubuntu/ (2)
      macosx/ (101)
        tips/ (25)
      windows_xp/ (4)
    programming/ (156)
      clr/ (1)
      dotnet/ (13)
      java/ (71)
        eclipse/ (22)
      lisp/ (34)
      python/ (86)
      smalltalk/ (4)
      xml/ (18)
    research/ (1)
    security/ (4)
    wireless/ (1)
  culture/ (10)
    film/ (8)
    music/ (6)
  education/ (13)
  family/ (17)
  gadgets/ (24)
  misc/ (47)
  people/ (18)
  photography/ (25)
    pictures/ (12)
  places/ (3)
    us/ (0)
      wa/ (2)
        bainbridge_island/ (17)
        seattle/ (13)
  skating/ (6)
  society/ (20)



[Valid RSS]

del.icio.us linkblog

www.flickr.com

Blogroll

java.blogs
Listed on BlogShares

Locations of visitors to this page
Where are visitors to this page?


pyblosxom GIF