Best query practices for SODA
Posted by Casey Trauer on 23 May 2013 03:58 PM

It is recommended that any software that queries the SODA database on a regular basis for the latest documents follow a few basic rules:

Keep queries sane. By this, we generally mean don't ask for too much in one query. From a time perspective, it is absolutely reasonable to query every five minutes, 15 minutes or hour for new documents. However, the time parameters in those queries should not ask for documents published in the day, week or month. Ask for documents published since the last time you queried. It is reasonable to have some overlap between queries.

Keep track of doc-ids. For every document that you retrieve, keep a local listing of the doc-id. You are charged for retrieving a document multiple times. Updates to a document are free. Updates will have different doc-ids, but they will have the same revision-id. Make sure your system does not download the same document repeatedly.

Store each document locally. All end-user applications should rely on locally stored versions of the data.

If you have any questions about how to query for information, let us know.

(1 vote(s))
This article was helpful
This article was not helpful

Comments (0)
Post a new comment
Full Name:
Help Desk Software by Kayako Resolve