Comments on: SQLite – the ultimate data-smithing tool! http://blog.gobansaor.com/2008/04/26/sqlite-the-ultimate-data-smithing-tool/ A country datasmith. Sat, 10 Jul 2010 14:04:14 +0000 hourly 1 http://wordpress.com/ By: code43 http://blog.gobansaor.com/2008/04/26/sqlite-the-ultimate-data-smithing-tool/#comment-5584 code43 Sat, 21 Nov 2009 20:46:34 +0000 http://gobansaor.wordpress.com/?p=363#comment-5584 hi Tom, thanks very much for your pointer to CouchDB -- very helpful for those interested in NoSQL. That makes it very easy to import/export with SQLite, so hence with any arbitrary Python object via y_serial http://yserial.sourceforge.net y_serial is designed to encourage shard SQLite databases and using Python code to unify them as needed. CouchDB is more monolithic -- so integration is an option when a project needs to scale big-time. hi Tom, thanks very much for your pointer to CouchDB — very helpful for those interested in NoSQL.

That makes it very easy to import/export with SQLite, so hence with any arbitrary Python object via y_serial http://yserial.sourceforge.net

y_serial is designed to encourage shard SQLite databases and using Python code to unify them as needed. CouchDB is more monolithic — so integration is an option when a project needs to scale big-time.

]]> By: Tom Gleeson http://blog.gobansaor.com/2008/04/26/sqlite-the-ultimate-data-smithing-tool/#comment-5577 Tom Gleeson Sat, 21 Nov 2009 11:15:19 +0000 http://gobansaor.wordpress.com/?p=363#comment-5577 You should also look at supporting APSW http://apsw.googlecode.com/svn/publish/couchdb.html the CouchDB via SQLite Virtual Table would offer interesting possibilities; using CouchDB as Web based master but SQLite as the local engine? In general the APSW approach to SQLite is much better that the standard Python library as it recognises that SQLite is different from server based rdbms. I use SQLite combined with Python, combined with Excel as my main datasmithing platform. Tom You should also look at supporting APSW http://apsw.googlecode.com/svn/publish/couchdb.html the CouchDB via SQLite Virtual Table would offer interesting possibilities; using CouchDB as Web based master but SQLite as the local engine?

In general the APSW approach to SQLite is much better that the standard Python library as it recognises that SQLite is different from server based rdbms.

I use SQLite combined with Python, combined with Excel as my main datasmithing platform.

Tom

]]> By: Tom Gleeson http://blog.gobansaor.com/2008/04/26/sqlite-the-ultimate-data-smithing-tool/#comment-5575 Tom Gleeson Sat, 21 Nov 2009 10:38:52 +0000 http://gobansaor.wordpress.com/?p=363#comment-5575 Must give it a try, I particularly like the idea of SQLite as container for persisted dictionaries. Tom Must give it a try, I particularly like the idea of SQLite as container for persisted dictionaries.

Tom

]]> By: code43 http://blog.gobansaor.com/2008/04/26/sqlite-the-ultimate-data-smithing-tool/#comment-5574 code43 Sat, 21 Nov 2009 02:53:24 +0000 http://gobansaor.wordpress.com/?p=363#comment-5574 SQLite also has great support for BLOB which can be utilized for compressed serialized Python objects; see http://yserial.sourceforge.net Objects at that project are actually even more general: files and URL content -- but the clearly one of the most useful is dictionaries which is essential for schema-less data. Python dictionaries can contain arbitrary objects, and such dictionaries can be accessed simply through SQLite. The SQLite module is part of the standard Python distribution > v2.5, so there is no need for further installation, configuration, separate server process, etc. The y_serial module uses only standard issue components, so everything that Tom mentioned becomes easily Python accessible. SQLite also has great support for BLOB which can be utilized for compressed serialized Python objects; see

http://yserial.sourceforge.net

Objects at that project are actually even more general: files and URL content — but the clearly one of the most useful is dictionaries which is essential for schema-less data. Python dictionaries can contain arbitrary objects, and such dictionaries can be accessed simply through SQLite.

The SQLite module is part of the standard Python distribution > v2.5, so there is no need for further installation, configuration, separate server process, etc. The y_serial module uses only standard issue components, so everything that Tom mentioned becomes easily Python accessible.

]]> By: Tom Gleeson http://blog.gobansaor.com/2008/04/26/sqlite-the-ultimate-data-smithing-tool/#comment-5059 Tom Gleeson Thu, 16 Apr 2009 19:45:38 +0000 http://gobansaor.wordpress.com/?p=363#comment-5059 @devnull I don't use ODBC myself for connecting SQLite to Excel but I've used this http://www.ch-werner.de/sqliteodbc/ in the past for connecting from Win32 based Java apps via a JDBC/ODBC bridge and it worked fine, including when I tested it from an Excel Query. Tom @devnull

I don’t use ODBC myself for connecting SQLite to Excel but I’ve used this http://www.ch-werner.de/sqliteodbc/ in the past for connecting from Win32 based Java apps via a JDBC/ODBC bridge and it worked fine, including when I tested it from an Excel Query.

Tom

]]> By: devnull http://blog.gobansaor.com/2008/04/26/sqlite-the-ultimate-data-smithing-tool/#comment-5058 devnull Thu, 16 Apr 2009 18:52:20 +0000 http://gobansaor.wordpress.com/?p=363#comment-5058 i'd be intested to see how you can connect excel to sqlite via odbc. it's been impossible for me to get it to work.. i’d be intested to see how you can connect excel to sqlite via odbc. it’s been impossible for me to get it to work..

]]> By: SQLite and Excel as DataSmithing Tools | Chui’s counterpoint http://blog.gobansaor.com/2008/04/26/sqlite-the-ultimate-data-smithing-tool/#comment-5050 SQLite and Excel as DataSmithing Tools | Chui’s counterpoint Thu, 16 Apr 2009 01:28:43 +0000 http://gobansaor.wordpress.com/?p=363#comment-5050 [...] Gleeson aka Goban Saor has an interesting perspective on how well SQLite acts as a general table store which can then be used in OLAP and Excel. He describes the SQLite as the “MP3 for [...] [...] Gleeson aka Goban Saor has an interesting perspective on how well SQLite acts as a general table store which can then be used in OLAP and Excel. He describes the SQLite as the “MP3 for [...]

]]> By: Python the new VBA ? « Gobán Saor http://blog.gobansaor.com/2008/04/26/sqlite-the-ultimate-data-smithing-tool/#comment-3966 Python the new VBA ? « Gobán Saor Sun, 04 May 2008 22:19:51 +0000 http://gobansaor.wordpress.com/?p=363#comment-3966 [...] 2.5 now has embedded SQLite3 (ultimate datasmithing tool!) support (note PHP5 developers, SQLite3 not [...] [...] 2.5 now has embedded SQLite3 (ultimate datasmithing tool!) support (note PHP5 developers, SQLite3 not [...]

]]>