Tuesday, 15 January 2013

android - Parse from html and process massive amount of data to sqlite using php -



android - Parse from html and process massive amount of data to sqlite using php -

i have android app local transportation times such public bus, ferry , underground need work both online , offline.

when app needs working offline, need maintain updated database. however, not have access kind of webservice or database municipality. that, have prepared php script parse html content municipality's web page , exract times each number of public bus, each combination of underground(from where, where) , each combination of ferry(similar underground.). however, problem starting here. parsing these datas approximately 100k records , process them sqlite database working really slow.

i'm new processing huge amount of info , php. can take suggestions.

thanks,

couldn't server processing , cache db centrally. android app has download compressed version of database local utilize when offline. when app online 1 time again can sync server retrieve latest data. send info in batches. can have php script crawl , scrape info every day.

php android performance sqlite sqlite3

No comments:

Post a Comment