Android :: Inserting Large Volumes Of Data Into SQLite
Sep 2, 2009
I need to insert approximately one million rows of data (spread over 4 tables) - each row has one or two numeric fields, and two or three text fields (normally quite short). Single-column indexes on all the fields. After doing some tests on the emulator with a small test set, I extrapolated (assuming the last row will be inserted with a similar speed to the first row) my results to figure out that this would take about 15 hours (I have a Core 2 Duo running Vista). However, then I tried running the small test set on my Hero and I was surprised to see it run more than four times faster. I would guess it would take about 3 hours on the Hero. Alternatively, I could make the pre-populated database available as a download on the first run but this is likely to be a 120MB download. I have a few questions I'm hoping someone can help me with: 1. SQLite performance on the actual device being 4-5 times faster compared to the emulator - is this normal/expected? 2. Do the figures above generally sound fast/slow/normal (sorry this is so vague)? 3. From a user perspective - would it be best to provide a 120MB download or a 3 hour "first-time initialisation" step (plus 6MB download)?
View 14 Replies
Aug 14, 2010
I am an android application developer. I am developing an application which requires of me to use Sqlite database. I have implemented fetching the data, but i am facing problems when i try to insert data into the Sqlite database. The problem that i am having is that the new data i enter is not fetched, i.e nothing is new is being entered into the database.
this is the method i wrote in Data.java
myDataBase is an object of SQLiteDatabase
public void insertTitle(String Recipe)
ContentValues initialValues = new ContentValues();
initialValues.put(COLUMN_NAME,value);
myDataBase.insert(ZRECIPE, null, initialValues);
}
and i create an object "d" of it in Add.java, where i call the "insertTitle()" method. But nothing is inserted.
View 2 Replies
View Related
Oct 27, 2010
I am new to android development.currently i am facing a problem while inserting/retrieving image to sqlite database using android Code...
View 1 Replies
View Related
Jun 26, 2010
I will be making a mobile application in Android. My application is like Google Map's Get Direction feature, but a lot more complex, so I need to store data about points in the map. So I'm worried that SQLite may not be able to handle these large amount of data(or considering the limited storage of the phone). I have no background in SQLite so please bear with me.
View 3 Replies
View Related
Feb 19, 2010
I need to take a picture with the camera and, if depending on the picture size, rotate it before saving it into the gallery. I'm using
Intent imageCaptureIntent = new Intent(MediaStore.ACTION_IMAGE_CAPTURE);
imageCaptureIntent.putExtra(MediaStore.EXTRA_OUTPUT, uri);
startActivityForResult(imageCaptureIntent, IMAGE_CAPTURE);
To take the pic and save it to a temporary file. Then
Bitmap bmp = BitmapFactory.decodeFile(imagePath);
String str = android.provider.MediaStore.Images.Media.insertImage(cr, bmp, name, description);
To save it. This is the code i have tried to use to rotate the bitmap.............
View 1 Replies
View Related
Aug 20, 2010
This is my SimpleDBAdapter Class that encapsulates all the complexities of accessing the database and the inner class SimpleDBHelper takes care of CRUD operations,now the Problem that i am facing here is when i deploy the code, the tables were getting created, but the
i am unable to insert tht values in to the table, the id is returning -1 that depicts that there is an error,while inserting the values.
id = db.insert(TABLE_SIMPLETABLE_CLIENT1,null,contentvalues);
SimpleDBAdapter.java
import android.content.ContentValues;
import android.content.Context;
import android.database.SQLException;
import android.database.sqlite.SQLiteDatabase;
import android.database.sqlite.SQLiteOpenHelper;
import android.util.Log;
import android.view.ViewGroup.MarginLayoutParams;
public class SimpleDBAdapter {................................
View 2 Replies
View Related
Aug 11, 2010
Ive developed a DB for use with my app but I've realised that I actually want extend my db to incorporate images! I will be hosting the db online but for now I am using it locally for development purposes. To create my db I have been using SQLiteBrowser, which I think is a standalone version of the Firefox SQLiteManager plugin, however I cant see a way to insert an image. I recognise that an image will have to be transfered into a byte array and stored as a blob, but rather that developing this element of the db programatically, I was wondering if the was a gui tool to help me skip this developmental element.
View 1 Replies
View Related
Nov 19, 2010
I am trying to insert rows into my database, but nothing gets persisted. Here is my helper class:
package com.android.cancertrials;
import java.util.Calendar;
import java.util.GregorianCalendar;
import android.content.ContentValues;
import android.content.Context;
import android.database.Cursor;
import android.database.sqlite.SQLiteDatabase;
import android.database.sqlite.SQLiteOpenHelper;..................
View 1 Replies
View Related
Nov 24, 2010
How do I use an SQL statement on an sqllite database to insert the current date in UTC. I found the NOW function but what format is that in? This will be on mobile devices so everyone will have a different locale, however, I need a standard time format because the device will compare the dates with my server. Also, is there a way to automatically update a 'modified' field when the data in the row is changed like you can in MySQL?
View 2 Replies
View Related
Sep 9, 2010
I am trying to inject a long text entry into a SQLite database, in a TEXT field. This text has new lines in it (i.e. it spans multiple paragraphs). I can get the new lines to show up if I do the INSERT manually:
INSERT INTO "LOGENTRY" VALUES(5,40,'PLACE','line1
line2
line4
',1283990533315,'4A','TEXT','',NULL);
but if I have the equivalent text in a CSV file and attempt to .import it into the table, I get an error that it's expecting more columns than exist (as soon as the new line is encountered, the program assumes it's the end of the input and thus it's missing columns). Is this possible? Or is the only way to manually do each INSERT?
View 3 Replies
View Related
Jul 26, 2010
I will be developing a dictionary app for both Android and iPhone. The data will be embedded within the app, and it consists out of approximately 100000 words, with genus and plural form. Is it better to use a SQLite database or can I just stick to XML? Somehow SQLite sounds more efficient, but I thought let's just ask.
View 3 Replies
View Related
Jun 30, 2009
I have a large(ish) database - around 30MB, created offline with 400,000 rows. Doing a simple select (name LIKE pattern%) and then showing the query in a listview takes about 10 seconds. I tried indexing that field but no difference. If this is normal I will just use a raw data file and do a binary search myself. If this is not normal I hope someone has a hint or two to what might be wrong.
View 15 Replies
View Related
Jun 23, 2009
I'm looking for a way to insert data into a cursor that is separate from the SQL database it retrieves the rest of the information from. Is there any way to to this, or is there a different way to add more information to a list view item? What I'm trying to do is to use a date column for each entry in the list to calculate the number of days until that date (and then put that number in the list item). I know how to get the value, but I just cant find a way to put it into the list without it being in the cursor.
View 7 Replies
View Related
Feb 1, 2012
How is inserting ,editing and deleting data from mysql database using webservice...how is it do?
View 2 Replies
View Related
May 28, 2010
I guess many people already read this article:
Using your own SQLite database in Android applications: http://www.reigndesign.com/blog/using-your-own-sqlite-database-in-android-applications/comment-page-2/#comment-12368
However it's keep bringing IOException at
CODE:.............
I'am trying to use a large DB file. It's as big as >8MB. I built it using sqlite3 in Mac OS X, inserted UTF-8 encoded strings (for I am using Korean), added android_meta table with ko_KR as locale, as instructed above.
However, When I debug, it keeps showing IOException at
CODE:..............
I suspect it's caused by trying to read a big file. If not, I have no clue why.
I tested the same code using much smaller text file, and it worked fine.
Can anyone help me out on this? I've searched many places, but no place gave me the clear answer, or good solution. Good meaning efficient or easy.
I will try use BufferedInput(Output)Stream, but if the simpler one cannot work, I don't think this will work either.
Can anyone explain the fundamental limits in file input/output in Android, and the right way around it, possibly?
WITH MORE DETAIL:
CODE:...............
View 3 Replies
View Related
Jul 28, 2009
Im currently developing a system where the user will end up having large arrays( using android). However the JVM memory is at risk of running out, so in order to prevent this I was thinking of creating a temporary database and store the data in there. However, one of the concerns that comes to me is the SDcard limited by read and write. Also another problem that comes to mind is the overhead of such an operation. Can anyone clear up my concerns, as well as also suggest a possibly good alternative to handling large arrays ( in the end these arrays will be uploaded to a website by writing a csv file and uploading it).
View 1 Replies
View Related
Dec 10, 2009
My application needs to intensively manipulate (read-write) on some structured text data.The size of the data is significant 1Mb. And there is initial data available for the user to start with.My idea is to put this data as a file in the .apk. Then, on initial application launch to read this data and populate Android SQLite database with it. Then just work with this database. But after the database is populated the data file is no longer needed. And I'd like to remove it to free some memory. Alternate approach is to work with this data file instead of SQLite database. But I assume SQLite would work a magnitude faster then i/o on my data file..
View 16 Replies
View Related
Jan 21, 2009
My application may consist og 100Kb code and 800 Kb Database content. If I include a datafile with the 800Kb data and import it into an SQLite database under the initial run of the applcation, I cannot delete the data file afterwards and my application will take up 800 Kb unnecessarily. Is there a better way to include/import my data....? (I want my application to not depend on being online after download - so the data should be downloaded with the application.
View 14 Replies
View Related
Nov 3, 2009
From one activity, I want to pass a lot of data (about 1MB of Strings).I tried sticking it in Intent.putExtra(ArrayList<String>), but if I put in too much data, I get "FAILED BINDER TRANSACTION".What's the easiest way? I don't want to publish a service, or use the file system. I really want a pipe that can write data from one end and read it from the other end. I can handle the case where the starter Activity dies while the "startee" activity is trying to read from the pipe.
View 6 Replies
View Related
Jun 10, 2009
I am working on an android app that needs to act on a few data files totaling around 30MB. I put together a test and the emulator failed with OutOfDiskSpace. Debugging on a device failed with even a smaller data size. After reading through the google groups, it appears that the application size limit isn't stated anywhere and nobody from google has been forthcoming with specifics about this. Given that there are iPhone apps that are over 100MB in size, putting such a small limit on Android apps seems weird, except just for the fact that you have a relatively small amount of total available app storage space (< 100MB).What techniques do you use to deal with this limit? If you have an app that needs more than 10MB, do you put it on a web server and deal with downloading it the first time? If so, how do you handle access control so that only your app can get the data?
View 2 Replies
View Related
Feb 1, 2010
I need to be able to scroll through a list with (up to) 20K rows, backed by a cursor on a read-only db. Testing 20K rows on a G1, the query takes approx .02s regardless of table size, while binding the adapter to the list takes 4.5s. Note that this is before the view calls used in rendering. What makes the binding delay more troublesome is that it blocks the UI thread, and is incurred on every rotate. Combine these, and doing a rotate just after starting the bind results in a delay up to 9s.
I tried lazy loading with a base adapter, but that hits the same delay in the underlying cursor.getCount(), and the overall user experience isn't ideal. I also considered using an ArrayAdapter, adding synthesized objects from the cursor rows, but then I'd incur the overhead of creating up to 20K objects (not to mention the additional memory requirements).
View 18 Replies
View Related
May 30, 2010
when i download large data from website, i got this error information:
I/global (20094): Default buffer size used in BufferedInputStream constructor.
It would be better to be explicit if an 8k buffer is required.
D/dalvikvm(20094): GC freed 6153 objects / 3650840 bytes in 335ms
I/dalvikvm-heap(20094): Forcing collection of SoftReferences for 3599051-byte al
location
D/dalvikvm(20094): GC freed 320 objects / 11400 bytes in 144ms
E/dalvikvm-heap(20094): Out of memory on a 3599051-byte allocation.
I/dalvikvm(20094): "Thread-9" prio=5 tid=17 RUNNABLE
I/dalvikvm(20094): | group="main" sCount=0 dsCount=0 s=0 obj=0x439b9480
I/dalvikvm(20094): | sysTid=25762 nice=0 sched=0/0 handle=4065496
View 1 Replies
View Related
Oct 23, 2009
I want make it support multiple screens(small,normal and large).I am 100% sure the all of layouts are working perfectly now, but large screen,the problem is that all XML files of layouts in layout-large can't load,The platform always load default XML file(these are under layout folder) at large screen environment.
View 4 Replies
View Related
Sep 15, 2010
How to access existing data from sqlite and how to implement the data in list view in android.
View 1 Replies
View Related
Jan 6, 2010
After playing pandora, slacker or using other data intensive apps the radio locks up. The up arrow just sticks and the only recourse is to restart the phone. Anyone else experiencing this? I did find if I turn off bluetooth and wifi(even though im not using it) it doesn't seem to happen nearly as often. Maybe its a heat issue?
View 4 Replies
View Related
May 3, 2013
I'm trying use abootimg to extract the bootimg.cfg file but it keeps giving me the error:
Code:
~/Projects/dualboot_bt_android/BT5-GNOME-ARM$ abootimg -x data.img bootimg.cfg
data.img: Value too large for defined data type
I think I'm getting this because the data.img is 4.9 gbs in size, but I don't know how to resize the it...
Can't believe I overlooked it. I tried to extract it from the data.img instead of the boot.img like I was supposed to. No wonder it didn't work.
View 2 Replies
View Related
Jun 8, 2010
If I have a bunch of data that is never going to change (eg. an English language dictionary or the rgb values of a couple hundred color names), how do I use an SQLite database to store it? I know a database is faster than loading everything into memory when the app starts, but how do I make the database either the first time the app runs or "before" the apps ever runs?
View 2 Replies
View Related
Dec 16, 2009
I want to store location data in sqlite. A latitude coordinate is a double, with 15 point precision. As far as I can tell this corresponds with the 'REAL' datatype which is 8 bytes. The alternative I suppose would be to store it as a String, and simply convert it back into a double later. Does it make any odds which way I go? Are there differences in storage capacity / efficiency?
View 3 Replies
View Related
Sep 21, 2010
How to display data from sqlite in textview..
View 1 Replies
View Related
Oct 23, 2009
My Android application stores all user data in a Sqlite database. What are my options to backup/export/import/copy this data? I know I can easily copy the database to the SD card. I would also like to send the data to a network server. Are there any packages/classes available to facilitate getting sqlite information to/from a network server?
View 2 Replies
View Related
