mirrors/django
1
0
Fork 0
mirror of https://github.com/django/django.git synced 2025-08-04 19:08:28 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4

Fixed #17788 -- Added batch_size argument to qs.bulk_create()

Browse source 
The qs.bulk_create() method did not work with large batches together
with SQLite3. This commit adds a way to split the bulk into smaller
batches. The default batch size is unlimited except for SQLite3 where
the batch size is limited to 999 SQL parameters per batch.

Thanks to everybody who participated in the discussions at Trac.
This commit is contained in:
Anssi Kääriäinen 2012-04-29 04:22:05 +03:00
parent fcad6c48f0
commit 29132ebdef
8 changed files with 110 additions and 38 deletions
Download patch file Download diff file Expand all files Collapse all files

20
docs/ref/models/querysets.txt
View file

@ -1350,7 +1350,7 @@ has a side effect on your data. For more, see `Safe methods`_ in the HTTP spec.
bulk_create
~~~~~~~~~~~
.. method:: bulk_create(objs)
.. method:: bulk_create(objs, batch_size=None)
.. versionadded:: 1.4
@ -1372,20 +1372,12 @@ This has a number of caveats though:
* If the model's primary key is an :class:`~django.db.models.AutoField` it
does not retrieve and set the primary key attribute, as ``save()`` does.
.. admonition:: Limits of SQLite
The ``batch_size`` parameter controls how many objects are created in single
query. The default is to create all objects in one batch, except for SQLite
where the default is such that at maximum 999 variables per query is used.
SQLite sets a limit on the number of parameters per SQL statement. The
maximum is defined by the SQLITE_MAX_VARIABLE_NUMBER_ compilation option,
which defaults to 999. For instance, if your model has 8 fields (including
the primary key), you cannot create more than 999 // 8 = 124 instances at
a time. If you exceed this limit, you'll get an exception::
django.db.utils.DatabaseError: too many SQL variables
If your application's performance requirements exceed SQLite's limits, you
should switch to another database engine, such as PostgreSQL.
.. _SQLITE_MAX_VARIABLE_NUMBER: http://sqlite.org/limits.html#max_variable_number
.. versionadded:: 1.5
The ``batch_size`` parameter was added in version 1.5.
count
~~~~~