I am currently using Python's cPickle module to perform the following tasks:
1) Create +10,000 instances of a user-defined class.
2) Put all instances in a dictionary.
3) cPickle (using "dump(...)") ...

How to pickle Python class method types? It is not implemented in standard library. I found that I can use some third party modules like dill but how to do it with pickle only.
I prepared some test ...

I have been trying to append to a list inside of another file, I also am trying to make it so if it has more than 3 variables inside of it, it deletes the oldest added variable and adds the new data, ...

I have a load a very large datafile which is bigger than my RAM. I try to do that both with Pickle and HDF5 but the data are loaded in memory.
Is there a way to access data without load them on memory ...

I'm trying to use the Theano library in python to do some experiments with Deep Belief Networks. I use the code in this address: DBN full code. This code use the MNIST Handwritten database. This file ...

Python's copy_reg module allows to register custom reducers and constructors. Is it correct that I can only customize the unpickle behavior of objects that I serialized after I registered the custom ...

I would like to make this very clear so ill start off with the case i know so everyone knows exactly what i mean. When i'm storing just a single dictionary in a pickle file this is the method i use ...

I have previously saved a dictionary which maps image_name -> list of feature vectors, with the file being ~32 Gb. I have been using cPickle to load the dictionary in, but since I only have 8 GB of ...

I have my program setup so it takes user input and creates an object from it. Then the object is stored in a dictionary, which in turn is pickled to a .pkl file. Any new object written to this file ...

I am trying to store information in a pickle file and then continually append new information to this file without out over-writing any information. The only issue here is that if i close the program ...

I have a pkl file from MNIST dataset, which consists of handwritten digit images.
I'd like to take a look at each of those digit images, so I need to unpack the pkl file, except I can't find out how.
...

I have a dataset of images, of which I have stored all the features of images in a text file using CPickle. I have to load back the contents of the pickled file into a variable, But when I try to run ...

I have a soup from BeautifulSoup that I cannot pickle. When I try to pickle the object the python interpreter silently crashes (such that it cannot be handled as an exception). I have to be able to ...

I have a program that uses cPickle to dump large (several GB) files. It appears to work fine for smaller files (the largest file it worked for was 5.6 GB) but fail silently (!) on larger files.
Not ...

My machine has 16G RAM and the training program uses memory up to 2.6G.
But when I want to save the classifier (trained using sklearn.svm.SVC from a large dataset) as pickle file, it consumes too much ...

I currently have a project that runs for several days. As errors might occur in some steps of execution, I pickle critical steps to be able to restart the script at the correct step (so I don't have ...

I would like to implement a class (ideally a singleton) for which the state should be restored using cPickle mechanism at initialization stage. To do so I wrote the following snippet:
import cPickle
...