B d=@sdZddlmZmZmZddlZddlmZddlm Z ddl Z ddl m Z ddZd d Zd d ZdddZddZddZddZdS)z Utility functions for automatically opening and serializing a python object into a file using the latest pickling protocol. Can optionally compress the output if file_name ends with .gz. Also provides functions to read that object back. )absolute_importdivisionprint_functionN) show_string) smart_open)cPicklec CsZtj|}ytj||dStk rT}ztdt|t|fWdd}~XYnXdS)zt Wraps libtbx.smart_open. Parameters ---------- file_name : str mode : str Returns ------- file ) file_namemodezCannot open pickle file %s (%s)N)ospath expanduserrfileIOErrorrstr)rr erq/mnt/filia/a/genomebrowser/www/genomebrowser/fleming/tools/molprobity/modules/cctbx_project/libtbx/easy_pickle.py_opens rc Cs*t|d}t||tj}WdQRX|S)z Wraps pickle.dump. Parameters ---------- file_name : str obj : object Examples -------- >>> from libtbx.easy_pickle import dump, load >>> dump("output.pkl.gz", [1, 2, 3]) >>> print load("output.pkl.gz") [1, 2, 3] wbN)rpickledumpHIGHEST_PROTOCOL)robjfprrrr#s rcCst|tjS)z^ Wraps pickle.dumps. Parameters ---------- obj : object Returns ------- str )rdumpsr)rrrrr7s rTc Cs|rtjrt|d}|}WdQRXy t|Stk r}z>ddlm}ddl }|dd|dd|j t |fWdd}~XYnXt|d}|}WdQRXtj|d d St|d}t |}WdQRX|S) z Wraps pickle.load. Parameters ---------- file_name : str faster_but_using_more_memory : bool, optional Optionally read the entirety of a file into memory before converting it into a python object. Returns ------- object rbNr)Sorryz[Please check that you are not using an old version and reading a file from a new version. z (The file %s z#was saved with a version of Python z/that is not supported in this version (%s): %s)bytes)encoding) sixPY2rreadrloads ValueError libtbx.utilsrsysversionrload)rZfaster_but_using_more_memoryrsrrr&rrrrr(Es&   &  r(cCs t|S)z Wraps pickle.loads. Parameters ---------- string : str Returns ------- object Examples -------- >>> from libtbx.easy_pickle import dumps, loads >>> print loads(dumps([1, 2, 3]) [1, 2, 3] )rr#)stringrrrr#ksr#cOstd||fdS)z1 Dumps args and keyword_args to args.pickle. z args.pickleN)r)argsZ keyword_argsrrr dump_argssr,cCsddlm}m}t||rjxNt|D]>}t|trV|d}||||<||=|}t||||<q(Wt||rx$t t |D]}t||||<qWt |drt|j |_ t |drt |j drt|j j|j _t|tr|d}|S)zq Fix pickles from Python 2 Parameters ---------- p: pickle Returns ------- p: the fixed pickle r)MappingMutableSequenceutf8__dict___infolabels)collections.abcr-r. isinstancelistkeysrdecodefix_py2_picklerangelenhasattrr0r1r2)rr-r.keyZstr_keyirrrr8s&          r8)T)__doc__ __future__rrrr libtbx.str_utilsrlibtbxrr six.movesrrrrrr(r#r,r8rrrrs    &