o ȷe&@s*dZddlmZdZzddlmZWney!ddlmZYnwddlZddl Z ddl Z zddl m Z Wn eyCddlZ YnwzddlZWn eyWddlZYnwddlZddlZejddkrkefZneefZddZeZGd d d e jZGd d d Zd dZedkredSdS)a PickleShare - a small 'shelve' like datastore with concurrency support Like shelve, a PickleShareDB object acts like a normal dictionary. Unlike shelve, many processes can access the database simultaneously. Changing a value in database is immediately visible to other processes accessing the same database. Concurrency is possible because the values are stored in separate files. Hence the "database" is a directory where *all* files are governed by PickleShare. Example usage:: from pickleshare import * db = PickleShareDB('~/testpickleshare') db.clear() print "Should be empty:",db.items() db['hello'] = 15 db['aku ankka'] = [1,2,313] db['paths/are/ok/key'] = [1,(5,46)] print db.keys() del db['aku ankka'] This module is certainly not ZODB, but can be used for low-load (non-mission-critical) situations where tiny code size trumps the advanced features of a "real" object database. Installation guide: pip install pickleshare Author: Ville Vainio License: MIT open source license. )print_functionz0.7.5)PathNcCsdtt|dddS)Nz%02x)abshash)keyr B/var/www/ideatree/venv/lib/python3.10/site-packages/pickleshare.py gethashfile@r c@seZdZdZddZddZddZdd Zed fd d Z d dZ ddZ ddZ ddZ d%ddZddZddZddZd&dd Zd!d"Zd#d$ZdS)' PickleShareDBz7 The main 'connection' object for PickleShare database c Cst|ts t|}tjtj|}t||_|j s@z |jj ddWnt y?}z |j t j kr5WYd}~nd}~wwi|_dS)z: Return a db object that will manage the specied directoryTparentsN) isinstance string_typesstrospathabspath expanduserrrootis_dirmkdirOSErrorerrnoEEXISTcache)selfrer r r __init__Gs      zPickleShareDB.__init__cCs|j|}z |tj}Wn tyt|w||jvr/||j|dkr/|j|dSz|d}t| }Wdn1sGwYWnt|||f|j|<|S)z db['key'] reading rrbN) rstatST_MTIMErKeyErrorropenpickleloadsread)rr filmtimefobjr r r __getitem__Ys"   zPickleShareDB.__getitem__c Cs|j|}|j}|r|s|jdd|d}tj||ddWdn1s,wYz ||jf|j |<WdSt yX}z|j t j krMWYd}~dSd}~ww)z db['key'] = 5 Trwb)protocolN) rparentrrr'r(dumpr$st_mtimerrrENOENT)rr valuer+r3r-r r r r __setitem__ms     zPickleShareDB.__setitem__cCsL|j|}|s ||t|}||i}|||i|||<dS)z hashed set N)rrrr getupdate)rhashrootr r7hroothfiledr r r hset}s    zPickleShareDB.hsetTcCsX|j|}|t|}||t}|tur&|r!|turt||S||}|||S)z hashed get )rr r9 _sentinelr&hdict)rr;r default fast_onlyr<r=r>r r r hgets     zPickleShareDB.hgetc Cs||d}|t|r|dpd}|dr#|g|dd}i}|D]#}z |||WntyDtd|d||=Ynw||q'|S)z> Get all data contained in hashed category 'hashroot' as dict /*xxNCorruptz!deleted - hset is not threadsafe!)keyssortlenendswithr:r&printuncache)rr;hfileslastallr-r r r rAs     zPickleShareDB.hdictcCsl||d}i}|D]}|||||q |||d<|D]}|j|}|jdkr/q"|q"dS)z Compress category 'hashroot', so hset is fast again hget will fail if fast_only is True for compressed items (that were hset before hcompress). rEz/xxrHN)rJr:rOrnameunlink)rr;rPrRr-pr r r hcompresss     zPickleShareDB.hcompresscCs<|j|}|j|dz|WdStyYdSw)z del db["key"] N)rrpoprTr)rr r+r r r __delitem__s  zPickleShareDB.__delitem__cCst||jddS)z% Make a key suitable for user's eyes \/)r relative_torreplace)rrUr r r _normalizedszPickleShareDB._normalizedNcs4|dur jd}nj|}fdd|DS)z, All keys in DB, or all keys matching a globN*csg|] }|r|qSr )is_filer]).0rUrr r sz&PickleShareDB.keys..)rrglobglob)rglobpatfilesr rar rJs zPickleShareDB.keyscC t|SN)iterrJrar r r __iter__ zPickleShareDB.__iter__cCrgrh)rLrJrar r r __len__rkzPickleShareDB.__len__cGs&|si|_|D] }|j|dqdS)z Removes all, or specified items from cache Use this after reading a large amount of large objects to free up memory, when you won't be needing the objects for a while. N)rrW)ritemsitr r r rOs zPickleShareDB.uncache<cCsdgddgddg}d}d} z||}|WSty"Ynw||kr+t|t|||||7}|t|dkrD|d7}q)a Wait (poll) for a key to get a value Will wait for `maxwaittime` seconds before raising a KeyError. The call exits normally if the `key` field in db gets a value within the timeout period. Use this for synchronizing different processes or for ensuring that an unfortunately timed "db['key'] = newvalue" operation in another process (which causes all 'get' operation to cause a KeyError for the duration of pickling) won't screw up your program logic. g?rg?r1r"r)r&timesleeprL)rr maxwaittimewtimestrieswaitedvalr r r waitgets"  zPickleShareDB.waitgetcCs t||S)z, Get a convenient link for accessing items )PickleShareLink)rfolderr r r getlinks zPickleShareDB.getlinkcCs d|jS)NzPickleShareDB('%s'))rrar r r __repr__s zPickleShareDB.__repr__rh)ro)__name__ __module__ __qualname____doc__r!r/r8r?r@rDrArVrXr]rJrjrlrOrwrzr{r r r r rEs$     rc@s0eZdZdZddZddZddZdd Zd S) rxz A shortdand for accessing nested PickleShare data conveniently. Created through PickleShareDB.getlink(), example:: lnk = db.getlink('myobjects/test') lnk.foo = 2 lnk.bar = lnk.foo + 5 cCs|jtdSrh)__dict__r:locals)rdbkeydirr r r r!(szPickleShareLink.__init__cCs|jd|jdd|S)NrrrZ)r)rr r r r __getattr__+r zPickleShareLink.__getattr__cCs||j|jd|<dS)NrZ)rr)rr rvr r r __setattr__-szPickleShareLink.__setattr__cCs@|jd}||jdd}d|jdddd|DfS)NrrrEz;cSsg|]}t|qSr )rbasename)r`kr r r rb4sz,PickleShareLink.__repr__..)rrJjoin)rrrJr r r r{/s zPickleShareLink.__repr__N)r|r}r~rr!rrr{r r r r rxs   rxc Csddl}|d}t}ddl}t|jdkrt|dS|jd}|jdd}|dkrD|s1dg}||d}ddl}||dS|dkrj|j }||d}t |} | |D]\} } | || <q_dS|dkr||d}| t| d dS|d krttdSdS) Nrz pickleshare - manage PickleShare databases Usage: pickleshare dump /path/to/db > dump.txt pickleshare load /path/to/db < dump.txt pickleshare test /path/to/db r1r"r4.loadtestwait250test)textwrapdedentrsysrLargvrNpprintrmstdinr*evalclearrwrstress) rusageDBrcmdargsrrcontdatarvr r r main6s<          r__main__)r __future__r __version__pathlibr ImportErrorpathlib2rr$rpcollections.abcabccollections_abc collectionscPickler(rr version_inforrunicoder objectr@MutableMappingrrxrr|r r r r sB !      Z'