Reuse StringGazetteer Object #188

Activity

1. luisenriqueramos1977

   added

   enhancementNew feature or requestNew feature or request

   on Apr 16, 2023
2. johann-petrak commented on Apr 17, 2023

   

   johann-petrak

   on Apr 17, 2023

   Collaborator

   More actions

   Thank you for this feature request!

   I think it would be a good idea to be able to store and load a gazetteer instance, however currently this is not immediately possible and the code would need some work to make it possible to e.g. pickle the instance.

   The main issue I see at the moment is that in order to be able to pickle the object, any lambdas must be replaced with callables that can be pickled, or by plugging into the pickle process by implementing our own __getstate__ and __setstate__ methods.
3. johann-petrak commented on Apr 17, 2023

   

   johann-petrak

   on Apr 17, 2023

   Collaborator

   More actions

   Actually, I think you could try doing this with the cloudpickle package:
   Install the package into your environment then do something like this to save and restore the gazetteer instance:

   Save:

   import cloudpickle
   with open("gaz1.pkl", "wb") as outf:
       cloudpickle.dump(gaz1, outf)
   

   Load:

   with open("gaz1.pkl", "rb") as inf:
       gaz1 = cloudpickle.load(inf)
   

   Does that work for you?
4. johann-petrak commented on Apr 17, 2023

   

   johann-petrak

   on Apr 17, 2023

   Last edited by johann-petrak

   Collaborator

   More actions

   Alternately, you could try using the dill package in a similar way.
5. luisenriqueramos1977 commented on May 30, 2023

   

   luisenriqueramos1977

   on May 30, 2023 via email

   Author

   More actions

   Dear Petrak, Thanks for the information, I was able to test it and get similar results for most gazetteers, but in one of them I got the following error: Cannot add gazetteer entry '', matches root node It seems there is a blank space in the list, but I used the same procedure for all of them, so I do not have idea how to solve this problem. Best regards Luis Ramos El lun, 17 abr 2023 a las 12:15, Johann Petrak ***@***.***>) escribió:

   …

   Alternately, you could try using the dill <https://github.com/uqfoundation/dill> package in a similar way. — Reply to this email directly, view it on GitHub <#188 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALS7GAAICVB276CYNHGSY2LXBUJ3FANCNFSM6AAAAAAXAEMJNA> . You are receiving this because you authored the thread.Message ID: ***@***.***>
6. johann-petrak commented on May 30, 2023

   

   johann-petrak

   on May 30, 2023

   Last edited by johann-petrak

   Collaborator

   More actions

   It seems there is a blank space in the list,

   What do you mean by that? Would you be able to cut the list down to the shortest list that produces that error and share it with me either heere, or by private email?