implement caching and hashing #2

Merged
charlesreid1 merged 19 commits from cache-and-hash into master 2018-08-02 17:59:45 +00:00
Owner

this PR mainly revises the algorithms for the functions that iterate over each item in a collection, and the functions that add documents to the search index.

the main changes to the functions iterating over each item in a collection:

  • better checking of pre-existing items
  • using sets to determine old/new/existing records

the main changes to the functions adding documents to the search index:

  • checking for existing version of document before adding
  • better logic to check/know when to check for another record

other minor changes:

  • comments/docstrings
  • updates to search.html template
this PR mainly revises the algorithms for the functions that iterate over each item in a collection, and the functions that add documents to the search index. the main changes to the functions iterating over each item in a collection: - <s>better checking of pre-existing items - using sets to determine old/new/existing records</s> the main changes to the functions adding documents to the search index: - <s>checking for existing version of document before adding - better logic to check/know when to check for another record</s> other minor changes: - <s>comments/docstrings - updates to search.html template</s>
Author
Owner

this is ready to go, except for the fact that... it doesn't actually use hashing yet. we're at 16 commits, all helpful to making this tool more functional. but we should still squeeze in hashing before we merge this.

this is ready to go, except for the fact that... it doesn't actually use hashing yet. we're at 16 commits, all helpful to making this tool more functional. but we should still squeeze in hashing before we merge this.
Author
Owner
import hashlib

hashlib.md5(u"hello world".encode()).hexdigest()
```python import hashlib hashlib.md5(u"hello world".encode()).hexdigest() ```
Author
Owner

more details... fixing alert boxes for control panel... so I got that goin for me

more details... fixing alert boxes for control panel... so I got that goin for me
Author
Owner

Aright forget about hashing content, just re-index everything. We'll come back to hashing soon.

Aright forget about hashing content, just re-index everything. We'll come back to hashing soon.
charlesreid1 closed this pull request 2018-08-02 17:59:45 +00:00
Sign in to join this conversation.
No Reviewers
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: charlesreid1/centillion#2
No description provided.