154 Commits

Author SHA1 Message Date
de796880c5 Merge branch 'master' of github.com:charlesreid1/centillion
* 'master' of github.com:charlesreid1/centillion:
  update config_flask.example.py to strip dc info
2018-08-13 19:14:54 -07:00
f79f711a38 Merge branch 'master' of github.com:dcppc/centillion
* 'master' of github.com:dcppc/centillion:
  Update Readme.md
2018-08-13 19:14:07 -07:00
00b862b83e Merge branch 'master' of ssh://git.charlesreid1.com:222/charlesreid1/centillion
* 'master' of ssh://git.charlesreid1.com:222/charlesreid1/centillion:
2018-08-13 19:13:53 -07:00
a06c3b645a
Update Readme.md 2018-08-13 12:42:18 -07:00
878ff011fb locked out by rate limit, but otherwise successful in indexing so far. 2018-08-13 00:54:12 -07:00
33cf78a524 successfully grabbing threads from 1st page of every subgroup 2018-08-13 00:27:45 -07:00
c1bcd8dc22 add import pdb where things are currently stuck 2018-08-12 20:25:29 -07:00
757e9d79a1 keep going with spider idea 2018-08-12 20:24:29 -07:00
c47682adb4 fix typo with groupsio key 2018-08-12 20:13:45 -07:00
f2662c3849 adding calls to index groupsio emails
this is currently work in progress.
we have a debug statement in place as a bookmark.

we are currently:
- creating a login session
- getting all the subgroups
- going to first subgroup
- getting list of titles and links
- getting emails for each title and link

still need to:
- figure out how to assemble email {}
- assemble content/etc and how to parse text of emails
2018-08-12 18:00:33 -07:00
2478a3f857 Merge branch 'dcppc' of github.com:dcppc/centillion into dcppc
* 'dcppc' of github.com:dcppc/centillion:
  fix how search results are bundled
  fix search template
2018-08-10 06:05:44 -07:00
f174080dfd catch exception when file info not found 2018-08-10 06:05:33 -07:00
ca8b12db06
Merge pull request #2 from charlesreid1/dcppc-merge-master
Merge dcppc changes into master
2018-08-10 05:49:29 -07:00
a1ffdad292
Merge branch 'master' into dcppc-merge-master 2018-08-10 05:49:19 -07:00
ce76396096 update config_flask.example.py to strip dc info 2018-08-10 05:46:07 -07:00
175ff4f71d
Merge pull request #17 from dcppc/github-files
fix search template
2018-08-09 18:57:30 -07:00
94f956e2d0 fix how search results are bundled 2018-08-09 18:56:56 -07:00
dc015671fc fix search template 2018-08-09 18:55:49 -07:00
1e9eec81d7 make it valid json 2018-08-09 18:15:14 -07:00
31e12476af
Merge pull request #16 from dcppc/inception
add inception
2018-08-09 18:08:11 -07:00
bbe4e32f63
Merge pull request #15 from dcppc/github-files
index all github filenames, not just markdown
2018-08-09 18:07:56 -07:00
5013741958 while we're at it 2018-08-09 17:40:56 -07:00
1ce80a5da0 closes #11 2018-08-09 17:38:20 -07:00
3ed967bd8b remove unused function 2018-08-09 17:28:22 -07:00
1eaaa32007 index all github filenames, not just markdown 2018-08-09 17:25:09 -07:00
9c7e696b6a Merge branch 'master' of ssh://git.charlesreid1.com:222/charlesreid1/centillion
* 'master' of ssh://git.charlesreid1.com:222/charlesreid1/centillion:
  Move images, resize images, update image markdown in readme
  update readme to use <img> tags
  merge image files in from master
  fix <title>
  fix the readme to reflect current state of things/links/descriptions
  fix typos/wording in readme
  adding changes to enable https, update callback to http, and everything still passes through https (proxy)
  update footer repo info
  update screen shots
  add mkdocs-material-dib submodule
  remove mkdocs material submodule
  update tagline
  update tagline
  add _example_ config file for flask
2018-08-09 16:39:18 -07:00
262a0c19e7
Merge pull request #14 from dcppc/local-fixes
Fix centillion to work for local instances
2018-08-09 16:37:37 -07:00
bd2714cc0b
Merge branch 'dcppc' into local-fixes 2018-08-09 16:36:34 -07:00
899d6fed53 comment out localhost only env var 2018-08-09 16:25:37 -07:00
a7756049e5 revert changes 2018-08-09 16:23:42 -07:00
3df427a8f8 fix how existing issues in search index are collected. closes #10 2018-08-09 16:17:17 -07:00
0dd06748de fix centillion to work for local instance 2018-08-09 16:16:30 -07:00
1a04814edf
Merge pull request #9 from dcppc/ACharbonneau-patch-1
Update config_centillion.json
1.0
2018-08-07 16:09:45 -07:00
Amanda Charbonneau
3fb72d409b
Update config_centillion.json
I fixed it
2018-08-07 18:24:32 -04:00
d89e01221a
Merge pull request #8 from dcppc/dcppc-test
Fix the name of the milestones repo: 'dcppc-milestones' not 'milestones'
2018-08-07 14:59:06 -07:00
6736f3f8ad add centillion configuration json file 2018-08-07 14:54:56 -07:00
abd13aba29
Merge pull request #7 from dcppc/fix-docstrings
Fix docstrings
2018-08-07 14:43:42 -07:00
13e49cdaa6 improve docstrings on gdrive_util.py too 2018-08-07 14:42:19 -07:00
83b2ce17fb fix docstrings in centillion_search.py 2018-08-07 14:41:26 -07:00
5be0709070
Merge pull request #6 from dcppc/fix-docs
Move images, resize images, update image markdown in readme
2018-08-07 13:02:08 -07:00
9edd95a78d Merge branch 'fix-docs'
* fix-docs:
  Move images, resize images, update image markdown in readme
  update readme to use <img> tags
  merge image files in from master
  fix <title>
  fix the readme to reflect current state of things/links/descriptions
  fix typos/wording in readme
  adding changes to enable https, update callback to http, and everything still passes through https (proxy)
  update footer repo info
  update screen shots
  add mkdocs-material-dib submodule
  remove mkdocs material submodule
  update tagline
  update tagline
  add _example_ config file for flask
2018-08-07 12:50:29 -07:00
37615d8707 Move images, resize images, update image markdown in readme 2018-08-07 12:40:38 -07:00
4b218f63b9 update readme to use <img> tags 2018-08-03 15:56:49 -07:00
4e17c890bc merge image files in from master 2018-08-03 15:53:51 -07:00
1129ec38e0 update the readme 2018-08-03 15:49:46 -07:00
875508c796 update screen shot images 2018-08-03 15:49:12 -07:00
abc7a2aedf fix <title> 2018-08-03 15:45:56 -07:00
8f1e5faefc update readme to reflect latest 2018-08-03 15:38:23 -07:00
d5f63e2322
Merge pull request #1 from dcppc/fix-readme
fix the readme to reflect current state of things/links/descriptions
2018-08-03 15:28:51 -07:00
84e5560423 fix the readme to reflect current state of things/links/descriptions 2018-08-03 15:28:16 -07:00