Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Concurrent mapnik #1

Open
wants to merge 53 commits into
base: master
Choose a base branch
from
Open

Concurrent mapnik #1

wants to merge 53 commits into from

Conversation

ArneBab
Copy link

@ArneBab ArneBab commented Mar 20, 2019

No description provided.

babenhauserheide and others added 27 commits March 19, 2019 15:38
implement naive global mapnik cache
6766a0a
@ArneBab
ensure that each mapnik map is loaded completely before it gets used
acc6e95
@ArneBab
test disabling cache
a484d7f
@ArneBab
test disabling cache
f522f34
@ArneBab
use async_
7a4eae5
@ArneBab
timing
b62a160
@ArneBab
test
331b3a3
@ArneBab
try clearing the cache when using map
fa1e725
@ArneBab
exception off again
f298e5d
@ArneBab
timing
68dd1cf
@ArneBab
trace
0e61f22
@ArneBab
trace
e15afb1
@ArneBab
trace
8b5f88c
@ArneBab
untrace
8d130c5
@ArneBab
cache map per thread id
0194c2c
@ArneBab
threading.get_ident()
cbb9a80
@ArneBab
fix refactoring error
b1757b9
@ArneBab
add cleanup
6f213b8
@ArneBab
use the same ident for gc and cachekey
1a8066b
@ArneBab
cleanup what worked
f657568
@ArneBab
missed loading
33636ec
@ArneBab
do not check loading, because we now cache by process *and* thread
a5b0a9c
@ArneBab
remove lock, because we are now thread and process local
45b9ae2
@ArneBab
debug output
0bd5544
@ArneBab
only gc if more maps than active threads
7e4279a
@ArneBab
whitespace cleanup
0b4942f
@ArneBab
more cleanup
2de249d
@ArneBab ArneBab added the question Further information is requested label Mar 20, 2019
ArneBab and others added 24 commits March 22, 2019 09:27
@ArneBab
pre-create up to 3 map_obj in daemon thread.
ebe4d98
@ArneBab
typo
c47fd70
@ArneBab
debug output
615a23c
@ArneBab
actually use the cache
e4a6820
@ArneBab
missed self.
357b8bd
@ArneBab
use a larger caching queue
f91d292
@ArneBab
delay detection of no-longer-full cache for more than the time needed…
5e6fe37 
… to create a map
@ArneBab
only re-fill the cache while idle
1d89b14
@ArneBab
remove wrong return
c8a4088
@ArneBab
fix: actually update last activity time
1155ed3
@ArneBab
more global
318927b
@ArneBab
remove debug output
ca7ef94
@ArneBab
use concurrent_tile_creators as count for pre-generated Map objects
484f364
@ArneBab
fix naming
a570568
@ArneBab
use concurrent_tile_creators
dce3bfe
@ArneBab
debug
9800270
@ArneBab
adhere to concurrent_tile_creators and reuse_map_objects
6c5a559
@ArneBab
test
47b3308
@ArneBab
test again
9b43c34
@ArneBab
prepare two times as many Maps as there are concurrent processes
56bf1f5
@ArneBab
plan
fbd76dd
@ArneBab
test
a72b1e9
@ArneBab
add randomized wait to reduce the chance of lock blocking
e80368e
remove debugging output
40cf2f9
mjwint3r pushed a commit that referenced this pull request May 3, 2022
@mki-c2c
Merge pull request #1 from camptocamp/stale_error_handler
3c30347 
Stale tile error handler

test for latest version of pillow failed, see PR mapproxy#530
ArneBab pushed a commit that referenced this pull request Jan 17, 2023
@ingenieroariel
Merge pull request #1 from tomkralidis/updates-2020-02-05
a78ae77 
add docs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@ArneBab