| Commit message (Expand) | Author | Age | Files | Lines |
|---|
| * | Garbage collect synchronized items from channels put/get queues.•••* fibers/conditions.scm (make-counter, %steps-till-gc, counter-decrement!)
(counter-reset!): Moved to new module, counter.scm.
* fibers/counter.scm: New file. Rename `%steps-till-gc' to
`%countdown-steps'.
* Makefile.am: Add counter.scm.
* fibers/channels.scm (<channel>, make-channel): Add new slots
`getq-gc-counter' and `putq-gc-counter'.
(put-operation, get-operation): Garbage collect synchronized items
from queues.
* fibers/deque.scm (dequeue-filter, dequeue-filter!): New procedures.
| Christopher Allan Webber | 2017-08-10 | 4 | -35/+90 |
| * | Update copyright headers, adding Chris Webber where appropriate.•••* fibers/conditions.scm:
* fibers/stack.scm: Update copyright headers.
| Christopher Allan Webber | 2017-08-10 | 2 | -0/+2 |
| * | Lighten up fibers by installing "catch" in scheduler•••This takes the load off of each fiber and speeds things up.
| Andy Wingo | 2017-08-06 | 1 | -21/+36 |
| * | Fix typo in schedule-task-when-fd-writable | Andy Wingo | 2017-08-06 | 1 | -1/+1 |
| * | Rebase fibers on top of schedulers and tasks•••This commit refactors fibers to be based on lighter-weight "tasks",
and makes the scheduler API more orthogonal. Now there are no more
fiber objects (although the fibers layer could re-add them if they are
useful), and fibers no longer have names (although again this could be
re-added at an upper layer). Also it's the current scheduler that's
bound by a parameter, not the current fiber, and as it's a thread-safe
parameter it doesn't need to be bound in each fiber.
| Andy Wingo | 2017-08-06 | 6 | -551/+428 |
| * | Garbage collect old condition waiters.•••* fibers/stack.scm (stack-filter!): New variable.
* fibers/conditions.scm (make-counter, counter-increment!)
(counter-reset!, %steps-till-gc): New variables.
(<condition>, make-condition): Update to take gc-step argument.
(wait-operation): Occasionally garbage collect old condition waiters.
| Christopher Allan Webber | 2017-07-31 | 2 | -5/+56 |
| * | Add block-asyncs in fiber->thread resume path•••* fibers/operations.scm (perform-operation): Block asyncs in resume
callback; otherwise the fiber doing the resuming could be scheduled
away.
| Andy Wingo | 2017-02-20 | 1 | -4/+6 |
| * | Fix deprecation warning in (fibers operations)•••* fibers/operations.scm: Use (ice-9 threads).
| Andy Wingo | 2017-02-20 | 1 | -0/+5 |
| * | Fix epoll wakeup•••* fibers/epoll.scm (epoll): Like a complete idiot, I broke epoll
wakeup. Fixed by calling expiry->timeout while epoll-state is
waiting.
| Andy Wingo | 2017-02-20 | 1 | -5/+7 |
| * | Update REPL support for run-fibers changes.•••* fibers/repl.scm (fibers): Update for new run-fibers changes.
| Andy Wingo | 2017-02-20 | 1 | -11/+26 |
| * | run-fibers returns when initial fiber finishes•••* epoll.c (scm_primitive_epoll_wait): Accept timeout in internal time
units instead of milliseconds. Avoid some overhead if the timeout is
zero.
* fibers/epoll.scm (epoll): Adapt to primitive-epoll-wait chance.
Change get-timeout callback to an "expiry" argument and an
update-expiry last-minute function. Tighten the window around the
"waiting" epoll-state.
* fibers.scm (%run-fibers): Remove current-read-waiter /
current-write-waiter parameterization, given that fibers individually
each have this parameterization.
(run-fibers): Add #:drain? argument.
* fibers/internal.scm (schedule-runnables-for-next-turn): Simplify a
bit, inlining scheduler-poll-timeout and adapting to epoll change.
(scheduler-work-pending?): New function.
(run-scheduler): Simplify finish? logic.
* tests/basic.scm:
* tests/speedup.scm: Update to drain where needed.
* fibers.texi: Update for new run-fibers termination condition.
| Andy Wingo | 2017-02-19 | 2 | -65/+71 |
| * | Lower preemption overhead•••* fibers/interrupts.scm (with-interrupts/sigprof):
(with-interrupts/thread-cputime, with-interrupts): Separate predicate
from interrupt routine, so that predicate can run off-thread.
* fibers.scm (%run-fibers): Adapt.
| Andy Wingo | 2017-02-17 | 1 | -7/+9 |
| * | Prevent spurious preemption•••* fibers/internal.scm (<scheduler>, make-scheduler):
(scheduler-runcount, run-scheduler): Maintain a count of run fibers.
* fibers.scm (%run-fibers): Only cause the current fiber to suspend if
the runcount isn't advancing.
| Andy Wingo | 2017-02-17 | 1 | -2/+14 |
| * | Take advantage of accept4 interface.•••* fibers/web/server.scm (client-loop): Setvbuf here.
(socket-loop): Use new accept4 interface.
| Andy Wingo | 2017-02-15 | 1 | -2/+2 |
| * | Tweak fibers web socket options•••* fibers/web/server.scm (client-loop): Move NODELAY things here and
actually enable NODELAY (before we were... disabling it???).
(socket-loop): Remove SNDBUF munging; let's assume it doesn't matter
rather than the reverse.
| Andy Wingo | 2017-02-15 | 1 | -7/+4 |
| * | Fix epoll-modify logic•••Because this case wasn't being hit before, there were bugs.
* fibers/internal.scm (<scheduler>): Remove active fd count; we'll add a
#:forever? option to run-fibers instead. Simplify sources.
(make-scheduler): Adapt.
(schedule-fibers-for-fd): Use resume callbacks, to allow for other
kinds of callbacks.
(scheduler-poll-timeout): Don't wait for active fd count to go to
zero.
(finalize-fd): Avoid mucking with hash tables from this potentially-gc
callback.
(add-fd-event-waiter): New function.
(resume-on-fd-events): Call new function.
| Andy Wingo | 2017-02-15 | 1 | -66/+52 |
| * | Add epoll-add*!•••* fibers/epoll.scm (epoll-add*!): New function, tries an epoll-modify!
then falls back to epoll-add!.
| Andy Wingo | 2017-02-15 | 1 | -1/+8 |
| * | Fix spurious epoll traffic•••* fibers/internal.scm (schedule-fibers-for-fd): Fix sense of the POLLERR
test. This was causing us to register and unregister our fd's with
the kernel all the time. This was a scalability bottleneck as adding
or removing an fd from an epoll set is serialized in the kernel
through one mutex (!!!!), the "epmutex"; because you can nest epoll
instances the kernel uses this to prevent cycles. Hint found in
Voellmy's paper on the MIO system for Haskell.
| Andy Wingo | 2017-02-14 | 1 | -1/+1 |
| * | Minor tweak to web server•••* fibers/web/server.scm (socket-loop): Move set-nonblocking! call to
client where it parallelizes better.
| Andy Wingo | 2017-02-14 | 1 | -2/+3 |
| * | Gracefully handle EPIPE•••* fibers/web/server.scm (client-loop): Avoid error when reading from
shut-down socket (EPIPE). Perhaps a read that gives EPIPE should
produce an EOF object anyway.
| Andy Wingo | 2017-02-12 | 1 | -3/+4 |
| * | Add concurrent web server•••* fibers.texi (Concurrent Web Server): New section.
* fibers/web/server.scm: Add web server that can run handlers
concurrently.
* examples/concurrent-web-hello.scm: New file.
* Makefile.am (SOURCES): Add (fibers web server).
| Andy Wingo | 2017-02-11 | 1 | -0/+282 |
| * | Add condition variable implementation•••* fibers/conditions.scm:
* tests/conditions.scm: New files.
* Makefile.am: Add new files.
* fibers.texi (Conditions): New section.
* fibers/timers.scm (sleep-operation): Rename from wait-operation.
* tests/foreign.scm: Adapt to sleep-operation change.
| Andy Wingo | 2017-02-11 | 2 | -3/+107 |
| * | Fix channel CAS logic•••* fibers/channels.scm (put-operation, get-operation): Fix bogus CAS that
could cause us to spin in an allocation loop.
| Andy Wingo | 2017-02-08 | 1 | -4/+4 |
| * | Better exception handling•••* fibers/internal.scm (create-fiber): Add a start-stack and a catch-all
around the fiber thunk. Note that in practice this needs the recent
post-2.1.6 patch in Guile (498f3f95684361f3591106a8f9cb9065fd649288)
to work well.
| Andy Wingo | 2017-02-07 | 1 | -4/+17 |
| * | Better findability for epoll extension.•••* fibers/config.scm.in: New file.
* Makefile.am: Wire up new file.
* env.in: Define FIBERS_BUILD_DIR.
* fibers/epoll.scm: Use (fibers config) to get dir for epoll extension.
| Andy Wingo | 2017-01-19 | 2 | -1/+33 |
| * | Randomized round-robin work sharing/stealing•••* fibers.scm (start-auxiliary-threads, stop-auxiliary-threads): Adapt to
scheduler-remote-peers change.
(spawn-fiber): Adapt to use choose-parallel-scheduler.
* fibers/internal.scm (<scheduler>): Add choose-parallel-scheduler
field.
(shuffle, make-selector): New helpers.
(make-scheduler): Adapt to initialize choose-parallel-scheduler
field.
(choose-parallel-scheduler): New public function.
(run-scheduler): Use fiber-stealer.
| Andy Wingo | 2017-01-18 | 1 | -28/+54 |
| * | create-fiber always captures dynamic state•••* fibers/internal.scm (create-fiber): Remove dynamic-state argument;
always capture the current dynamic state.
* fibers/timers.scm (timer-operation):
* fibers.scm (spawn-fiber): Adapt.
| Andy Wingo | 2017-01-08 | 2 | -11/+11 |
| * | Peer schedulers share a prompt tag•••* fibers/internal.scm (make-scheduler): Peer schedulers share a prompt
tag. This eliminates TOCTTOU bugs in suspend-current-fiber when
computing the suspension prompt tag.
(run-scheduler): Inline run-fiber and just use the same prompt tag for
all fibers.
| Andy Wingo | 2017-01-08 | 1 | -15/+17 |
| * | Fix race between with-interrupts and thread start•••* fibers/interrupts.scm (with-interrupts/thread-cputime): Fix race.
| Andy Wingo | 2017-01-08 | 1 | -4/+10 |
| * | Fix clock-nanosleep wrapper•••* fibers/posix-clocks.scm (clock-nanosleep): clock_nanosleep returns
the error value directly; it doesn't set errno. Fix.
| Andy Wingo | 2017-01-08 | 1 | -9/+7 |
| * | Add support for operations from foreign threads•••* tests/foreign.scm: New file.
* Makefile.am: Add new file.
* fibers/operations.scm (perform-operation): Support blocking operations
from foreign threads (without a scheduler).
* fibers/timers.scm (timer-sched, *timer-sched*, timer-operation): Add
support for timeouts that use an auxiliary thread instead of relying
on the current scheduler.
| Andy Wingo | 2017-01-05 | 2 | -2/+51 |
| * | Remove epoll dep on suspendable ports•••* epoll.c (scm_primitive_epoll_wake): New function.
(scm_primitive_epoll_wait): If the epoll was woken, drain the read
pipe directly.
(init_fibers_epoll): Adapt prototypes.
* fibers/epoll.scm (epoll-wake!): Use primitive-epoll-wake.
(epoll): Let primitive-epoll-wait handle wakeup.
| Andy Wingo | 2017-01-04 | 1 | -17/+5 |
| * | Centralize operation wrap handling•••* fibers/operations.scm (<base-op>): Update comment.
(perform-operation): Wrap resume proc before calling block function.
* fibers/channels.scm (put-operation, get-operation):
* fibers/timers.scm (timer-operation): Adapt to pre-wrapped resume proc.
| Andy Wingo | 2017-01-04 | 3 | -28/+28 |
| * | Prepare for support for blocking operations•••* fibers/operations.scm (perform-operation): Block function takes sched
and resume function, not fiber. Will allow blocking operations in the
future.
* fibers/internal.scm (add-timer): Rename from resume-on-timer; just
call a thunk after a time has passed.
* fibers/timers.scm (timer-operation): Adapt to resume-on-timer and
operation changes.
* fibers/channels.scm (put-operation, get-operation): Adapt to operation
changes.
| Andy Wingo | 2017-01-04 | 4 | -62/+58 |
| * | Fix ,spawn-fiber•••* fibers/repl.scm (spawn-fiber): Use spawn-fiber instead of create-fiber
to get right dynamic-state.
| Andy Wingo | 2016-12-30 | 1 | -1/+1 |
| * | Flesh out remote peers interface•••* fibers/internal.scm (<scheduler>): Add remote-peers setter, and expose
getter publically.
(make-scheduler): Change remote-peers arg to "parallelism", and use
setter to initialize remote peers.
| Andy Wingo | 2016-12-29 | 1 | -3/+14 |
| * | C-c works on threads stuck in epoll•••* epoll.c (scm_primitive_epoll_wait): Add wakefd argument, and use
facilities from git guile to ensure that C-c will wake a thread
sleeping in epoll.
(init_fibers_epoll): Declare additional primitive-epoll-wait arg.
* fibers/epoll.scm (epoll): Tell Guile about the wake fd.
| Andy Wingo | 2016-12-29 | 1 | -1/+3 |
| * | Fix yield-current-fiber•••* fibers/internal.scm (yield-current-fiber): Fix to allow
yield-current-fiber to be run from an interrupt tick, when it's
possible that no fiber is current.
| Andy Wingo | 2016-12-23 | 1 | -5/+8 |
| * | Enable work stealing in run-scheduler•••* fibers.scm (run-fibers): Store result in an atomic box, given that the
initial fiber could migrate.
* fibers/internal.scm (<scheduler>): Add remote-peers field.
(<fiber>): Add set-fiber-scheduler!.
(make-scheduler): Adapt to <scheduler> change.
(scheduler-finished?): New helper.
(scheduler-poll-timeout): Take a finished? predicate to know when to
wait and when to return directly.
(schedule-runnables-for-next-turn): Plumb finished? predicate
through.
(run-scheduler): Avoid returning until finished? is true. Refactor to
add work stealing.
(steal-fiber!): New helper.
| Andy Wingo | 2016-12-22 | 1 | -37/+53 |
| * | Get current scheduler from current fiber•••* fibers.scm (run-fibers): Refine #:keep-scheduler? default.
(current-fiber-scheduler): Rename from require-current-scheduler, and
use the current fiber to get at the scheduler.
(spawn-fiber): Let create-fiber handle dynamic state shenanigans, as
it needs to ensure that current-fiber is bound in the thunk.
* fibers/internal.scm (with-scheduler): Don't parameterize
current-scheduler, as that binding for a given scheduler needs to
change over time, and the with-dynamic-state prevents this from
happening.
(schedule-fiber!): Wake schedulers not on the current kernel thread.
(run-fiber): Don't parameterize current-fiber; it's lost across the
with-dynamic-state.
(create-fiber): Instead set current-fiber inside the
with-dynamic-state.
(suspend-current-fiber, yield-current-fiber): Get current scheduler
from current fiber.
| Andy Wingo | 2016-12-22 | 1 | -27/+25 |
| * | run-scheduler pops one fiber at a time•••* fibers/internal.scm (run-scheduler): Pop one fiber at a time.
| Andy Wingo | 2016-12-22 | 1 | -13/+15 |
| * | Rework runqueue as pair of stacks•••* fibers/stack.scm: New file.
* Makefile.am: Add new file.
* fibers/internal.scm: Rework runqueue to have separate current and next
stacks. We want to expose the current runqueue so that remote
schedulers can steal work, but we also need to know when we flip the
next runqueue to the current runqueue so that we can pull in
additional wakeups from epoll and timers.
| Andy Wingo | 2016-12-22 | 2 | -23/+92 |
| * | Beginnings of work stealing•••* fibers/deque.scm (update!): Don't spin if value didn't change.
(dequeue!): New function.
* fibers/internal.scm (schedule-fibers-for-fd): Add comment about
stealing and fd's.
(steal-work!): New internal function.
| Andy Wingo | 2016-12-21 | 2 | -4/+26 |
| * | Add REPL commands to manual | Andy Wingo | 2016-12-16 | 1 | -1/+1 |
| * | Factor interrupt generation to separate facility•••* fibers/interrupts.scm: New file.
* fibers/internal.scm (<scheduler>): Remove Hz field and adapt users.
(run-scheduler): Remove preemption; (fibers) handles this now.
(yield-current-fiber): New primitive.
* fibers.scm (run-fibers): Use interrupts module and wrap run-scheduler
in `with-interrupts'.
* Makefile.am: Add new file.
| Andy Wingo | 2016-12-16 | 2 | -50/+105 |
| * | Add posix-clocks.scm•••* fibers/posix-clocks.scm: New file.
* Makefile.am: Add new file.
| Andy Wingo | 2016-12-16 | 1 | -0/+166 |
| * | Add support for preemption•••* Makefile.am: Add new test.
* TODO.md: Remove stale TODO entries.
* fibers.scm (run-fibers): Add #:hz parameter.
* fibers.texi (Design): Mention that we support preemption.
(Using Fibers): Update for preemption.
* fibers/internal.scm (<scheduler>): Add hz field.
(make-scheduler): Add #:hz initarg.
(maybe-preemptive): New helper.
(run-scheduler): Use maybe-preemptive.
* tests/preemption.scm: New test.
| Andy Wingo | 2016-12-12 | 1 | -18/+49 |
| * | Error on attempt to suspend unsuspendable continuations•••* fibers/internal.scm (suspend-current-fiber): Error if the fiber is not
suspendable.
| Andy Wingo | 2016-12-12 | 1 | -2/+9 |
| * | Import (ice-9 threads) to avoid deprecation warnings•••* fibers/internal.scm:
* fibers/repl.scm: Explicitly import (ice-9 threads).
| Andy Wingo | 2016-12-12 | 2 | -0/+2 |
| * | Merge pull request #4 from vyp/typo•••fibers/internal: comment typos | Andy Wingo | 2016-10-19 | 1 | -2/+2 |
| |\ |
|
