Opened 12 years ago

Closed 11 years ago

#382 closed enhancement (fixed)

Implement stack guard pages

Reported by: Martin Decky Owned by: Jakub Jermář
Priority: minor Milestone: 0.6.0
Component: helenos/kernel/generic Version: mainline
Keywords: gsoc12 Cc:
Blocker for: Depends on:
See also:

Description (last modified by Jakub Jermář)

Implement stack guard pages to detect stack overflows as they happen.

Stack guard pages are special unmapped pages in the virtual address space which trigger an exception whenever the code tries to access the memory within the guard page. This serves two main purposes:
  • A guard page above and below thread's stack serves as a safety mechanism to detect stack overflows and underflows. Stack underflows usually happen when the code control flow is somehow corrupted, stack overflows usually happen when the size of the stack is not sufficient for the current level of function nesting and local variables allocation (many times this is a sign of unbounded recursion).
  • A guard page can be also used to implement a stack which grows automatically as needed (which allows the initial stack size to be very small). However, to fully utilize automatically growing stacks in a multithreaded environment, the compiler and run-time environment are required to support discontinuous stacks. GCC has support for this on several platforms.

The guard pages mechanism can be generalized to also protect other (even all) memory areas within the address space.

What Gains and Benefits will this bring?
Undetected stack overflows and underflows can lead to silent memory corruption (usually corrupting the data on the stacks of other threads). This usually leads to application/kernel crash eventually, but the root cause of the crash is usually not obvious and debugging such cases is very tedious. Guard pages serve as an early detection mechanism which points the programmer directly to the source of the problem when it happens.

Guard pages in general are not a fail-safe security measure and they cannot detect complex stack corruption conditions (stack corruption within the dedicated stack area), but they are still a very helpful enhancement with almost no run-time overhead.

Required skills
A successful applicant will need to have very good skills in programming in the C language and the ability to learn and use the memory management subsystem of HelenOS.
Possible mentors
HelenOS Core Team, Martin Decky

Change History (6)

comment:1 by Jakub Jermář, 12 years ago

Keywords: gsoc12 added

comment:2 by Jakub Jermář, 12 years ago

Keywords: needswork added

comment:3 by Martin Decky, 12 years ago

Description: modified (diff)
Keywords: needswork removed

comment:4 by Jakub Jermář, 12 years ago

Description: modified (diff)

comment:5 by Jakub Jermář, 11 years ago

Guard pages for uspace have been implemented in mainline,1700 and a form of userspace growing stacks have been implemented as of mainline,1711.

Guard pages for kernel are, IMO, not a good idea as kernel stack is always allocated from kernel identity pages. The kernel identity region remains constant during the entire life-span of the running kernel and we should not drill holes into it. It may be even impossible on some architectures.

comment:6 by Jakub Jermář, 11 years ago

Resolution: fixed
Status: newclosed
Note: See TracTickets for help on using tickets.