TimQu
91fb664910
Refactored a little and implemented functions for prophesy
Former-commit-id: a61f1eaff2
10 years ago
TimQu
f3f3a31e1e
Optimization for policy recycling
Former-commit-id: b66a74b746
10 years ago
TimQu
9c645ba24b
Work on policy recycling
Former-commit-id: b8e94254ce
10 years ago
TimQu
dae0faa2a0
refactored the quick implementation of the recent bugfix
Former-commit-id: 5c0d1fa3b9
10 years ago
TimQu
4a874a5a29
Added some benchmark models from param website
Fixed two bugs considering nonatomic subformulae and constant results
Qualitative modelchecking needs to be done when applying a policy!
Former-commit-id: bd88228214
10 years ago
TimQu
87c8241ec7
policies for games
Former-commit-id: 8bfb325b60
10 years ago
TimQu
bf450688b4
The variable pool of carl needs to be cleared after executing a test.
Sampling for mdps now uses the policy of the previous iteration as initial guess
Former-commit-id: 3b8b25f30f
10 years ago
TimQu
0863d0e51a
don't store ALL the occurring policies...
Former-commit-id: f442b97b8b
10 years ago
TimQu
ca917a651c
MinMaxLinearEqSolvers can now use some initial policy as a first guess.
First steps to use this for region approximation
Former-commit-id: 9a8151607f
10 years ago
TimQu
a723cfca14
Made sampling for MDPs correct again
Former-commit-id: 7917200f4e
10 years ago
TimQu
e80a1081bb
First steps to identify the parameters for which the optimal policy always choses the same boundary
Former-commit-id: c2561730f6
10 years ago
TimQu
6ddddd8cfa
Implemented policy extraction for value iteration
Former-commit-id: 604b4667b8
10 years ago
TimQu
b09d123779
...
Former-commit-id: 47c139f3bf
10 years ago
TimQu
1860502a3a
Deterministic states with only constant outgoing transitions are now eliminated
Former-commit-id: be5bf4f7cc
10 years ago
TimQu
77c2f397a9
fix for approximation model, additional test for mdps, minor changes
Former-commit-id: cc837ddf3e
10 years ago
TimQu
c53b79b9b7
approximation model, again
Former-commit-id: a7da8e4298
10 years ago
TimQu
67ff27954e
refactored approximation model (almost done)
Former-commit-id: c7f285906b
10 years ago
TimQu
046afd3804
Refactored SamplingModel
Former-commit-id: b51ed752b4
10 years ago
dehnert
6f59fd7aca
fixed computation of rewards in MDPs
Former-commit-id: 3d025b92b1
10 years ago
dehnert
4b4c11048f
fixed bug in prob1E. added functions to retrieve schedulers for prob0E, probGreater0E and prob1E states of MDPs
Former-commit-id: aea5fe773b
10 years ago
sjunges
d06c92c10a
Revert "Revert "added flag that indicates which interval bound is to be taken. added xerces to the gitignore""
This reverts commit dfd2cda380 [formerly 4be9f6f8c8 ].
Former-commit-id: 4510017c6a
10 years ago
sjunges
dfd2cda380
Revert "added flag that indicates which interval bound is to be taken. added xerces to the gitignore"
This reverts commit 16ea224b6a [formerly ee85062515 ].
Former-commit-id: 4be9f6f8c8
10 years ago
dehnert
16ea224b6a
added flag that indicates which interval bound is to be taken. added xerces to the gitignore
Former-commit-id: ee85062515
10 years ago
sjunges
896d2bcaef
propositional model checking for further interval reward model types
Former-commit-id: b8d2c89335
10 years ago
TimQu
d26f38b9a2
minor stuff, some more pmdp examples and an mdp test case
Former-commit-id: f48e308e5f
10 years ago
TimQu
adc5c8d1c1
Fixed another memory leak: CheckResults have not been destructed properly.
Former-commit-id: 5631c101bb
10 years ago
TimQu
77e086f446
small fix regarding the return type of computeValue
Former-commit-id: 78b43e0f6d
10 years ago
TimQu
f72c30cdff
First version of approximation model (with mdp intead of s2pg)
Former-commit-id: 86fdbc5f36
10 years ago
TimQu
c94e9c25a6
Added Mdp Region checking in storm.h, Some STORM_LOG_DEBUGs, fixes for sampling to work on Mdps
Former-commit-id: ab42fefd92
10 years ago
TimQu
78bd4a041a
Added Mdp class, sampling might work already (untested)
Former-commit-id: f0d5c77645
10 years ago
TimQu
70dd76c08b
Splitted region modelchecker in abstract class and dtmc class (to easily add an mdp class soon)
Former-commit-id: e722c8f2bd
10 years ago
TimQu
0043d3ebf5
changed template argument, used unordered_map
Former-commit-id: a563503d4a
10 years ago
TimQu
5b1494b9a9
Made use of this new cool rewardModel thing
Former-commit-id: d670d09278
10 years ago
TimQu
d377e6b289
Minor improvements everywhere. Also implemented some tests
Former-commit-id: be74e5f459
10 years ago
TimQu
c4444567e7
further optimization on approximation model initialization. Also better code structure of preprocessing steps
Former-commit-id: e916644a6c
10 years ago
TimQu
af505c7e89
Faster and more structured initialization of approx and sampling model
Former-commit-id: 34c2253a1b
10 years ago
TimQu
d57551c1ec
Fix for solver
Former-commit-id: 5fb470cdb5
10 years ago
TimQu
37a7b392f6
First version of approximation for rewards
Former-commit-id: e5ac667925
10 years ago
sjunges
e7d82fbaf5
Fix
Former-commit-id: edd0ad8b36
10 years ago
sjunges
6d10ba0ad0
compiles again
Former-commit-id: 1c09323cd1
10 years ago
sjunges
f08f66e900
added an option for polic extraction to the helper, some includes
Former-commit-id: 44b6a5d03f
10 years ago
sjunges
72ef715d68
Return type to also include partial schedulers
Former-commit-id: 65bee19f6a
10 years ago
TimQu
5de90c27e5
Preprocessing, sampling and state elimination now also work with rewards
Former-commit-id: ef14610efa
11 years ago
sjunges
2f5df9d72f
use the configured factory in the sparse mdp helper
Former-commit-id: 8d3faf1c6b
11 years ago
sjunges
8568ee3986
only one optimization direction enum -- towards integration of termination criterions on the model checker
Former-commit-id: 648855264e
11 years ago
dehnert
56eae69703
added more missing headers
Former-commit-id: 11be18e0d9
11 years ago
dehnert
3657b13aa9
another missing ifdef
Former-commit-id: 447f164488
11 years ago
dehnert
16d672a5cb
put carl reference in ifdef
Former-commit-id: c54cde0afe
11 years ago
dehnert
032e141254
small fix to the way interval reward models are reduced to a scalar vector
Former-commit-id: 218b31ce69
11 years ago
dehnert
f409087f47
first version of interval reward model support for MDPs. also fixed a missing include that prevented compilation of the main executable
Former-commit-id: 6b7f7a96e7
11 years ago