Skip to content

Latest commit

 

History

History
1021 lines (708 loc) · 38.4 KB

CHANGELOG.md

File metadata and controls

1021 lines (708 loc) · 38.4 KB
Raw

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[0.54.2] - 2024-12-12

Fixed

  • Fixed GitHub release action to upload release binaries

[0.54.1] - 2024-12-12

Fixed

  • Fixed GitHub release action to create release binaries

[0.54.0] - 2024-12-10

Changed

  • Improved printing of results. Should be more intuitive to understand what hevm found.
  • More complete and precise array/mapping slot rewrite, along with a copySlice improvement
  • Use a let expression in copySlice to decrease expression size
  • The --debug flag now dumps the internal expressions as well
  • hevm now uses the forge-std library's way of detecting failures, i.e. through reverting with a specific error code unless --assertion-type DSTest is passed
  • Default max iterations is 5 now. --max-iters -1 now signals no bound. This change is to match other symbolic execution frameworks' default bound and to not go into an infinite loop by default when there could be other, interesting and reachable bugs in the code
  • Update to GHC version 9.6.5
  • Abstraction-refinement is no longer an option, it was never really useful and not well-tested

Added

  • More POr and PAnd rules
  • Array/Map slot decomposition can be turned off via a flag
  • More PEq, PLEq, and PLT rules
  • New label cheatcode.
  • Updated Bitwuzla to newer version
  • New cheatcodes startPrank() & stopPrank()
  • ARM64 and x86_64 Mac along with Linux x86_64 static binaries for releases
  • Tutorial for symbolic execution
  • PAnd props are now recursively flattened
  • Double negation in Prop are removed
  • Updated forge to modern version, thereby fixing JSON parsing of new forge JSONs
  • Fixed RPC fetching of contract data
  • Symbolic ABI encoding for tuples, fuzzer for encoder
  • Printing Addrs when running symbolic for counterexamples and reachable end states
  • Improved symbolic execution tutorial
  • More Mod, SMod, Div, and SDiv simplification rules
  • Add freshAddresses field in VMOpts so that initial fresh address can be given as input
  • Add documentation about limitations and workarounds
  • More verbose error messages in case of symbolic arguments to opcode
  • Tests to enforce that in Expr and Prop, constants are on the LHS whenever possible
  • Support for MCOPY and TSTORE/TLOAD, i.e. EIP 5656 + 1153 + 4788
  • All fuzz tests now run twice, once with expected SAT and once with expected UNSAT to check against incorrectly trivial UNSAT queries
  • Allow --num-solvers option for equivalence checking, use num cores by default
  • Preliminary support for multi-threaded Z3
  • Skip over SMT generation issues due to e.g. CopySlice with symbolic arguments, and return partial results instead of erroring out
  • Fix interpreter's MCOPY handling so that it doesn't error out on symbolic arguments
  • More desciptive errors in case of a cheatcode issue
  • Better and more pretty debug messages
  • Many env* cheatcodes are now supported

Fixed

  • vm.prank is now respected during calls to create
  • concat is a 2-ary, not an n-ary function in SMT2LIB, declare-const does not exist in QF_AUFBV, replacing with declare-fun
  • CVC5 needs --incremental flag to work properly in abstraction-refinement mode
  • cli.hs now uses with-utf8 so no release binary will have locale issues anymore
  • Took ideas for simplification rules from "Super-optimization of Smart Contracts" paper by Albert et al.
  • Printing panic uint256 as hex, not as int
  • Decomposition does not take place when entire states are compared, as that would necessitate a different approach.
  • initial-storage option of hevm symbolic is respected
  • caller option of hevm symbolic is now respected
  • Thanks to the new simplification rules, we can now enable more conformance tests
  • Multi-threaded running of Tracing.hs was not possible due to IO race. Fixed.
  • Fixed multi-threading bug in symbolic interpretation
  • Fixed simplification of concrete CopySlice with destination offset beyond destination size
  • Fixed a bug in our SMT encoding of reading multiple consecutive bytes from concrete index
  • Fixed bug in SMT encoding that caused empty and all-zero byte arrays to be considered equal and hence lead to false negatives through trivially UNSAT SMT expressions
  • Respect --smt-timeout in equivalence checking
  • Fixed the handling of returndata with an abstract size during transaction finalization
  • Error handling for user-facing cli commands is much improved
  • Fixed call signature generation for test cases
  • Fixing prank so it doesn't override the sender address on lower call frames

[0.53.0] - 2024-02-23

Changed

  • Minimum distance requirements are now asserted for Keccak function calls. They assert that it's hard to generate two Keccak's that are less than 256 afar.
  • Keccak concretization is now done only after all simplifications are performed. This helps with simplification pre-concretization
  • Added an IllegalOverflow error in case the system tries to allocate a large amount of memory during abstract gas execution but concrete running. In these cases, the interpreter can out-of-heap as the only check is that the size allocated is less than $2**{64}$, but that is too large to fit in memory. Now, we check more stringently, and still return an IllegalOverflow
  • Fixed --root option for the test subcommand
  • Use -Wunused-packages and eliminate unused deps.

Added

  • Optimized smt queries that significantly improve performance when dealing with solidity mappings and arrays
  • Support for using Bitwuzla as a solver
  • More efficient encoding for failure in ds-test style tests
  • Symbolic tests now support statically sized arrays as parameters
  • hevm test now has a num-solvers parameter that controls how many solver instances to spawn
  • New solc-specific simplification rules that should make the final Props a lot more readable
  • Prop is now correctly ordered, better BufLength and Max simplifications of Expr, and further solc-specific simplifications of Expr
  • Simplify earlier and don't check reachability for things statically determined to be FALSE
  • New concrete fuzzer that can be controlled via --num-cex-fuzz
  • Partial support for dynamic jumps when the jump destination can be computed given already available information
  • Added three forking cheatcodes: createFork, selectFork, and activeFork

Fixed

  • Traces now correctly perform source mapping to display contract details
  • Event traces now correctly display indexed arguments and argument names
  • JSON reading of foundry JSONs was dependent on locale and did not work with many locales.

[0.52.0] - 2023-10-26

This is a major breaking release that removes several user facing features and includes non trivial breakage for library users. These changes mean the code is significantly simpler, more performant, and allow support for new features like fully symbolic addresses.

In addition to the changes below, this release includes significant work on performance optimization for symbolic execution.

Added

The major new user facing feature in this release is support for fully symbolic addresses (including fully symbolic addresses for deployed contracts). This allows tests to be writen that call vm.prank with a symbolic value, making some tests (e.g. access control, token transfer logic) much more comprehensive.

Some restrictions around reading balances from and transfering value between symbolic addresses are currently in place. Currently, if the address is symbolic, then you will only be able to read it's balance, or transfer value to/from it, if it is the address of a contract that is actually deployed. This is required to ensure soundness in the face of aliasing between symbolic addresses. We intend to lift this restriction in a future release.

Other

  • Support for vm.deal
  • Support for vm.assume (this is semantically identical to using require, but does simplify the process of porting exisitng fuzz tests to be symbolic)
  • the check prefix now recognized for symbolic tests
  • hevm test now takes a --number argument to specify which block should be used when making rpc queries

Changed

Revert Semantics in Solidity Tests

solidity tests no longer consider reverts to be a failure, and check only for the ds-test failed bit or user defined assertion failures (i.e. Panic(0x01)). This makes writing tests much easier as users no longer have to consider trivial reverts (e.g. arithmetic overflow).

A positive (i.e. prove/check) test with no rechable assertion violations that does not have any succesful branches will still be considered a failure.

Removed

hevm has been around for a while, and over time has accumulated many features. We decided to remove some of these features in the interest of focusing our attention, increasing our iteration speed and simplifying maintainance. The following user facing features have been removed from this release:

  • The visual debugger has been removed
  • All concrete ds-test executors have been removed (i.e. plain, fuzzer, invariant)
  • Rpc caching and state serialization has been removed (i.e. all --cache / --state flags)
  • The various DAPP_TEST variables are no longer observed
  • The --initial-storage flag no longer accepts a concrete prestore (valid values are now Empty or Abstract)

Fixed

This release also includes many small bugfixes:

  • CopySlice wraparound issue especially during CopyCallBytesToMemory
  • Contracts deployed during symbolic execution are created with an empty storage (instead of abstract in previous versions)
  • EVM.Solidity.toCode to include contractName in error string
  • Better cex reconstruction in cases where branches do not refer to all input variables in calldata
  • Correctly handle empty bytestring compiled contracts' JSON
  • No more false positives when keccak is called with inputs of different sizes
  • test now falls back to displaying an unecoded bytestring for calldata when the model returned by the solver has a different length the length of the arguments in the test signature.
  • we now generate correct counterexamples for branches where only a subset of input variables are referenced by the path conditions
  • vm.prank now works correctly when passed a symbolic address
  • vm.prank now works correctly when the next call transfers value
  • storage layout information will now be parsed from the output of forge build if it is available

API Changes

Reworked Storage Model / Symbolic Addresses

Adding symbolic addresses required some fairly significant changes to the way that we model storage. We introduced a new address type to Expr (Expr EAddr), that allows us to model fully symbolic addresses. Instead of modelling storage as a global symbolic 2D map (address -> word -> word) in vm.env, each contract now has it's own symbolic 1D map (word -> word), that is stored in the vm.contracts mapping. vm.contracts is now keyed on Expr EAddr instead of Addr. Addresses that are keys to the vm.contracts mapping are asserted to be distinct in our smt encoding. This allows us to support symbolic addresses in a fully static manner (i.e. we do not currently need to make any extra smt queries when looking up storage for a symbolic address).

Mutable Memory & ST

We now use a mutable representation of memory if it is currently completely concrete. This is a significant performance improvement, and fixed a particulary egregious memory leak. It does entail the use of the ST monad, and introduces a new type parameter to the VM type that tags a given instance with it's thread local state. Library users will now need to either use the ST moand and runST or stToIO to compose and sequence vm executions.

GHC 9.4

Hevm is now built with ghc9.4. While earlier compiler versions may continue to work for now, they are no longer explicitly tested or supported.

Other

  • Contract balances can now be fully symbolic
  • Contract code can now be fully abstract. Calls into contracts with unknown code will fail with UnexpectedSymbolicArg.
  • Run expression simplification on branch conditions
  • SLoad/SStore simplifications based on assumptions regarding Keccak non-collision&preimage
  • Improved Prop simplification
  • CopySlice+WriteWord+ConcreteBuf now truncates ConcreteBuf in special cases
  • Better simplification of Eq IR elements
  • Run a toplevel constant folding reasoning system on branch conditions
  • Global config via a monad, which should allow for more refactoring
  • evalProp is renamed to simplifyProp for consistency
  • Mem explosion in writeWord function was possible in case offset was close to 2^256. Fixed.
  • BufLength was not simplified via bufLength function. Fixed.
  • Add and Mul are associative, let's use that to make Expr more canonical
  • VMOpts no longer takes an initial store, and instead takes a baseState which can be either EmptyBase or AbstractBase. This controls whether storage should be inialized as empty or fully abstract. Regardless of this setting contracts that are deployed at runtime via a call to CREATE/CREATE2 have zero initialized storage.

[0.51.3] - 2023-07-14

Fixed

  • Path joining on Windows
  • Fixed overflow issue in stripWrites
  • Automatic tests are now more reproducible

Changed

  • Removed sha3Crack which has been deprecated for keccakEqs
  • Abstraction-refinement for more complicated expressions such as MULMOD

Added

  • Added flag -f debug to add debug flags to cabal/GHC

[0.51.2] - 2023-07-11

Fixed

  • SMT encoding of Expr now has assertions for the range of environment values that are less than word size (256 bits).
  • Trace now contains the cheat code calls
  • More consistent error messages

Changed

  • SMT2 scripts are now being reprocessed to put one sexpr per line. Having sepxrs that span across multiple lines trigers a bug in CVC5.
  • Removing long-running tests so we can finish all unit tests in approx 10 minutes on a current-gen laptop CPU
  • Added git revision to hevm version

Added

  • execution traces are now shown for failed prove_ tests

[0.51.1] - 2023-06-02

Fixed

  • hevm now gracefully handles missing out directories
  • Constraints are correctly propogated to the final output expression during symbolic execution

Changed

  • HEVM is now fully compliant with the Shanghai hard fork

[0.51.0] - 2023-04-27

Added

  • hevm can now execute unit tests in foundry projects. Just run hevm test from the root of a foundry repo, and all unit tests will be executed (including prove tests).
  • A new stack based loop detection heuristic
  • Analysis of partial execution traces is now supported

Changed

  • hevm dapp-test has been replaced with hevm test --project-type DappTools.
  • hevm test no longer supports parsing solidity output in the combined json format.
  • The default value for --ask-smt-iterations has been changed to 1
  • The SMT solver is never queried for branch conditions that do not occur in a loop (as determined by the loop detection heuristic)

Fixed

  • --max-iterations is respected in cases where path conditions have become inconsistent
  • --max-iterations is now respected for loops with a concrete branch condition

Fixed

  • Fixed a bug where underflow was possible when transfering eth

[0.50.5] - 2023-04-18

Changed

  • The --storage-model parameter has been replaced with --initial-storage
  • The --smttimeout argument now expects a value in seconds not milliseconds
  • The default smt timeout has been set to 5 minutes
  • hevm symbolic now searches only for user defined assertions by default

Fixed

  • The prank cheatcode now transfers value from the correct address
  • Fixed an off-by-one error in EVM.Debug.srcMapCodePos

[0.50.4] - 2023-03-17

Fixed

  • The --solvers cli option is now respected (previously we always used Z3)
  • The equivalence command now fails with the correct status code when counterexamples are found
  • The equivalence command now respects the given --sig argument
  • Correct symbolic execution for the SGT opcode

Changed

  • The equivalence command now pretty prints discovered counterexamples

Added

  • Implemented a shrinking algorithm for counterexamples
  • A new differential fuzzing test harness that compares the concrete semantics, as well as parts of the symbolic semantics against the geth evm implementation
  • The hevm library can now be built on Windows systems.
  • equivalence can now be checked for fully or partially concrete calldata
  • Support for function pointers in ABI

[0.50.3] - 2023-02-17

Fixed

  • hevm symbolic exits with status code 1 if counterexamples or timeouts are found
  • Calldata reads beyond calldata size are provably equal to zero.

Added

  • New cheatcode prank(address) that sets msg.sender to the specified address for the next call.
  • Improved equivalence checker that avoids checking similar branches more than once.
  • Improved simplification for arithmetic expressions
  • Construction of storage counterexamples based on the model returned by the SMT solver.
  • Static binaries for macos

Changed

  • SMT encoding of buffer length without using uninterpreted functions.

[0.50.2] - 2023-01-06

Fixed

  • Arithmetic overflow in concrete SAR edge case (#163)
  • Unexpected abstract term application during fully concrete execution (#163)

[0.50.1] - 2022-12-29

Fixed

  • hevm exec no longer fails with hevm: No match in record selector smttimeout
  • the gas, gaslimit, priorityfee, and gasprice cli options are now respected
  • cleaner formatting for the gas value in the visual debugger

Changed

  • we now build with ghc 9.2.4 by default
  • various perf improvements for concrete execution (#157, #152)

[0.50.0] - 2022-12-19

Changed

The symbolic execution engine has been rewritten. We have removed our dependency on sbv, and now symbolic execution decompiles bytecode into a custom IR, and smt queries are constructed based on the structure of the term in this IR.

This gives us much deeper control over the encoding, and makes custom static analysis and simplification passes much easier to implement.

The symbolic execution engine is now parallel by default, and will distribute granular SMT queries across a pool of solvers, allowing analysis to be scaled out horizontally across many CPUs.

more details can be found in the architecuture docs.

Removed

The following cli commands have been removed:

  • abiencode
  • rlp
  • flatten
  • strip-metadata

[0.49.0] - 2021-11-12

Added

  • Support for solc 0.8.10
  • Support for solc 0.8.11

Changed

  • Clearer display for the invalid opcode (0xfe) in debug view
  • Better error messages when trying to deploy unlinked bytecode
  • bytesX arguments to hevm abiencode are automatically padded

Fixed

  • Test contracts with no code (e.g. abstract contracts) are now skipped
  • Replay data for invariant tests is now displayed in a form that does not cause errors when used with dapp test --replay

[0.48.1] - 2021-09-08

Added

  • Support for 0.8.4 custom error types in stack traces

Changed

  • Contract feching happens synchronously again.
  • Invariants checked before calling methods from targetContracts.

Fixed

  • The block gas limit and basefee are now correctly fetched when running tests via rpc

0.48.0 - 2021-08-03

Changed

  • Updated to London hard fork!
  • The configuration variable DAPP_TEST_BALANCE_CREATE has been renamed to DAPP_TEST_BALANCE
  • Default smttimeout has been increased to 1 minute.
  • A new flag has been added to hevm (--ask-smt-iterations) that controls the number of iterations at which the symbolic execution engine will stop eager evaluation and begin to query the smt solver whether a given branch is reachable or not.
  • Contract fetching now happens asynchronously.
  • Fixed no contract definition crashes
  • Removed NoSuchContract failures

0.47.0 - 2021-07-01

Added

  • A new test runner for checking invariants against random reachable contract states.
  • hevm symbolic can search for solc 0.8 style assertion violations, and a new --assertions flag has been added allowing users to customize which assertions should be reported
  • A new cheatcode ffi(string[]) that executes an arbitrary command in the system shell

Changed

  • Z3 is once again the default smt solver
  • Updated nixpkgs to the 21.05 channel

Fixed

  • Sourcemaps for contracts containing immutable are now shown in the debug view.

0.46.0 - 2021-04-29

Added

  • Updated to Berlin! Conformant with GeneralStateTests at commit hash 644967e345bbc6642fab613e1b1737abbe131f78.

Fixed

  • ADDMOD and MULMOD by zero yields zero.
  • Address calculation for newly created contracts.
  • Accomodated for the notorious "anomolies on the main network" (see yellow paper Appendix K for trivia)
  • A hevm crash when debugging a SELFDESTRUCT contract.

0.45.0 - 2021-03-22

Added

  • Two new cheatcodes were added: sign(uint sk, bytes message) and addr(uint sk). Taken together these should allow for much more ergonomic testing of code that handles signed messages.
  • Symbolic execution can deal with partially symbolic bytecode, allowing for symbolic constructor arguments to be given in tests.

Fixed

  • Fixed a bug in the abiencoding.
  • Fixed the range being generated by ints.
  • hevm flatten combines the SPDX license identifiers of all source files.

Changed

  • updated nixpkgs to the 20.09 channel
  • Arbitrary instance of AbiType can no longer generate a tuple

0.44.1 - 2020-02-02

Changed

  • hevm cheatcodes now accept symbolic arguments, allowing e.g. symbolic jumps in time in unit tests
  • More efficient arithmetic overflow checks by translating queries to a more intelligent form.

0.44.0 - 2020-01-26

Added

  • hevm now accepts solidity json output built via --standard-json as well as --combined-json.
  • addresses in the trace output are prefixed with ContractName@0x... if there is a corresponding contract and @0x... otherwise.

Fixed

  • Symbolic execution now generates calldata arguments restricted to the proper ranges, following the semantics of fuzzing.
  • If the --address flag is present in hevm exec or hevm symbolic, it overrides the contract address at which a contract will be created.
  • Address pretty printing
  • Updated sbv to 8.9.5 to fix "non-const in array declaration" cvc4 issue with ds-test.

Changed

  • Use cvc4 as default smt solver

0.43.2 - 2020-12-10

Changed

  • The default smttimeout has been increased from 20s to 30s

0.43.1 - 2020-12-10

Changed

  • Counterexamples from symbolic tests now show clearer failure reasons

Fixed

  • Symbolic tests now work with RPC
  • Branch selection is working again in the interactive debugger

0.43.0 - 2020-11-29

Added

  • A --show-tree option to hevm symbolic which prints the execution tree explored.
  • Some symbolic terms are displayed with richer semantic information, instead of the black box <symbolic>.
  • hevm dapp-test now supports symbolic execution of test methods that are prefixed with prove or proveFail
  • The hevm interactive alias has been removed, as it is equivalent to hevm dapp-test --debug
  • hevm dapp-test --match now matches on contract name and file path, as well as test name
  • Step through the callstack in debug mode using the arrow keys

Changed

  • dapp-test trace output now detects ds-note events and shows LogNote
  • create addresses are shown with @<address> in the trace
  • DSTest.setUp() is only run if it exists, rather than failing
  • support new ds-test log_named_x(string, x) (previously bytes32 keys)
  • return arguments are fully displayed in the trace (previously only a single word)
  • return/revert trace will now show the correct source position

0.42.0 - 2020-10-31

Changed

  • z3 updated to 4.8.8
  • optimize SMT queries
  • More useful trace output for unknown calls
  • Default to on chain values for coinbase, timestamp, difficulty, blocknumber when rpc is provided
  • Perform tx initialization (gas payment, value transfer) in hevm exec, hevm symbolic and hevm dapp-test.

Added

  • TTY commands P and c-p for taking larger steps backwards in the debuger.
  • --cache flag for dapp-test, exec, symbolic, interactive, enabling caching of contracts received by rpc.
  • load(address,bytes32) cheat code allowing storage reads from arbitrary contracts.

0.41.0 - 2020-08-19

Changed

  • Switched to PVP for version control, starting now at 0.41.0 (MAJOR.MAJOR.MINOR).
  • z3 updated to 4.8.7
  • Generate more interesting values in property based testing, and implement proper shrinking for all abi values.
  • Fixed soundness bug when using KECCAK or SHA256 opcode/precompile
  • Fixed an issue in debug mode where backstepping could cause path information to be forgotten
  • Ensure that pathconditions are consistent when branching, and end the execution with VMFailure: DeadPath if this is not the case
  • Fixed a soundness bug where nonzero jumpconditions were assumed to equal one.
  • default --smttimeout changed from unlimited to 20 seconds
  • hevm symbolic --debug now respects --max-iterations

Added

  • hevm exec --trace flag to dump a trace
  • Faster backstepping in interactive mode by saving multiple snapshot states.
  • Support for symbolic storage for multiple contracts

0.40 - 2020-07-22

  • hevm is now capable of symbolic execution!

Changed

As a result, the types of several registers of the EVM have changed to admit symbolic values as well as concrete ones.

  • state.stack: Word -> SymWord.

  • state.memory: ByteString -> [SWord 8].

  • state.callvalue: W256 -> SymWord.

  • state.caller: Addr -> SAddr.

  • state.returndata: ByteString -> [SWord 8].

  • state.calldata: ByteString -> ([SWord 8], (SWord 32)). The first element is a list of symbolic bytes, the second is the length of calldata. We have fst calldata !! i .== 0 for all snd calldata < i.

  • tx.value: W256 -> SymWord.

  • contract.storage: Map Word Word -> Storage, defined as:

data Storage
  = Concrete (Map Word SymWord)
  | Symbolic (SArray (WordN 256) (WordN 256))
  deriving (Show)

Added

New cli commands:

  • hevm symbolic: search for assertion violations, or step through a symbolic execution in debug mode.
  • hevm equivalence: compare two programs for equivalence.

See the README for details on usage.

The new module EVM.SymExec exposes several library functions dealing with symbolic execution. In particular,

  • SymExec.interpret: implements an operational monad script similar to TTY.interpret and Stepper.interpret, but returns a list of final VM states rather than a single VM.
  • SymExec.verify: takes a prestate and a postcondition, symbolically executes the prestate and checks that all final states matches the postcondition.

Removed

The concrete versions of a lot of arithmetic operations, replaced with their more general symbolic counterpart.

0.39 - 2020-07-13

  • Exposes abi encoding to cli
  • Added cheat code hevm.store(address a, bytes32 location, bytes32 value)
  • Removes ExecMode, always running as ExecuteAsBlockchainTest. This means that hevm exec now finalizes transactions as well.
  • --code is now entirely optional. Not supplying it returns an empty contract, or whatever is stored in --state.

0.38 - 2020-04-23

  • Exposes metadata stripping of bytecode to the cli: hevm strip-metadata --code X. 357.
  • Fixes a bug in the srcmap parsing introduced in 0.37 356.
  • Fixes a bug in the abi-encoding of bytes with size > 32358.

0.37 - 2020-03-24

  • Sourcemap parser now admits solc-0.6.0 compiled .sol.json files.

0.36 - 2020-01-07

  • Implement Istanbul support 318
  • Fix a bug introduced in 280 of rlp encoding of transactions and sender address 320.
  • Make InvalidTx a fatal error for vm tests and ci.
  • Suport property based testing in unit tests. 313 Arguments to test functions are randomly generated based on the function abi. Fuzz tests are not present in the graphical debugger.
  • Added flags --replay and --fuzz-run to hevm dapp-test, allowing for particular fuzz run cases to be rerun, or for configuration of how many fuzz tests are run.
  • Correct gas readouts for unit tests
  • Prevent crash when trying to jump to next source code point if source code is missing

0.35 - 2019-11-02

0.34 - 2019-08-28

  • handle new solc bzzr metadata in codehash for source map
  • show VM hex outputs as hexadecimal
  • rpc defaults to latest block
  • hevm interactive:
  • fix rpc fetch
  • scrollable memory pane
  • Fix regression in VMTest compliance.
  • hevm exec ergonomics:
  • Allow code/calldata prefixed with 0x
  • create transactions with specific caller nonce
  • interactive help pane
  • memory pane scrolling

0.33 - 2019-08-06

  • Full compliance with the General State Tests (with the BlockchainTest format), using the Yellow and Jello papers as reference, for Constantinople Fix (aka Petersburg). Including:
  • full precompile support
  • correct substate accounting, including touched accounts, selfdestructs and refunds
  • memory read/write semantics
  • many gas cost corrections
  • Show more information for non solc bytecode in interactive view (trace and storage)
  • Help text for all cli options
  • Enable --debug flag in hevm dapp-test

0.32 - 2019-06-14

0.31 - 2019-05-29

  • Precompiles: SHA256, RIPEMD, IDENTITY, MODEXP, ECADD, ECMUL, ECPAIRING, MODEXP
  • Show the hevm version with hevm version
  • Interactive mode:
  • no longer exits on reaching halt
  • new shortcuts: 'a' / 'e' for start / end
  • allow returning to test picker screen
  • Exact integer formatting in dapp-test and tty

0.30 - 2019-05-09

  • Adjustable verbosity level for dapp-test with --verbose={0,1,2}
  • Working stack build

0.29 - 2019-04-03

  • Significant jump in compliance with client tests
  • Add support for running GeneralStateTests

0.28 - 2019-03-22

0.27 - 2019-02-06

0.26 - 2019-02-05

  • Format Solidity Error(string) messages in trace

0.25 - 2019-02-04

  • Add SHL, SHR and SAR opcodes

0.24 - 2019-01-23

  • Fix STATICCALL for precompiled contracts
  • Assume Solidity 0.5.2 in tests

0.23 - 2018-12-12

  • Show passing test traces with --verbose flag

0.22 - 2018-11-13

  • Simple memory view in TTY

0.21 - 2018-10-29

  • Fix Hackage package by including C header files for ethjet

0.20 - 2018-10-27

  • Parse constructor inputs from Solidity AST

0.19 - 2018-10-09

  • Enable experimental 'cheat' address, allowing for modification of the EVM environment from within the tests. Currently just the block timestamp can be adjusted.

0.18 - 2018-10-09

0.17 - 2018-10-05

  • Semigroup/Monoid fix

0.16 - 2018-09-19

  • Move ethjet into hevm

[0.15] - 2018-05-09

  • Fix SDIV/SMOD definitions for extreme case

[0.14.1] - 2018-04-17

  • Improve PC display in TTY

[0.14] - 2018-03-08

  • Implement STATICCALL

[0.13] - 2018-02-28

  • Require specific block number for RPC debugging
  • Implement RETURNDATACOPY and RETURNDATASIZE
  • Fix bug where created contracts didn't get their balance

[0.12.3] - 2017-12-19

  • More useful RPC debugging because we strip the entire BZZR metadata

[0.12.2] - 2017-12-17

  • Experimental new ecrecover implementation via libethjet
  • Correct error checking for setUp() invocations

[0.12.1] - 2017-11-28

  • Test name regex matching via --match
  • Fixed source map parsing bug when used with solc --optimize
  • TTY: fix a padding-related display glitch

0.12 - 2017-11-14

  • Use 13 different environment variables to control block parameters for unit testing, e.g. block number, timestamp, initial balance, etc.

    Full list:

    • DAPP_TEST_ADDRESS
    • DAPP_TEST_CALLER
    • DAPP_TEST_ORIGIN
    • DAPP_TEST_GAS_CREATE
    • DAPP_TEST_GAS_CALL
    • DAPP_TEST_BALANCE_CREATE
    • DAPP_TEST_BALANCE_CALL
    • DAPP_TEST_COINBASE
    • DAPP_TEST_NUMBER
    • DAPP_TEST_TIMESTAMP
    • DAPP_TEST_GAS_LIMIT
    • DAPP_TEST_GAS_PRICE
    • DAPP_TEST_DIFFICULTY

0.11.5 - 2017-11-14

  • Use --state with --exec --debug

0.11.4 - 2017-11-12

  • Fix bug when unit test contract has creations in constructor

0.11.3 - 2017-11-08

  • Fix array support in ABI module

0.11.2 - 2017-11-04

  • TTY: show a help bar with key bindings at the bottom

0.11.1 - 2017-11-02

  • TTY: fix a display glitch
  • TTY: improve display of ABI hashes on the stack

0.11 - 2017-10-31

  • Add "hevm flatten" for Etherscan-ish source code concatenation
  • Simplify code by removing concrete/symbolic machine abstraction

0.10.9 - 2017-10-23

  • Fix bugs in ABI formatting

0.10.7 - 2017-10-19

  • Fix library linking bug
  • Fix gas consumption of DELEGATECALL
  • Better error tracing
  • Experimental "contract browser" (stupid list of addresses)

0.10.6 - 2017-10-19

  • Enable library linking for unit tests and debugger
  • Use the same default gas/balance values as ethrun

0.10.5 - 2017-10-17

  • Better trace output including arguments and return values
  • Proof of concept coverage analysis via dapp-test --coverage

0.10 - 2017-10-10

  • Enable new trace output by default for failing tests
  • Exit with failure code from test runner when tests fail
  • More fixes to improve Ethereum test suite compliance

0.9.5 - 2017-10-06

  • Prototype of new trace output with hevm dapp-test --verbose
  • Nicer trace tree in the TTY debugger
  • Many fixes to improve Ethereum test suite compliance

0.9 - 2017-09-29

  • Integrates with live chains via RPC (read-only)
  • Exposes a special contract address with test-related functionality (time warp)

0.8.5 - 2017-09-22

  • Renames hevm from its maiden name hsevm ✨

0.8 - 2017-09-21

  • Implements gas metering (Metropolis rules by default)
  • Shows gas counter in the terminal interface
  • Enables debugger for consensus test executions
  • Consensus test runner script with HTML reporting
  • Passes 564 of the VMTests; fails 115 (see 0.8 test report)
  • Command line options for specifying initial gas amounts and balances
  • Improved TTY UI layout

0.7 - 2017-09-07

  • Can save and load contract states to disk using a Git-backed store (only --exec)
  • Can debug raw EVM bytecode using exec --debug
  • Fixes exec --value
  • Has smarter defaults for command line when running tests or debugging
  • Fixes bug with MSIZE in CALL context

0.6.5 - 2017-09-01

  • Fixes exec with regards to exit codes and error messages

0.6.1 - 2017-08-03

  • TTY: Adds command C-n in TTY for "stepping over"

0.6 - 2017-08-03

  • TTY: Adds second line to stack entries with humanized formatting
  • TTY: Gets rid of the separate log pane in favor of a unified trace pane

0.5 - 2017-08-02

  • TTY: Adds p command for stepping backwards
  • Adds ability to track origins of stack and heap words
  • Tracks Keccak preimage for words that come from the SHA3 instruction

0.4 - 2017-07-31

  • Parallelizes unit test runner
  • Improves speed by changing representation of memory
  • Internal refactoring for future support of symbolic execution
  • Adds logs to the trace pane

0.3.2 - 2017-06-17

  • Adds REVERT opcode
  • Sets TIMESTAMP value to 1 in unit tests

0.3.0 - 2017-06-14

  • Reverts contract state after CALL fails
  • Improves test runner console output

0.2.0 - 2017-06-13

  • Fixes bug in CALL

0.1.0.1 - 2017-03-31

  • Highlights Solidity exactly on character level
  • Adds N command for stepping by Solidity source position instead of by opcode

0.1.0.0 - 2017-03-29

  • First release