Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Riak Test v1.1.0 #786

Open
wants to merge 157 commits into
base: master
Choose a base branch
from
Open

Riak Test v1.1.0 #786

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
157 commits
Select commit Hold shift + click to select a range
6d9fbb3
Make some changes to riak_test to make it more flexible
kellymclaughlin Feb 28, 2014
8348835
convert bucket_types test to decoupled r_t framework
bowrocker Jul 28, 2014
e69f962
convert basic_command_line test to decoupled r_t framework
bowrocker Jul 28, 2014
86b8c6f
convert bucket_types test to decoupled r_t framework
bowrocker Jul 29, 2014
5fe4c03
convert bucket_props_roundtrip test to decoupled r_t framework
bowrocker Jul 29, 2014
381ff9f
Move replication tests to separate subdirectory
kellymclaughlin Jul 29, 2014
d15efa0
Move rebar plugin to separate directory
kellymclaughlin Jul 29, 2014
333e67d
Add missing node function to rt.erl
kellymclaughlin Jul 29, 2014
c7c8dfc
Remove direct calls to rtdev harness from replication tests
kellymclaughlin Jul 29, 2014
263cd68
Move configuration functions to rt_config.
bowrocker Jul 29, 2014
ba4ee80
Continue to move config functions from rt to rt_config.
bowrocker Jul 30, 2014
ff24f91
Migrate several more functions into rt_cluster from rt.
bowrocker Jul 30, 2014
1267503
Move backend related functions from rt module to new rt_backend module.
bowrocker Jul 30, 2014
6267aa2
Move protobuf-related functions from rt module to rt_pb.
bowrocker Jul 30, 2014
8c9f6f1
Fix rt_pb function exports.
bowrocker Jul 30, 2014
defdf55
Refactor http-relate rt functions
bowrocker Jul 30, 2014
56b10d7
Move node-related functions from rt module to rt_node.
bowrocker Jul 30, 2014
e1f0d45
Move rt:brutal_kill to rt_node.
bowrocker Jul 30, 2014
891f366
Move ring-related rt functions to rt_ring; some cleanup.
bowrocker Jul 30, 2014
80005cd
Move command-line oriented rt functions to rt_cmd_line.
bowrocker Jul 30, 2014
110657c
Move bucket types related functions from rt module to rt_bucket_types.
bowrocker Jul 31, 2014
10b56a2
Move AAE related functions from rt module to rt_aae.
bowrocker Jul 31, 2014
3e8928c
More functions moved to rt_node.
bowrocker Jul 31, 2014
614661a
Move rt:is_pingable to rt_node.
bowrocker Jul 31, 2014
82c3564
Move systest read/write functions from rt module to rt_systest.
bowrocker Jul 31, 2014
c8eaaf6
Fix calls to rt:teardown; should be rt_cluster:teardown.
bowrocker Jul 31, 2014
0b8c762
Move all access to rt_properties record into an rt_properties module
kellymclaughlin Jul 30, 2014
9649d09
Take first pass at harness refactoring.
bowrocker Aug 1, 2014
87b492d
Convert rt_cs_dev harness to test_harness behaviour.
bowrocker Aug 1, 2014
f0c3974
Fix typo in rt_cs_dev: 'behavious' -> 'behaviour'.
bowrocker Aug 4, 2014
4e3ddcf
Fix whitespace in rt_cs_dev.
bowrocker Aug 4, 2014
62947c9
Refactor and reorganize riak_test_escript module
kellymclaughlin Aug 1, 2014
ad6cf58
Fix issue with lager startup
kellymclaughlin Aug 5, 2014
e785626
Fix whitespace problems; add some edoc to harness modules.
bowrocker Aug 6, 2014
5f182bf
Move default cluster config to rt_properties.
bowrocker Aug 6, 2014
6551087
Fix code reference for edoc in rt_harness.
bowrocker Aug 6, 2014
894b9b5
Add support for test group annotations to riak_tests.
bowrocker Aug 8, 2014
4a2717e
Add support for multiple test_type attributes by changing format to t…
bowrocker Aug 8, 2014
409957d
Address review feedback.
bowrocker Aug 8, 2014
4e7e9a7
Major overhaul of the internal workings of riak_test
kellymclaughlin Aug 13, 2014
4145d0c
Port Jon Anderson's work on test groups to avoid merge pain
kellymclaughlin Dec 15, 2014
8f7ff87
Convert riak_cli dependency to clique dependency
kellymclaughlin Dec 16, 2014
d8a6df4
Expand support for replication test conversion
kellymclaughlin Dec 16, 2014
97218d9
Use metadata property and change confirm arity to 1
kellymclaughlin Dec 19, 2014
e4c7008
Convert a few tests to new API and fix a some framework bugs
kellymclaughlin Dec 22, 2014
86e800b
Fix several framework bugs found while testing
kellymclaughlin Jan 9, 2015
a1f5df8
Add an external_properties field to rt_properties record
kellymclaughlin Jan 9, 2015
8120e9c
WIP: Support execution of old and new style tests
Jan 21, 2015
32a0b7e
Update build scripts and README to better reflect mixed mode
Feb 12, 2015
a948019
Move configuration functions to rt_config.
bowrocker Jul 29, 2014
f7cf16f
Migrate several more functions into rt_cluster from rt.
bowrocker Jul 30, 2014
13387de
WIP: Support execution of old and new style tests
Jan 21, 2015
11c7aac
Initial run of an old style test
Feb 13, 2015
ba8b606
Reduced repetition in tests/overload predicates
bearcage Feb 11, 2015
fe36e7e
Move configuration functions to rt_config.
bowrocker Jul 29, 2014
2d494b2
Migrate several more functions into rt_cluster from rt.
bowrocker Jul 30, 2014
c87a8ec
WIP: Support execution of old and new style tests
Jan 21, 2015
9b987b3
Reduced repetition in tests/overload predicates
bearcage Feb 11, 2015
aa854c5
- Fix mistakes in the rebase with origin/master
Feb 13, 2015
50f000b
Additional rebase cleanup
Feb 13, 2015
3313111
- Fixes a rebase error in repl_bucket_types
Feb 17, 2015
2ddb1b8
Modifies node_manager to deploy zero nodes for old style tests an
Feb 17, 2015
bdc9f44
Ports more rt functions and fixes the verify_build_cluster test case
Feb 18, 2015
1e2ffb6
Redirects function calls in the rt module to use their analogs in the
Feb 19, 2015
e8985e0
Wraps the rt:set_conf, rt:set_advanced_conf, and rt:update_app_config
Feb 19, 2015
93863aa
Refinements to the wrapper to pass the verify_down test case
Feb 19, 2015
cadd8da
Update rtdev:deploy_nodes/1
Feb 21, 2015
10d1b94
Adjust VersionMap to key off dev[0-9] and path names appropriately
Feb 21, 2015
fb5854b
Adds additional debug logging to rtdev and pulls the master version of a
Feb 24, 2015
19d931b
Update to support verify_membackend
Feb 25, 2015
660b671
Adds support for admin/3 to the rt_cmd_line, rt_harness, and rtdev
Feb 25, 2015
0be645e
verify_staged_clustering passes using the r_t v1 API Wrapper
Feb 25, 2015
4ab1e67
Adds debug logging to rt:allocate_nodes to introspect the calculation of
Feb 26, 2015
5f52520
Modified rt_harness_util to use the rt2 rather than the rt module
Feb 27, 2015
050ba3f
Modifies rtdev-all to use make deps for non-tagged builds
Feb 27, 2015
4073090
The verify_staged_clustering test case passes using the r_t v1 API
Feb 27, 2015
3ef12cb
verify_riak_stats passes using the r_t v1 API wrapper
Feb 27, 2015
7bc3d0c
Rename rt_max_wait_time to rt_max_receive_wait_time and document conf…
Mar 4, 2015
b4689eb
- Removes riak from the repo -- it should be ignored
Feb 27, 2015
fe1c7bf
Refines deprecation logging for the rt_max_wait_time parameter and adds
Mar 4, 2015
7da4084
Add back support for riak_test_runner:metadata/0 for unported tests
Mar 5, 2015
929f53a
Fixed typo in rt_max_receive_wait_time
Mar 5, 2015
9be62bf
Fix result() returned by handle_sync_event to remain in current state…
Mar 5, 2015
765283e
Add test_summary_format_time for human-readable Duration output
Mar 5, 2015
9e0f2f7
Fixed typos in rt_bucket_type function names
Mar 6, 2015
f3402cd
Update the proper settings of `spam_dir`
Mar 6, 2015
138e21d
Implements an option (rt_execution_mode) to specify that r_t should run
Mar 5, 2015
9766d8c
Adds the partition_repair test case to the regression test script
Mar 6, 2015
961c47b
Add back missing version of rt:set_conf to run verify_build_cluster
Mar 9, 2015
e4b4d2b
Update CS devrel paths
Mar 10, 2015
3579657
Support riak_control_authentication
Mar 11, 2015
1631b9e
Re-implements prompting to leave nodes running on failure and verify_jmx
Mar 11, 2015
d68b88a
- Modifies rtdev-install to create directories in the form of
Mar 12, 2015
b7b4013
verify_aae test cases using the v1 API wrapper. Adds the test case to
Mar 12, 2015
f56993b
ensemble_bysantine, ensemble_interleave, verify_claimant, and
Mar 13, 2015
904778d
Test case gh_riak_core_155 passes using the v1 wrapper
Mar 13, 2015
f725fb4
Update pb_security to use code:get_object_code/1 to work with new fra…
Mar 14, 2015
8f89479
Add debugging statements to test results to help debug in case of fra…
Mar 14, 2015
ff1acf2
Update versioning
Mar 14, 2015
979386a
Update version configuration and add version validation
Mar 18, 2015
224965a
Add in verify_search test to regression suite
Mar 18, 2015
238cc46
verify_2i_aae passes the regression test suite. verify_membackend no
Mar 19, 2015
a7e7d0e
Fixes the creation of the current results symlink and various syntax
Mar 19, 2015
3c90be1
WIP: Initial draft of a Riak cluster FSM and associated API to replace
Mar 19, 2015
c4882dc
verify_handoff now passes using the v1 API wrapper
Mar 19, 2015
9cc0f6f
Fix overload test for rebase
Mar 20, 2015
5b79d58
Add verify_capabilities to regression suite
Mar 23, 2015
7684412
Add support for loaded_upgrade test
Mar 24, 2015
74d2e9b
replication2, overload, and repl_fs_stat_caching pass using the v1 API
Mar 20, 2015
f9b9ab7
- v2 API Definition: Initial work on the node API
Mar 20, 2015
6279219
- The repl_fs_stat_caching and replication2 test cases work with the v1
Mar 24, 2015
566d0d4
Fixes continue on fail feature to ensure that test runs actually stop
Mar 25, 2015
0311cf1
Fixes a syntax error in the regression test script that causes riak_test
Mar 26, 2015
d5c5f9f
Add support for verify_handoff_mixed
Mar 26, 2015
0bacc4e
Add verify_bitcask_tombstone2_upgrade to regression test suite
Mar 26, 2015
1f4a8a9
Add replication_object_reformat to regression test list
Mar 26, 2015
f05fc20
Wraps rt:pbc/1 to call rt_pb:pbc/1 and fixes riak_test_escript to only
Mar 27, 2015
94de39a
Wraps rt:pbc/2 to call rt_pb:pbc/2 and adds implementation of
Mar 27, 2015
e9215d1
Fixes the implementation of rt_pb:pbc/2 to properly match the results of
Mar 27, 2015
145b257
WIP: Additional refinements to the v2 API specification
Mar 27, 2015
957fc93
Modifies rt_config:get/1 to default the continue_on_fail flag when no
Mar 30, 2015
41d6940
Roll back regression test to work with new testing infrastructure
Mar 30, 2015
c957e6c
verifymembackend passes the using v1 wrapper
Mar 30, 2015
88d3c40
Revert verify_membackend back to master version
Mar 31, 2015
c5fe86c
Finally get replication2_pg passing in the regression suite
Apr 2, 2015
867228e
Continued work on implementing the new r_t v2 API
Apr 2, 2015
0604560
Initial introduction of rt_test_plan record to wrap tests
Apr 10, 2015
f7e61bf
Get GiddyUp product and version from the default version instead of c…
Apr 11, 2015
4186a46
Finally get GiddyUp working
Apr 16, 2015
62f03fd
Re-sync all tests from master
Apr 16, 2015
a57a0b9
Get GiddyUp consuming riak_test.log
Apr 19, 2015
33772f3
Convert giddyup module into a gen_server
Apr 22, 2015
a529f17
Fix creation of test plans from GiddyUp
Apr 22, 2015
d50506c
Report full test names when showing which tests to run or not run
Apr 22, 2015
c55fd46
Sync up botched rebase of rt.erl
Apr 22, 2015
4d70aaa
Use the full name of a test case (including backend) when reporting
Apr 22, 2015
cc9fd32
Update riak_test.config
Apr 23, 2015
6b6afe2
Add better debugging messages when no tests are specified and when gi…
Apr 23, 2015
c59d537
Update riak_test.config
Apr 24, 2015
8704610
Change how results table is written to lager file
Apr 27, 2015
a3671c9
Fix unit tests for rt_config
Apr 28, 2015
d6dca14
Register Erlang setup before determining which tests to run so YZ tests
Apr 30, 2015
92fd1e5
Addresses BTA-207 to fix cuttlefish_configuration test and
Apr 30, 2015
1428fca
Close files after making local copies for GiddyUp
May 5, 2015
fe374ec
Fix clique table for atoms as failure reasons
May 6, 2015
2019b2e
Add unit tests for results table
May 7, 2015
a212c40
Resync tests from master
May 8, 2015
d3975f6
Put lib directory back in git because intercepts are stored there
May 12, 2015
deebded
Fix specification of backends
May 13, 2015
f25fbac
Handle the case where versions are single atoms, not version/config
May 14, 2015
8f1ff94
Introduces the rt_riak_cluster and rt_riak_node FSMs to orchestrate Riak
May 19, 2015
2f11dd3
Add back in support for version upgrade path for BTA-204
May 20, 2015
25c80f9
Update README.md
May 20, 2015
e76c192
Update README.md
May 20, 2015
524833b
Fix kv679_dataloss for new mixed framework
May 26, 2015
f53e630
Fix deploy_nodes/1 versions for riak667_safe
May 26, 2015
b446979
- WIP: Breaking change that is untested for node defintions to support
Jun 5, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ doc/
*.jar
coverage
tags
riak-*
riak*
*.png
.rebar/
.local_dialyzer_plt
Expand Down
0 src/rebar_riak_test_plugin.erl → .plugins/rebar_riak_test_plugin.erl
View file
Open in desktop
File renamed without changes.
5 changes: 3 additions & 2 deletions INSTALL
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,8 @@
{rt_deps, ["/usr/local/basho/evan/riak2.0/deps"]},
%% should be really long to allow full bitcasks to
%% come up
{rt_max_wait_time, 600000000000000},
{rt_max_receive_wait_time, 600000000000000},
{test_timeout, 600000000000000},
{basho_bench, "/usr/local/basho/evan/basho_bench/"},
{basho_bench_statedir, "/tmp/bb_seqstate/"},
{rt_retry_delay, 500},
Expand All @@ -39,6 +40,6 @@

at least right now. this will problably change as the configuration
stuff gets sorted out. some of these may not be necessary.
rt_max_wait_time is (could maybe be set to infinity? maybe by the
rt_max_receive_wait_time is (could maybe be set to infinity? maybe by the
harness?), perf_* and basho_bench* are also critical. rt_deps
should maybe be dynamic?
15 changes: 8 additions & 7 deletions Makefile
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,11 +1,6 @@
.PHONY: deps

APPS = kernel stdlib sasl erts ssl tools os_mon runtime_tools crypto inets \
xmerl webtool eunit syntax_tools compiler hipe mnesia public_key \
observer wx gs
PLT = $(HOME)/.riak-test_dialyzer_plt

all: deps compile
all: deps compile testcases
./rebar skip_deps=true escriptize
SMOKE_TEST=1 ./rebar skip_deps=true escriptize

Expand All @@ -18,7 +13,7 @@ docsclean:
compile: deps
./rebar compile

clean:
clean: clean_testcases
@./rebar clean

distclean: clean
Expand All @@ -28,6 +23,12 @@ quickbuild:
./rebar skip_deps=true compile
./rebar escriptize

testcases:
@(cd search-corpus; tar fx spam.0.1.tar.gz)

clean_testcases:
@rm -rf search-corpus/spam.0/

##################
# Dialyzer targets
##################
Expand Down
Loading