getdns/src/test
Willem Toorop 426fc238da Fixes for FreeBSD warnings when compiling tests
/usr/local/include/check.h:454:75: warning: token pasting of ',' and __VA_ARGS__ is a GNU extension [-Wgnu-zero-variadic-macro-arguments]
     _ck_assert_failed(__FILE__, __LINE__, "Assertion '"#expr"' failed" , ## __VA_ARGS__, NULL)
/usr/local/include/check.h:454:75: warning: token pasting of ',' and __VA_ARGS__ is a GNU extension [-Wgnu-zero-variadic-macro-arguments]
2017-03-22 14:10:15 +01:00
..
tpkg Fit mdns code with pending dns netreqs on EMFILE 2017-03-20 21:33:19 +01:00
Makefile.in Dependencies 2017-03-20 21:58:45 +01:00
README Write libcheck logfiles via env variables 2016-03-17 16:40:30 +01:00
check_getdns.c Fixes for FreeBSD warnings when compiling tests 2017-03-22 14:10:15 +01:00
check_getdns_address.h Fix non existant domain names 2017-01-13 12:59:16 +01:00
check_getdns_address_sync.h Fix test for NODATA address_sync lookup 2015-07-07 11:46:52 +02:00
check_getdns_cancel_callback.h Fix pedantic warnings in unit tests 2016-12-08 22:33:10 +01:00
check_getdns_common.c Fixes for FreeBSD warnings when compiling tests 2017-03-22 14:10:15 +01:00
check_getdns_common.h Fix pedantic warnings in unit tests 2016-12-08 22:33:10 +01:00
check_getdns_context_create.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_context_destroy.h Fix pedantic warnings in unit tests 2016-12-08 22:33:10 +01:00
check_getdns_context_set_context_update_callback.h Update the name of the new option to 'round_robin_upstreams' 2017-03-17 16:53:03 +00:00
check_getdns_context_set_dns_transport.h Initial re-work of stateful transport selection and timeout/error handling. Also update transport test to avoid timeout. 2016-07-04 17:02:14 +01:00
check_getdns_context_set_timeout.c Unit test fixes for CFLAGS=-Wextra 2016-12-08 14:39:38 +01:00
check_getdns_context_set_timeout.h Fixes for FreeBSD warnings when compiling tests 2017-03-22 14:10:15 +01:00
check_getdns_context_set_upstream_recursive_servers.h Disable IPv6 only test, because travis containers 2015-12-10 16:49:55 +01:00
check_getdns_convert_alabel_to_ulabel.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_convert_ulabel_to_alabel.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_dict_destroy.h Fix signal.h include. 2014-03-12 21:32:18 -04:00
check_getdns_dict_get_bindata.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_dict_get_data_type.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_dict_get_dict.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_dict_get_int.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_dict_get_list.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_dict_get_names.h Unit test fixes for CFLAGS=-Wextra 2016-12-08 14:39:38 +01:00
check_getdns_dict_set_bindata.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_dict_set_dict.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_dict_set_int.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_dict_set_list.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_display_ip_address.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_eventloop.h Make just the src/getdns files part of doxygen by default. 2016-07-01 17:53:45 +01:00
check_getdns_general.h Fix pedantic warnings in unit tests 2016-12-08 22:33:10 +01:00
check_getdns_general_sync.h Fix NOERROR/NODATA test 2015-03-02 11:44:27 +01:00
check_getdns_hostname.h Fix pedantic warnings in unit tests 2016-12-08 22:33:10 +01:00
check_getdns_hostname_sync.h Reversed IPv6 lookup can take a while 2016-03-24 11:46:42 +01:00
check_getdns_libev.c Fixes for FreeBSD warnings when compiling tests 2017-03-22 14:10:15 +01:00
check_getdns_libevent.c Fixes for FreeBSD warnings when compiling tests 2017-03-22 14:10:15 +01:00
check_getdns_libevent.h Define u_char if including event.h for libevent1 2014-02-25 14:21:44 -05:00
check_getdns_libuv.c Fixes for FreeBSD warnings when compiling tests 2017-03-22 14:10:15 +01:00
check_getdns_list_get_bindata.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_list_get_data_type.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_list_get_dict.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_list_get_int.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_list_get_length.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_list_get_list.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_pretty_print_dict.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
check_getdns_selectloop.c Unit test fixes for CFLAGS=-Wextra 2016-12-08 14:39:38 +01:00
check_getdns_service.h Fix pedantic warnings in unit tests 2016-12-08 22:33:10 +01:00
check_getdns_service_sync.h Fix non existant domain names 2017-01-13 12:59:16 +01:00
check_getdns_transport.c Unit test fixes for CFLAGS=-Wextra 2016-12-08 14:39:38 +01:00
check_getdns_transport.h Fixes for FreeBSD warnings when compiling tests 2017-03-22 14:10:15 +01:00
scratchpad.template.c Bugfixes for setting with json pointers 2015-10-08 12:54:30 +02:00
testmessages.c Static checking fixes 2016-04-29 12:00:17 +02:00
testmessages.h Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00
tests_dict.c Unit test fixes for CFLAGS=-Wextra 2016-12-08 14:39:38 +01:00
tests_dict.good update testscript, check_dns is much better than diff. 2014-02-04 11:35:28 +01:00
tests_list.c Unit test fixes for CFLAGS=-Wextra 2016-12-08 14:39:38 +01:00
tests_list.good update testscript, check_dns is much better than diff. 2014-02-04 11:35:28 +01:00
tests_namespaces.c No executable flags on source files 2015-01-20 12:16:49 +01:00
tests_namespaces.good rm spurious execute bits +unit test to detect them 2015-05-26 14:16:27 +02:00
tests_stub_async.c Unit test fixes for CFLAGS=-Wextra 2016-12-08 14:39:38 +01:00
tests_stub_async.good Crude changes to stub test scripts to allow testing of all transport and recusive mode combinations 2014-10-22 17:09:33 +00:00
tests_stub_sync.c Synchronize with October 2015 spec 2015-10-22 12:02:04 +02:00
tests_stub_sync.good Crude changes to stub test scripts to allow testing of all transport and recusive mode combinations 2014-10-22 17:09:33 +00:00
tests_transports.sh Remove unnecessary test 2016-12-09 17:03:41 +00:00
testscript.sh Fill in <organization> place holder. 2014-02-25 14:23:19 +01:00

README

The programs in this directory are intended to provide a regression
test suite - we should be adding tests here as we build the package.

When building unit tests one approach that makes regression testing
easy is to generate canonical output and maintain that with the
code.  Changes to the code should produce output that matches the
canonical output, if it doesn't then the developer needs to look at
the differences to determine whether something broke or is fixed.  Once
the new output is verified it can replace the canonical output.

A typical flow might be illustrated via tests_list:
    - build tests_list (an executable linked against the library)
    - run the regression tests
        ./tests_list > tests_list.out
    - compare output to canonical output
        diff tests_list.out tests_list.can > tests_list.res
    - if there are any diffs then a change affected the output
    - verify the new output and copy it to tests_list.can
    - commit the new canonical output to the repository

Some of the tests that remain to be implemented:
- memory leak testing integrated into the test progs

libcheck facilitates selectively debugging of specific cases.
Example usage:
$ CK_LOG_FILE_NAME="/dev/stderr" CK_FORK=no \
    CK_RUN_SUITE="getdns_context_set_timeout()" CK_RUN_CASE="Positive" \
    ../../libtool exe gdb --args ./check_getdns