Current Released Version

Release 4.0.0 - February 2018
Updates include:
  • FDI Package and DD6 Sources for FDI Conformance Testing
  • DD5 EDD with and also without Device Level Menus
  • DD5 EDD now includes Device Templates
  • DD4/DD5 EDD with sources
  • DD Forward Compatibility Test Support 
  • Multiple Capability Level Test Support
  • Support for optional features for Profile C hosts was added
  • New standard test device hardware is required

Details:
  • 4334:Re-order sections in a new test CF file, 02010c.cff - order does not matter per FF-103 section 4.4.4.2 
  • 4746:Created second DDv5 binary for HTK that has only block level menus
  • 5534:Unsigned long value goes out of bounds in method of TC_CH_019
  • 5995:Enhance test case for host to ignore missing optional CFF Entries; 02010c.cff removes deprecated [VFD 2 Channels] section
  • 6027:TC_CH_007 – test case value should be 5, not 50; fix test case text
  • 6028:TC_MN_003 – Names of labels for groups wrong in test case
  • 6052:Remove unused variables from CONDTB1 Test Case Menus
  • 6104:TC_METH_002 – Label and help text not consistent with other method tests
  • 6114:Classification of some conditional test cases as online for DDv6 Profile
  • 6156:TC_COND_0010 Edit Format definition problem – remove max width specifier
  • 6158:TC_GRD_010 handling should be read-only, but source is set to read and write
  • 6159:TC_MN_004 image is bad; there is no window with a hyperlink on menu entry 
  • 6160:TC_MN_005 Dialog: Grid image should have horizontal orientation per DD
  • 6162:TC_MN_007 image is bad; PAGE is not displayed correctly
  • 6221:TC_IMG_008 image is too small to allow test case to work properly.  Use larger image so the INLINE reference can clearly show it is being resized.
  • 6232:Limited display host is not required to support menu STYLEs.  Add note to beginning of MENU and CHART tests that clarifies what is expected of a Limited Display Host for these test cases
  • 6238:TC_MN_011 – one test step refers to TC_MN_010 window
  • 6240:“Menu Test Dialog 1” in multiple menu tests refers to the dialog as a window
  • 6289:TC_MN_010 and TC_MN_011 contain 5 columns and 7 rows – fix test steps
  • 6571:TC_METH_001; TC_METH_002 – add test steps to make sure ther are no builtin failures at the end of execution
  • 7175:Device Templates added to DDv6 and then back-ported to the DDv5 binaries for DEV_TYPE 0x1000, Rev 2 using the FF DD-IDE Beta tokenizer 5.3.1
  • 7397:Remove reference to obsolete builtin resolve_selector_ref() in DDv4 and DDv5 source
  • 7422:All image tests use wrong image label and image help in test steps.  Fix doc to match DD Source.
  • 7449:TC_COND_0051b should use the signed variable, not unsigned – fix in DD source
  • 7450:TC_FILE_005 does not properly initialize the list at the beginning of the test case method
  • 7633:TC_MN_006 – “Dialog 2 Label Should be a Button, not a page – fix image in doc
  • 7648:TC_MN_014 – “TC_CH_001” PAGE should be on the second row with other elements in the dialog window, not a second PAGE
  • 7649:TC_MN_007, Window 1 – Ambiguous DD source can cause different behavior; remove rowbreak and columnbreak from source since it is not part of what is being tested; replace all images of the test case
  • 7670:TC_GR_010 – wrong labels on waveform legends for waveforms 2, 3, and 4
  • 7671:TC_GR_012 Graph Image Wrong – update image in spec
  • 7672:TC_GR_014 – Waveform images misleading/confusing – fix image in test case
  • 7673:TC_CH_004 Gauge Chart value “4” should be “40” – no colored lines – fix image 
  • 7674:TC_CH_009 Multiple problems with chart image
  • 7675:TC_CH_010 Multiple problems with chart image
  • 7676:TC_MN_001 Grid image is wrong; missing words in test steps – correct both
  • 7677:TC_MN_002 Bad images for Pages 1, 2, and 3 – update images
  • 7678:TC_MN_003 Window 1 bad image and descriptions in test steps; Window 4 grid image has reversed orientation of rows and columsn vs. DD source
  • 7679:TC_MN_004 – Multiple bad or misleading images for this test case
  • 7680:TC_MN_005 – Multiple bad or misleading images for this test case; steps 1.6 and 1.7 are confusing
  • 7681:TC_MN_006 – Multiple bad or misleading images; confusing test steps
  • 7682:TC_MN_007 – Confusing first lines of each Window test step; Window 1, 4, and 5 has multiple problems 
  • 7683:TC_MN_008 – Confusing or wrong test steps; bad display of PAGE in image
  • 7684:TC_MN_011; TC_MN_012 test steps have references to wrong menu numbers
  • 7685:TC_GRD_001 through TC_GRD_010; all images have an incorrect title in them
  • 7686:TC_GRD_010; first line of test case needs to be deleted; Col2 Row 6 parameter data type is INT_16, not UINT_16
  • 7688:TC_CH_003 – test step 1, line 4 is a duplicate of line 3 – remove duplicate
  • 7689:TC_CH_006 and TC_CH_007 – fix image so value of variable is 5 and not 50
  • 7693:Multi-language tests do not work becasue some of the DD source files are LATIN ANSI and they are #included from UTF-8
  • 7694:Divide by zero errors need to be fixed in COND0052C and COND0052D7880Images of FF logo in HTK DDL sources should be updated to reflect FCG; DDL Sources and all screen shots in section 2.5.3 should be replaced
  • 7880:Images of FF logo in HTK DDL replaced with FCG images; screen shots all replaced where applicable
  • 7885:TC_CH_003 source labels in image are all wrong
  • 7896:All CHART tests – the host is allowed to plot these values on a time scale using the current system time.  If so, the label would be “Time”.  All images will be replaced with new ones from RRTE that will reflect this
  • 7897:TC_CH_002 – reference to legend should be removed; help text to verify doesn’t match DD source; labels in legend may be derived from variable sources if host supports unified EDDL specs – add notes to allow this different display
  • 7898:TC_MN_014 – Add another note to clarify the exact differences between DDv5 and DDv6 representations of the device level menu
  • 7900:Note for subtest 11 and 12 in COND TB1 is no longer valid
  • 7901:DDv5 Visualization labels are not “loosely comparative” to the images and test steps in FF-694.  Remove this statement at the top of section 2.5.
  • 7902:Remove unnecessary “Host” row and any unneeded “Notes” rows in all tests of FF-694
  • 7903:Offline concept only applies to DD6 Profile
  • 7904:TC_METH_002 using wrong label in device level menu; be consistent with other method tests.
  • 7905:TC_METH_001, TC_METH_002, TC_METH_003 do not apply to Offline mode
  • 7907:TC_GR_010 has a redundant step
  • 7909:TC_DDCF_001 doesn’t work.  Rewrite DD source and test steps.  
  • 7914:Bring Test Cases for Device Templates into FF-694 - applies to both DD5 and DD6.
  • 7917:TC_MN_008 Menu 1 - Ambiguous DD source can cause different behavior; remove rowbreak and columnbreak from source since it is not part of what is being tested; replace all images of the test case
  • 7921:Create new test procedure for testing of COMPATIBILITY_REV that follows steps of FF-569 but uses HTK DEV_TYPE 0x1001
  • 7922:Create new test procedure for testing of Multiple Capability Levels that follows steps of FF-569 but uses HTK DEV_TYPE 0x1001
  • 7925:Method test for non-ASCII Unicode Prompt Strings should be labeled “TC_METH_003” in the DD source just like it is in FF-694 – change all source
  • 7933:TC_ITEM_004 references a record member instead of the entire record; result is inability to test changes to host language selections
  • 7936:TC_ITEM_004 does not make it clear that the DD language was changed when the localization in the host is changed.  Make English, German, Spanish, and French help strings for this test case appear in a similar fashion to Russian, Chinese, Japanese, Portuguese, and Italian.
  • 7939:Add FDI required root menus to DDv6 and include a handful of appropriate parameters in each.
  • 7940:Change name of TC_DDCF_001 in FF-694 and DD sources to “TC_DD_001”
  • 7941:Create new test document for non-EDD related tests from FF-694.  Move CF tests and other new tests for DD Forward Compatibility and Multiple Capability Level to that new document.
  • 7957:New test case TC_ITEM_018 for Collection Validity added to the DD5 and DD6 Source; FF-694
  • 7958:TC_MN_019 serves no purpose in DD5 - nothing is on the menu - remove from DD5 sources
  • 8023:TC_MN_019 in DD6 needs extra page with visibility=true in order to run the test properly
  • 8024:TC_ITEM_004 description includes test for Korean, but EDD sources do not have Korean
  • 8027:Add footnote that extra true page was added to DDL source for TC_MN_019; FF-694
  • 8028:TC_METH_002 fails assign2() builtin test with response code 1802; data sizes are mismatched (Bugzilla 2230)
  • 8040:DD5 and DD6 should contain all six original FF Device Level Menus as defined in FF-901
  • 8079:Implement GetHealthStatus() method in main FDI Package for HTK
  • 8090:Fix incorrectly spelled diagnostic root menus in EDD sources so they are found by a host
  • 8091:Changed to a valid response code to fix get_response_code_string() failure in TC_METH_001 (Bugzilla 1882)
  • 8092:Modified TC_METH_001 definition to use "DICT_ID()" instead of hard coding the index (Bugzilla 1558 and 1560)
  • 8101:Local parameters are not valid in DD4 - Remove DD4 test criteria from TC_COND_0029 tests
  • 8104:References to individual bits of a bit-enumerated variable are not supported in DD4 - Remove DD4 test criteria from TC_COND_0027 tests.



Previous Released Versions


Release 2.0.1 - April 2011
  • corrected inconsistencies between FF-694 and DDL for TC_CH_018, TC_CH_019, TC_CH_020, TC_CH_022 and TC_CH_023
  •  changed STATUS of OUT_A_n and OUT_D_n parameters in Custom Function Block to read/write for easier testing with block
  •  changed STATUS of OUT_A and OUT_D parameters in Custom Input Block to read/write for easier testing with block
  •  removed comment symbols from test heading and items in CFF
  •  added menuTestMethod1 to METHOD_ITEMS list of BLOCK VISUALTB
  •  added PARAM.ALERT_KEY=1 before assign() in TC_METH_001 for convenience
  •  corrected inconsistencies between FF-694 and DDL for TC_CH_002, TC_CH_011-TC_CH_020, TC_CH_024, TC_MN_007-TC_MN_009, & TC_METH_003
  •  corrected inconsistencies between FF-694 and DDL for COND0010-COND0031
  •  corrected inconsistencies between FF-694 and DDL for TC_COND_0027A and TC_COND_0027B
  •  corrected inconsistencies between FF-694 and DDL for TC_MN_001-TC_MN_012
  •  changed parameter value of builtin from 1402 to BLTIN_NO_MEMORY (1800+1) in TC_METH_001
  •  corrected inconsistencies between FF-694 and DDL for TC_GRD_001
  •  corrected block menu structure as described and in FF-901 for handhelds
  •  removed reference to obsolete worksheet for visualizations
  •  changed 010106.cff & 020106.cff: CffVersion=1,10 // FF-103-1.10
  •  corrected inconsistencies between FF-694 and DDL for TC_COND_0016-TC_COND_0017, TC_COND_029A-C
  •  changed input parameter for COND0051B from test_input_var (unsigned) to test_input_int (signed) to be correct with test case
  •  corrected HTK DDL to be compatible with DDL 3.60 and TOK 5.2.0
  •  changed "diagnostics_root_menu" to "diagnostic_root_menu" as per FF-901
  •  corrected chart source reference for non-essential visualization of HTK DDs (not in test case)
  •  removed definition and reference to fl_blk_param_file, fl_unicode_string_file as they are not even used in any test cases and also violate recent changes in specification
  •  added parameter initial values in CFF for parameters in TBs used in conditional expressions as per FF-901
  •  corrected inconsistencies between FF-694 and DDL for TC_GR_015
  •  removed procedures for checking EDIT_FORMAT, MIN_VALUE and MAX_VALUE in TC_COND_0031 as the parameter becomes read-only from other requirement
  •  removed test requirement and procedures for TC_File_006
  •  removed white background requirement from test procedures for TC_GR_001-TC_GR_011
  •  added sub-note to visualization procedures excluding systems with limited display capabilities to comply with size attributes
  •  corrected expectation in FF-694 procedures for x-axis units of charts
Release 2.0.0    
  • added signed int input parameter to CondTB2 to support unary negation test case
  • added Field Diagnostics to standard test device
  • added custom DS parameters to AI/AO FBs in standard test device
  • corrected reversed octets for Bitstring, Time-of-day, Time-difference parameters in standard test device
  • corrected inconsistencies between FF-694 and DDL for TC_MN_001, TC_MN_002
  • corrected inconsistencies between FF-694 and DDL for TC_MN_001, TC_MN_003, TC_MN_005, and TC_MN_007
  • corrected inconsistencies between FF-694 and DDL for TC_MN_002, TC_MN_005, TC_MN_006
  • corrected inconsistencies between FF-694 and DDL for TC_MN_003
  • corrected inconsistencies between FF-694 and DDL for TC_MN_003, TC_MN_005
  • corrected inconsistencies between FF-694 and DDL for TC_MN_007
  • corrected inconsistencies between FF-694 and DDL for TC_MN_004, TC_MN_005
  • corrected inconsistencies between FF-694 and DDL for TC_MN_005, TC_MN_007
  • corrected inconsistencies between FF-694 and DDL for TC_MN_007
  • corrected inconsistencies between FF-694 and DDL for TC_MN_008
  • corrected inconsistencies between FF-694 and DDL for TC_GRD_ test cases
  • added steps to check charts behavior in FF-694
  • corrected CommClass value  in CFF
  • corrected inconsistencies between FF-694 and DDL for TC_GR_002
  • corrected inconsistencies between FF-694 and DDL for TC_GR_014
  • corrected inconsistencies between FF-694 and DDL for TC_IMG_008
  • added bits 0, 10, & 12 to FEATURES in standard test device
  • corrected size of the FSTATE_STATUS in the MAO block in standard test device
  • added Profiled Custom Function Blocks to standard test device
  • added COMPATIBILITY_REV parameter to standard test device
  • HTK passes ITK campaign; failed tests reconciled and will be addressed in future release of ITK
  • corrected inconsistencies between FF-694 and DDL for TC_MN_001 , TC_MN_003 ,TC_MN_005  and TC_MN_007
  • corrected inconsistencies between FF-694 and DDL for TC_GR_011 and TC_CH_023
  • changed DD item name from __event_update to __update_evt for TB definitions (to be consistent with DDL 3.50)

Release 1.1.0
  • Added DDL and test cases for:
    • device-level menus
    • cross-block features
    • Unicode support
  • Added test cases for DD write access rights.

Details:
  • editorial in FF-694 regarding modal dialog menu
  • added UTF-8 standard dictionary (.dc8) for evaluation (not yet implemented in DDL)
  • FF-694 inconsistency for TC_CH_019
  • FF-694 inconsistency for TC_CH_020
  • FF-694 inconsistency for TC_CH_022
  • FF-694 inconsistency for TC_CH_023
  • corrected enumeration list for TC_COND_027B
  • FF-694 inconsistency for TC_COND_0051
  • corrected input value for conditional in COND0059B
  • clarified edit_format not dictating display format in FF-694
  • FF-694 inconsistency for TC_GR_001
  • added y-axis to TC_GR_013
  • FF-694 inconsistency for TC_GR_014
  • FF-694 inconsistency for TC_IMG_008
  • FF-694 inconsistency for TC_METH_001
  • corrected TC_METH_001 for send_value returning error for unchanged value
  • FF-694 inconsistency for TC_MN_001
  • FF-694 inconsistency for TC_MN_003
  • FF-694 inconsistency for TC_MN_004
  • FF-694 inconsistency for TC_MN_006
  • FF-694 inconsistency for TC_MN_007
  • FF-694 inconsistency for TC_MN_008
  • corrected TC_METH_001 MenuDisplay builtin to call correct type of menu
  • corrected test_fl_val to be LOCAL
  • added hault in TC_File_001_step_2 so test result can be detected
  • added int status to tc_ch_004_set_vals_method
  • corrected max column with in FF-981, FF-694, & DDL in accordance with FF-754
  • corrected cond0017 conditional to init list and reference correct element
  • corrected several tc_ch_###_set_vals_methods
  • removed c & d test cases for TC_COND_0051
  • FF-694 inconsistency for TC_GR_012
  • corrected convenience method
  • corrected convenience method
  • FF-694 inconsistencies for TC_GRD_0##
  • removed obsolete reference in FF-694
  • FF-694 inconsistencies for TC_GR_014
  • corrected macro (_DD5_PROFILE) in builtin test case
  • FF-694 inconsistency with FF-901
  • added wording to FF-694 with regards to uninitialized locals in conditional for some host implementations
  • added a no_download list to HTK to test feature 3.3.17 in FF-569
  • added standard handheld root menus to DDL
  • clarified FF-694 with regards to images and labels in accordance with FF-901
  • added help text to methods to be consistent with FF-694
  • changed "online or offline" to "online and offline" in FF-694 test case criteria; offline support not required though
  • FF-694 inconsistency for TC_GR_002
  • FF-694 inconsistency for TC_GR_010
  • FF-694 inconsistency for TC_GR_002
  • FF-694 inconsistency for TC_Ch_003
  • added hault in TC_METH_003 so test result can be detected
  • FF-694 inconsistency for TC_Ch_018,19,20
  • FF-694 inconsistency for TC_CH_019
  • FF-694 inconsistency for TC_CH_020
  • FF-694 inconsistency for TC_CH_021
  • FF-694 inconsistency for TC_CH_022
  • FF-694 inconsistency for TC_CH_023
  • FF-694 inconsistency for TC_CH_024
  • corrected wrong menu-item references in CondTB2 introduced in 1.1.0 beta
  • FF-694 inconsistency for TC_GR_014
  • FF-694 inconsistency for TC_GR_014
  • corrected cond sub-test procedures in FF-694
  • FF-694 inconsistency for TC_GR_013
  • removed cond0052e from FF-694
  • removed cond0058c from FF-694
  • clarified "method invalid" in FF-694
  • FF-694 inconsistency for TC_IMG_001
  • FF-694 inconsistency for TC_CH_021
  • FF-694 inconsistency for TC_IMG_008
  • FF-694 inconsistency for TC_CH_002
  • FF-694 inconsistency for TC_CH_018
  • FF-694 inconsistency for TC_CH_019,20,21
  • FF-694 inconsistency for TC_MN_001
  • FF-694 inconsistency for TC_MN_002
  • FF-694 inconsistency for TC_METH_001
  • removed TC_File_013,14 from DDL (currently unsupported in FF-694)
Release 1.0.1
  • feature added menus & charts for ChannelTB; does not add/affect test cases
  • made iterators for file/list start with index 1 to corelate with FF-901 FS 1.1
  • added send_on_exit() builtins to file test methods
  • added 1000_Test_Case_Conditional_Menus.ddl to users guide
  • simplified DDL for TC_DDCF_001 for maintenance
  • clarified procedures for TC_DDCF_001 in FF-694
  • corrected conditional test cases for bit-masked bit-enumerated reference
  • enhancement to rest of file test cases; associated with earlier AR
  • deprecated FD-217 spreadsheet from product
  • corrected builtin method test for writing to writable value
  • moved TC_LIST_005 from unsupported section of FF-694 to currently testable
  • clarified procedures in FF-694 for TC_COND_0027
  • implemented block characteristic conditional test case in DDL
  • corrected DDL for TC_COND_011 to reference record element in conditional
  • syncronized FF-694 and DDL for TC_COND_010 regarding validity subtests
  • moved TC_COND_018a, 018b, 020, 024, and 026 to "currently unsupported" section of FF-694
  • clarified FF-694 in that host does not need to show item actions as buttons
  • updated diagrams in FF-694 for TC_MN_002
  • corrected FF-694 procedures to enter proper value for TC_COND_0058
  • clarified FF-694 for menu behavior for TC_MN_004
  • added TC_MN_000 in DDL to correlate with FF-694
  • DDL and procedures for persistent data test cases were broken into two methods
  • corrected conditional validity definitions for all items
  • updated FF-694 diagram for number of lines in TC_CH_021
  • clarified dialog title inconsistency for TC_CH_06 between FF-694 and DDL
  • clarified expected menu appearence for TC_CH_06 in FF-694
  • changed ""msec" to "ms" for units subtest in FF-694
  • clarified write value for TC_CH_COND_0050 in FF-694
  • modified DDL for TC_MN_013 menu hierachy to match FF-694
  • syncronized page menu titles between FF-694 and DDL
  • syncronized menu title inconsistencies between FF-694 and DDL
  • enhanced min/max limits test procedure to test inside & outside constraints
  • changed v_bool item from enumerated to boolean in DDL
  • removed R_DS148, R_DS151, R_DS158 from users guide
  • changed FLOAT[2] to FLOAT in users guide
  • removed test step for conditional evaluation of unary negation of unsigned until firmware is updated
  • completed builtins test method
  • enhanced conditional test case procedures and menu structure for more efficient testing
  • resolved several inconsistencies between FF-694 and DDL for chart test cases
  • erroneous duplicate subtests removed in FF-694
  • erroneous duplicate subtests removed in FF-694
  • changed images in FF-694 for Chart 002 to have same line colors
  • updated example images in FF-694 for charts with multiple sources
  • syncronized Y-Axis labels between FF-694 and DDL
  • syncronized Chart 002 range between FF-694 and DDL
  • added wording to FF-694 on array configuration in "input" menus
  • syncronized menu structures between FF-694 and DDL
  • syncronized graph/chart titles/help between FF-694 and DDL