vpsvip 0.4.0 - native OpenBSD acceptance checklist

Status: these are tests to run, not a claim that native acceptance passed.
Use a disposable OpenBSD 7.8 VM with console access, a snapshot, and test data.
Do not run package removal, kernel changes, cron experiments, or destructive
native-program checks on a production machine. Record actual results and any
unsupported commands or ownership constraints; do not replace failure with a
simulated success.

System/architecture: __________________  Python: __________________
Terminal: ____________________________  Date: ____________________
Tester: _________________________________________________________

1. Install, upgrade, and command-line output

   Run the unittest suite with the intended installed Python. Extract the
   0.4.0 archive into its own source directory and use its install.py with the
   actual versioned interpreter and existing --prefix. Verify --version reports
   vpsvip 0.4.0; check --help and man 8 vpsvip. On a VM with rcpanel 0.3.5
   installed, or a VM with vpsvippanel 0.3.6, confirm sbin/vpsvip runs 0.4.0
   and all older version trees remain. Confirm trusted generated sbin/rcpanel
   and sbin/vpsvippanel launchers also run the new version. A customized or
   linked old launcher must remain unchanged with
   an explicit installer notice. A clean install creates neither historical
   command. An unrelated regular sbin/vpsvip must be preserved and block the
   install. Check that a detected concurrent primary-launcher change also stops
   replacement. Required source/document failures must precede publication.
   Compare service state and configuration before/after installation: neither
   should change. Verify saved panel state is not rewritten by the installer.
   Confirm existing preferences, saved commands, and the downloaded package
   catalog load from .config/rcpanel, and existing .rcpanel-backups remain
   accessible. Verify old and new processes use the same configuration and
   package locks. Check exact legacy httpd/smtpd form files remain recognized;
   a reviewed form save uses the new header while manual files stay protected.
   Reinstall identical code successfully; reject changed code under the same
   version before launcher replacement. Verify the launcher uses -I and the
   intended exact interpreter. Confirm privileged actions require root and
   explicitly invoked native programs retain the account's ordinary permissions.

   Exercise --map, --map network, --programs, --programs ssh, --packages,
   --settings, --status, and --status sshd without curses or a startup notice.
   The targeted form must show only sshd; nonexistent/malformed names must fail.
   Compare live
   output to the VM. Exercise all with
   --demo; native host inventories/services/package records must not be read
   or changed by simulated administration. EDITOR remains a real editor on a
   temporary file. Verify live mode refuses a non-OpenBSD host.

   Outcome: _____________________________________________________

2. Map, numeric navigation, and terminal restoration

   Verify the exact existing BLOODGUILT CURSE wording and credits on every
   interactive launch, including demo. Try ordinary keys including Enter,
   q, 0, and 4: each continues from the notice. Resize must not dismiss it.
   Ctrl+C must exit. Ctrl+Z must suspend and restore the shell terminal; fg
   must resume the same screen with working input. Repeat suspend/resume in
   menus, a prompt, and a viewer. Startup remains enabled with hints disabled.

   Walk all 12 categories; compare the static listing to SYSTEM-MAP.txt. Confirm 8/2
   move, 5/6 open, 4 returns, and 0 returns to the top map. Exercise arrows,
   j/k, Enter, Escape, Home/End, and paging. Return to long menus and verify
   each retains its own selection and scroll position. Search with /.
   Verify configuration labels begin with the real basename, including
   smtpd.conf, and show the full unambiguous path on the information/file page.

   Jump with : to 3*1*1 and 3*1*1#; both must only open the endpoint, with no
   command executed. Try malformed and missing codes. Type digits including
   0/2/4/5/6/8 into text fields; they must remain data. In a text viewer,
   Left/Right must scroll long lines, while Escape/4 returns. Exercise / search,
   n/N match movement, and w wrapping on long, empty, and control-escaped output.
   Page Down and Space must advance a screen, and Page Up must go back. The
   status must show End on the last screen, including a short manual. Pressing
   n/N without a search must explain how to start one.
   Resize through
   small and normal sizes in menus, fields, forms, and viewers. Exit normally
   and through an error; terminal input/echo must be restored.

   During a slow read, tap Escape once and verify return without waiting for
   the query's normal timeout. Repeat with 4/q and with 0 returning to the map.
   Reopen and cancel repeatedly; no child, worker, descriptor, or lock may be
   left behind and no late result/error viewer may appear. Include a harmless
   child which closes its output before sleeping. Back through service/package
   details, kernel values, and file directories must not start another query.
   Explicit Refresh must still work, and cancelled Refresh must retain the
   prior snapshot. Use harmless fixtures for cancellation tests.

   Outcome: _____________________________________________________

3. Program inventory, manuals, and exact reports

   Open System > Manuals. Compare the displayed intro(5) text to man -c 5 intro;
   this is a brief section overview. Check the complete httpd.conf(5) and
   smtpd.conf(5) references, paging through to the end and searching within
   them. Verify rc.conf is selected from section 8. Check that general native
   manuals are absent from Panel and that manual labels show name(section).

   Inspect all ten inventory groups, including base/local libexec, X11, and
   games where installed. Compare executable paths to the VM's files. Check
   duplicate basenames display distinct full paths. Missing optional groups,
   missing manuals, access failures, and truncated inventory must remain clear.
   Confirm inventory itself does not launch discovered executables.

   Read a synopsis and full manual. Review a harmless command with quoted
   arguments and a specific existing absolute working directory. Cancel once,
   then run it and confirm exact argv/cwd and terminal restoration. Ensure
   invalid quoting fails before launch and shell substitutions stay literal.
   Refresh/remove a disposable executable between review and run; reject a
   stale selection. Test unsafe executable ownership in an isolated directory.

   Run available fixed reports and compare their results to the displayed
   native commands, especially netstat -R, smtpctl show status/queue/stats,
   swapctl -lk, vmctl status, mount without arguments, and syspatch -c/-l.
   Confirm no report changes state. Missing daemons, privileges, hardware,
   or tools must show native failure instead of invented empty success.

   Outcome: _____________________________________________________

4. Runtime kernel settings and persistent file

   Compare the browsable hierarchy with sysctl -a. Search, refresh, and read
   individual names; inspect a multiline value such as kern.version. Using
   an expendable VM setting, record the old value, review a runtime change,
   and compare native sysctl output. Confirm /etc/sysctl.conf is unchanged.
   After closing the result, retain the old snapshot with a refresh note;
   Read current value must obtain the actual value, including normalization.
   Restore the original runtime value explicitly. Attempt a documented
   read-only value and an invalid assignment; display the native failures.
   Reject writes as an ordinary account.

   Separately stage, review, and cancel an edit to /etc/sysctl.conf. If testing
   installation, confirm no sysctl command applies it automatically. Test boot
   persistence only after recording a console recovery method and VM snapshot.

   Outcome: _____________________________________________________

5. Package information and preview/confirmation

   Confirm /etc/installurl is correct for the disposable VM. Compare installed
   names/comments with pkg_info -A, manual-install tags with pkg_info -m, and
   details/files/dependents/messages with their displayed native commands.
   Search a harmless package by plain fragment and select an exact result.
   Check malformed names, paths, URLs, and option-like queries are rejected.
   Run a dry run, inspect the native output and exact command, then cancel;
   no package change may be applied. Preview requires root.

   Explicitly download the full available-name catalog. Check the source,
   release/package architecture, UTC timestamp, count, and status against the
   actual mirror indexes. Confirm the cache file is in the effective user's
   private state directory. Browse and filter the cached not-installed list
   while the network is unavailable; browsing must not download again.
   Compare exact-name exclusions with the installed package inventory.
   Refresh explicitly and verify replacement occurs only after a complete
   successful download. On failure, retain the previous cache and display its
   status rather than presenting a new empty success. Test malformed cache and
   changed mirror/release/architecture; incompatible data must not authorize
   installation. Selecting a cached package still requires a fresh native
   preview, review, and confirmation.

   In this VM only, exercise install, single-package update, remove, upgrade
   all, and unused-dependency removal where applicable. Choose disposable
   packages and retain the panel's Python interpreter. Compare every outcome
   to native inventory using explicit Refresh and inspect package messages.
   Back must remain available without a forced inventory query. Repository
   results and downloaded lists must refresh installed markers locally without
   repeating the repository search or download. A failed or truncated
   preview must not offer application. A used plan must not be reusable.

   Change installed inventory between preview and apply from another session;
   require a new preview. Also change a disposable package's manual/automatic
   tag with native pkg_add -m/-a, without changing its name; require a new
   preview. Try two panel instances; package operation overlap must be refused.
   Native external-client locks remain authoritative; do not claim the preview
   freezes repository contents or every package DB record.

   Outcome: _____________________________________________________

6. Package progress, failures, and disconnect handling

   Observe progress during a real test-VM package operation. Verify native
   output/exit status and final inventory. Confirm there is no automatic
   mutation timeout. During a disposable operation, Ctrl+C must not abandon
   the package writer. Send SIGHUP or SIGTERM while it runs; the panel must
   wait for completion before closing. Reconnect and inspect the actual state.
   Request Ctrl+Z during a disposable operation; suspend only after the worker
   completes, then resume and inspect the result. Use harmless worker fixtures
   for repeatable long-operation tests instead of interrupting package writes.
   Escape during an applying change must show its protected status without
   killing the child. Escape during a preview or catalog download must cancel
   instead; a cancelled download before publication must retain the old cache.

   Exercise an unreachable mirror or unavailable package without force flags.
   Show the failure and require fresh review; no retry or rollback is automatic.
   Do not forcibly interrupt a package writer merely to satisfy this checklist.
   Test slow/large-output and observer-error paths with the portable harmless
   child-process tests, not by corrupting a package database. Confirm inherited
   PKG_PATH/PKG_DBDIR do not redirect panel package operations.

   Outcome: _____________________________________________________

7. Editor, configuration roots, validation, and recovery

   Carry EDITOR through doas explicitly. Edit a staged file and independently
   check the live contents remain unchanged before installation. Inspect the
   full diff and cancel. Repeat with malformed EDITOR, missing executable,
   nonzero editor exit, and Ctrl+C inside the editor. Use a wait option for
   editors that detach. Confirm terminal restoration and no implicit install.
   Verify a saved editor override precedes EDITOR, clearing it restores the
   environment choice, and clearing both falls back to /usr/bin/vi. Suspend
   the foreground editor with normal job control and resume it; the draft
   must remain uninstalled until explicitly reviewed and installed.

   Exercise supported root-owned files below /etc, /var/unbound/etc, and
   /var/nsd/etc. Record refusal of unsupported daemon-owned directories/files;
   do not weaken ownership to hide it. Compare backup bytes, mode 0600, private
   directory mode 0700, and preserved installed metadata. Test a live-file
   conflict, competing panel lock, and restore through the target's menu.

   Exercise all available registered validators, including both DNS checkers,
   with valid and invalid disposable candidates. No validator should apply
   configuration. Check relative includes and report files without validators.
   Use an alternate daemon configuration path explicitly rather than assuming
   the catalog default is active. Keep includes stable during a transaction.
   Cancel a standalone validation and confirm its worker exits before the
   private validation copy is removed. Preserve the staged draft and live file.
   Configuration installation remains protected once applying.

   In the VM only, test a harmless temporary /etc/crontab entry and confirm the
   effect notice explains automatic reload. Remove it and restore the original
   file afterward. Verify a file install issues no rcctl action while acknowledging
   that a native reader can use new contents immediately or on its next read.

   Outcome: _____________________________________________________

8. Existing services and structured forms

   Compare service Boot/Now states with rcctl ls all/on/started and get for a
   base daemon, package daemon, disabled daemon, and boot-only setting. Confirm
   disable does not stop a daemon and stop does not disable startup. Check
   rc.conf.local backup before enable/disable/flag changes. Show actual nonzero
   results for unsupported reload/configtest actions. Use a disposable slow
   rc.d test script with an intentional delay and native daemon_timeout; verify
   that the panel does not impose its old outer kill timer. Check nonzero native
   results, refresh state, and verify no retry. Check a valid _prefixed custom
   service name. Reject # in plain daemon flags before saving, since native
   configuration comment handling cannot preserve that value reliably.

   Generate the default HTTP configuration, validate it, supply test content
   in /var/www/htdocs, explicitly enable/start httpd, and test loopback port
   8080. Exercise listing off/on. Add an unfamiliar comment and verify the form
   refuses silent adoption; test explicit replacement and typed confirmation.

   Save the original smtpd.conf. Validate both local mbox/Maildir variants and
   test delivery to a disposable account. Check lo0 binding and outbound-rule
   off/on behavior; no public listener or IMAP setup should be implied. Restore
   the test machine's original files and service state when finished.

   Outcome: _____________________________________________________

9. Preference drafts, persistence, and recovery

   Open Panel preferences and edit every option. Back/Discard must preserve
   both the file and active settings. Save must persist and apply the draft;
   restart and verify preferences under the same effective account. Test root
   and an ordinary user separately, and confirm inherited HOME cannot select
   another account's state directory. Demo settings must disappear on exit.
   Open the Editor preference at 60 and 80 columns. Read its entire explanation,
   including the last word, while keeping the field visible. Resize while
   editing and verify the draft and cursor are preserved. Page Up/Page Down
   must reveal long input help without inserting characters into the field.
   Change saved preferences in a second panel; reject a stale save in the first.
   Reload without writing. A changed draft must prompt before being discarded;
   cancelling Reload keeps the draft, and a failed Reload must not apply a
   guessed value or overwrite the file.

   Check page overlap boundaries 0 and 10, recent limits 0 and 50, malformed
   numbers, invalid startup codes, quoted editor arguments, bad quoting, and
   relative/nonexistent native working directories. A startup endpoint must
   only open its page. Toggle hints, cursor memory, and default wrapping and
   confirm actual behavior without disabling the warning or confirmations.

   Make a disposable preference file malformed. Report it, use session defaults,
   and leave its bytes intact. Ordinary Save must not silently replace it.
   Cancel default reset once; then explicitly confirm it. Clear favorites,
   retain saved commands/catalog, and apply the defaults. Unsafe permissions,
   linked files, or ownership problems must never be bypassed by default reset.
   Simulate a save failure and confirm active settings remain unchanged.

   Outcome: _____________________________________________________

10. Favorites, recent pages, and saved native commands

   Add/remove endpoint favorites with f. Restart and verify favorite persistence.
   Reopen favorites and recent pages without running an action. Check the recent
   limit, duplicate-page behavior, and zero disabling recording. Recent history
   must not persist across launches. Verify released map codes still resolve
   to the same functions, including 12*3, 12*4, and 12*5 native manuals.
   The relocated manuals must show System breadcrumbs. Upgrade preferences
   with one of these startup choices and favorites; load without changing
   disk bytes, remove a relocated favorite, then Save and confirm canonical
   System codes. A second writer's intervening change must still block Save.

   Save a harmless named command with quoted arguments and an absolute working
   directory. Restart, load it from Panel, and inspect the reopened program
   page; loading must not launch it. Cancel invocation, then approve it and
   verify exact argv/cwd. Reject a missing or untrusted executable at launch.
   Test replacement/removal confirmation and malformed command storage without
   silently discarding existing records. Confirm reset of ordinary preferences
   retains named commands.

   Outcome: _____________________________________________________

11. Security maintenance acceptance

   On the disposable VM, confirm that root refuses a user-owned editor and a
   root-owned executable reached through an untrusted directory. A bare editor
   name must use the fixed system PATH even with an untrusted PATH inherited by
   the panel. Confirm that EXINIT/VIMINIT, shell startup variables, caller HOME,
   and Python/loader environment overrides do not reach the editor. Verify the
   chosen foreground editor still handles UTF-8 configuration bytes correctly
   under the documented C locale. Check normal Ctrl+C/Ctrl+Z/fg handoff.

   Change a disposable staged draft while its install confirmation is open.
   Installation must refuse the stale review. Repeat with a replacement inode
   containing identical text and with a changed private staging directory.
   Verify both current-file validation and staged validation use private copies
   and never install or accept bytes changed by the check. Keep the target and
   its backup content under independent observation in this VM.

   After live package search or preview, change the disposable VM's installurl.
   Install/update/update-all must require a fresh search or preview. Restore
   installurl afterward. Deletion must not require a working mirror. Verify
   native package signature checks remain enabled and incomplete preview output
   never authorizes a package change.

   In an isolated installation prefix, set an application directory to 1777.
   Reinstallation must refuse it before switching the launcher. Restore its
   original mode. Verify the live installer rejects an untrusted interpreter.
   Run the installed launcher with hostile cwd/PYTHONPATH and confirm isolated
   imports. Do not run malicious payloads on a production server.

   Exercise a harmless helper whose child retains stdout after the parent
   exits. The panel must return the parent's status, report incomplete capture,
   and avoid killing the background process group. Custom daemon output must
   be redirected using the native service's normal configuration; a later write
   to a closed capture pipe can still fail. Record native rc.subr behavior.

   Outcome: _____________________________________________________

12. Small VPS and SSH behavior

   Record the guest's RAM/CPU allocation and native Python version. Observe
   panel memory while viewing bounded large reports with short and long lines,
   both wrapped and unwrapped. Page, search, resize, and return to the map;
   controls must remain escaped and final rows must remain reachable.

   Open one service directly and Refresh it. Observe fresh rcctl ls all
   membership followed by get NAME status and, as root for a daemon, check NAME.
   There must be no ls on/started or unrelated daemon checks on this path.
   Compare the silent get-status exit code and normal check output to the
   panel's boot/runtime labels. Check a disabled-but-running daemon and a
   boot-only setting. Unexpected custom-script diagnostics must remain unknown.

   In Kernel settings, complete the inventory and then Read current value.
   Observe one sysctl NAME command, including for kern.version's multiline
   output. There must be no additional sysctl -a around that selected read.
   Runtime changes must still perform the fresh membership check. Failed,
   malformed, interrupted, and incomplete reads must retain the prior snapshot.

   Open the saved package catalog and compare installed markers. Filter and
   return through details with no mirror query. Reopen after altering a
   disposable catalog fixture; validation must still run before use. Install
   previews must independently revalidate the selected package and source.

   Follow VPS.txt's tmux workflow using the guest account. Detach and reattach,
   and exercise an SSH disconnect with harmless read work. Confirm the panel
   and terminal remain usable after reattachment. Record native resource
   observations separately from the synthetic Linux performance measurements.

   Outcome: _____________________________________________________

Acceptance decision and unresolved issues:

_________________________________________________________________
_________________________________________________________________
_________________________________________________________________

0.4.0 GUIDED SETUP AND FAILURE REGRESSIONS

Open 8*7# and confirm no service or configuration changes occur on entry,
viewing settings, reading manuals, or canceling a choice. Test a base daemon
and one installed package daemon. Default paths must match the known catalog;
unregistered files require a real administrator-entered path and keep their
manual-review status. A different file selected by flags is not guessed.

Enable and Start must require separate confirmations. Keep a known failing
configuration and check that failure does not trigger enable/start/retry.
Inspect native configtest scope, including a script without a substantive test.
Refresh must show actually observed boot/runtime state, retain warnings, and
never claim network readiness. Failed/canceled refresh must not make stale
state appear current. Installing a package must mark the daemon list stale
until an explicit refresh. Completed earlier changes remain on exit.

Use a controlled temporary filesystem or fault injection to verify a failed
built-in draft update retains its previous complete contents and review.
Verify subsequent settings/catalog saves work after a failed temporary-file
cleanup. Repeated canceled package previews, including cancellation at worker
completion, must not retain abandoned authorization or captured output.

Search far along a long line, toggle wrapping, and resize: the match/position
must remain visible. Test a saved path with escaped non-ASCII characters and
edit around it without cursor drift. Run a harmless foreground program and
press Ctrl+C at its return prompt: the panel must close cleanly.

Outcome: _________________________________________________________
