mirror of
https://github.com/jorijn/meshcore-stats.git
synced 2026-03-28 17:42:55 +01:00
* test: add comprehensive pytest test suite with 95% coverage Add full unit and integration test coverage for the meshcore-stats project: - 1020 tests covering all modules (db, charts, html, reports, client, etc.) - 95.95% code coverage with pytest-cov (95% threshold enforced) - GitHub Actions CI workflow for automated testing on push/PR - Proper mocking of external dependencies (meshcore, serial, filesystem) - SVG snapshot infrastructure for chart regression testing - Integration tests for collection and rendering pipelines Test organization: - tests/charts/: Chart rendering and statistics - tests/client/: MeshCore client and connection handling - tests/config/: Environment and configuration parsing - tests/database/: SQLite operations and migrations - tests/html/: HTML generation and Jinja templates - tests/reports/: Report generation and formatting - tests/retry/: Circuit breaker and retry logic - tests/unit/: Pure unit tests for utilities - tests/integration/: End-to-end pipeline tests 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * chore: add test-engineer agent configuration Add project-local test-engineer agent for pytest test development, coverage analysis, and test review tasks. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * docs: comprehensive test suite review with 956 tests analyzed Conducted thorough review of all 956 test cases across 47 test files: - Unit Tests: 338 tests (battery, metrics, log, telemetry, env, charts, html, reports, formatters) - Config Tests: 53 tests (env loading, config file parsing) - Database Tests: 115 tests (init, insert, queries, migrations, maintenance, validation) - Retry Tests: 59 tests (circuit breaker, async retries, factory) - Charts Tests: 76 tests (transforms, statistics, timeseries, rendering, I/O) - HTML Tests: 81 tests (site generation, Jinja2, metrics builders, reports index) - Reports Tests: 149 tests (location, JSON/TXT formatting, aggregation, counter totals) - Client Tests: 63 tests (contacts, connection, meshcore availability, commands) - Integration Tests: 22 tests (reports, collection, rendering pipelines) Results: - Overall Pass Rate: 99.7% (953/956) - 3 tests marked for improvement (empty test bodies in client tests) - 0 tests requiring fixes Key findings documented in test_review/tests.md including quality observations, F.I.R.S.T. principle adherence, and recommendations. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * test: implement snapshot testing for charts and reports Add comprehensive snapshot testing infrastructure: SVG Chart Snapshots: - Deterministic fixtures with fixed timestamps (2024-01-15 12:00:00) - Tests for gauge/counter metrics in light/dark themes - Empty chart and single-point edge cases - Extended normalize_svg_for_snapshot_full() for reproducible comparisons TXT Report Snapshots: - Monthly/yearly report snapshots for repeater and companion - Empty report handling tests - Tests in tests/reports/test_snapshots.py Infrastructure: - tests/snapshots/conftest.py with shared fixtures - UPDATE_SNAPSHOTS=1 environment variable for regeneration - scripts/generate_snapshots.py for batch snapshot generation Run `UPDATE_SNAPSHOTS=1 pytest tests/charts/test_chart_render.py::TestSvgSnapshots` to generate initial snapshots. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * test: fix SVG normalization and generate initial snapshots Fix normalize_svg_for_snapshot() to handle: - clipPath IDs like id="p47c77a2a6e" - url(#p...) references - xlink:href="#p..." references - <dc:date> timestamps Generated initial snapshot files: - 7 SVG chart snapshots (gauge, counter, empty, single-point in light/dark) - 6 TXT report snapshots (monthly/yearly for repeater/companion + empty) All 13 snapshot tests now pass. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * test: fix SVG normalization to preserve axis rendering The SVG normalization was replacing all matplotlib-generated IDs with the same value, causing duplicate IDs that broke SVG rendering: - Font glyphs, clipPaths, and tick marks all got id="normalized" - References couldn't resolve to the correct elements - X and Y axes failed to render in normalized snapshots Fix uses type-specific prefixes with sequential numbering: - glyph_N for font glyphs (DejaVuSans-XX patterns) - clip_N for clipPath definitions (p[0-9a-f]{8,} patterns) - tick_N for tick marks (m[0-9a-f]{8,} patterns) This ensures all IDs remain unique while still being deterministic for snapshot comparison. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * chore: add coverage and pytest artifacts to gitignore Add .coverage, .coverage.*, htmlcov/, and .pytest_cache/ to prevent test artifacts from being committed. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * style: fix all ruff lint errors across codebase - Sort and organize imports (I001) - Use modern type annotations (X | Y instead of Union, collections.abc) - Remove unused imports (F401) - Combine nested if statements (SIM102) - Use ternary operators where appropriate (SIM108) - Combine nested with statements (SIM117) - Use contextlib.suppress instead of try-except-pass (SIM105) - Add noqa comments for intentional SIM115 violations (file locks) - Add TYPE_CHECKING import for forward references - Fix exception chaining (B904) All 1033 tests pass. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * docs: add TDD workflow and pre-commit requirements to CLAUDE.md - Add mandatory test-driven development workflow (write tests first) - Add pre-commit requirements (must run lint and tests before committing) - Document test organization and running commands - Document 95% coverage requirement 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * fix: resolve mypy type checking errors with proper structural fixes - charts.py: Create PeriodConfig dataclass for type-safe period configuration, use mdates.date2num() for matplotlib datetime handling, fix x-axis limits for single-point charts - db.py: Add explicit int() conversion with None handling for SQLite returns - env.py: Add class-level type annotations to Config class - html.py: Add MetricDisplay TypedDict, fix import order, add proper type annotations for table data functions - meshcore_client.py: Add return type annotation Update tests to use new dataclass attribute access and regenerate SVG snapshots. Add mypy step to CLAUDE.md pre-commit requirements. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * fix: cast Jinja2 template.render() to str for mypy Jinja2's type stubs declare render() as returning Any, but it actually returns str. Wrap with str() to satisfy mypy's no-any-return check. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * ci: improve workflow security and reliability - test.yml: Pin all actions by SHA, add concurrency control to cancel in-progress runs on rapid pushes - release-please.yml: Pin action by SHA, add 10-minute timeout - conftest.py: Fix snapshot_base_time to use explicit UTC timezone for consistent behavior across CI and local environments Regenerate SVG snapshots with UTC-aware timestamps. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * fix: add mypy command to permissions in settings.local.json * test: add comprehensive script tests with coroutine warning fixes - Add tests/scripts/ with tests for collect_companion, collect_repeater, and render scripts (1135 tests total, 96% coverage) - Fix unawaited coroutine warnings by using AsyncMock properly for async functions and async_context_manager_factory fixture for context managers - Add --cov=scripts to CI workflow and pyproject.toml coverage config - Omit scripts/generate_snapshots.py from coverage (dev utility) 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * docs: migrate claude setup to codex skills * feat: migrate dependencies to uv (#31) * fix: run tests through uv * test: fix ruff lint issues in tests Consolidate patch context managers and clean unused imports/variables Use datetime.UTC in snapshot fixtures * test: avoid unawaited async mocks in entrypoint tests * ci: replace codecov with github coverage artifacts Add junit XML output and coverage summary in job output Upload HTML and XML coverage artifacts (3.12 only) on every run --------- Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
332 lines
10 KiB
Python
332 lines
10 KiB
Python
"""Tests for database migration system."""
|
|
|
|
import sqlite3
|
|
from pathlib import Path
|
|
|
|
import pytest
|
|
|
|
from meshmon.db import (
|
|
_apply_migrations,
|
|
_get_migration_files,
|
|
_get_schema_version,
|
|
_set_schema_version,
|
|
get_schema_version,
|
|
)
|
|
|
|
|
|
class TestGetMigrationFiles:
|
|
"""Tests for _get_migration_files function."""
|
|
|
|
def test_finds_migration_files(self):
|
|
"""Should find actual migration files in MIGRATIONS_DIR."""
|
|
migrations = _get_migration_files()
|
|
|
|
assert len(migrations) >= 2
|
|
# Should include 001 and 002
|
|
versions = [v for v, _ in migrations]
|
|
assert 1 in versions
|
|
assert 2 in versions
|
|
|
|
def test_returns_sorted_by_version(self):
|
|
"""Migrations should be sorted by version number."""
|
|
migrations = _get_migration_files()
|
|
|
|
versions = [v for v, _ in migrations]
|
|
assert versions == sorted(versions)
|
|
|
|
def test_returns_path_objects(self):
|
|
"""Each migration should have a Path object."""
|
|
migrations = _get_migration_files()
|
|
|
|
for _version, path in migrations:
|
|
assert isinstance(path, Path)
|
|
assert path.exists()
|
|
assert path.suffix == ".sql"
|
|
|
|
def test_extracts_version_from_filename(self):
|
|
"""Version number extracted from filename prefix."""
|
|
migrations = _get_migration_files()
|
|
|
|
for version, path in migrations:
|
|
filename_version = int(path.stem.split("_")[0])
|
|
assert version == filename_version
|
|
|
|
def test_empty_when_no_migrations_dir(self, tmp_path, monkeypatch):
|
|
"""Returns empty list when migrations dir doesn't exist."""
|
|
fake_dir = tmp_path / "nonexistent"
|
|
monkeypatch.setattr("meshmon.db.MIGRATIONS_DIR", fake_dir)
|
|
|
|
migrations = _get_migration_files()
|
|
|
|
assert migrations == []
|
|
|
|
def test_skips_invalid_filenames(self, tmp_path, monkeypatch):
|
|
"""Skips files without valid version prefix."""
|
|
migrations_dir = tmp_path / "migrations"
|
|
migrations_dir.mkdir()
|
|
|
|
# Create valid migration
|
|
(migrations_dir / "001_valid.sql").write_text("-- valid")
|
|
# Create invalid migrations
|
|
(migrations_dir / "invalid_name.sql").write_text("-- invalid")
|
|
(migrations_dir / "abc_noversion.sql").write_text("-- no version")
|
|
|
|
monkeypatch.setattr("meshmon.db.MIGRATIONS_DIR", migrations_dir)
|
|
|
|
migrations = _get_migration_files()
|
|
|
|
assert len(migrations) == 1
|
|
assert migrations[0][0] == 1
|
|
|
|
|
|
class TestGetSchemaVersion:
|
|
"""Tests for _get_schema_version internal function."""
|
|
|
|
def test_returns_zero_for_fresh_db(self, tmp_path):
|
|
"""Fresh database with no db_meta returns 0."""
|
|
db_path = tmp_path / "test.db"
|
|
conn = sqlite3.connect(db_path)
|
|
|
|
version = _get_schema_version(conn)
|
|
|
|
assert version == 0
|
|
conn.close()
|
|
|
|
def test_returns_stored_version(self, tmp_path):
|
|
"""Returns version from db_meta table."""
|
|
db_path = tmp_path / "test.db"
|
|
conn = sqlite3.connect(db_path)
|
|
conn.execute("""
|
|
CREATE TABLE db_meta (
|
|
key TEXT PRIMARY KEY NOT NULL,
|
|
value TEXT NOT NULL
|
|
)
|
|
""")
|
|
conn.execute(
|
|
"INSERT INTO db_meta (key, value) VALUES ('schema_version', '5')"
|
|
)
|
|
conn.commit()
|
|
|
|
version = _get_schema_version(conn)
|
|
|
|
assert version == 5
|
|
conn.close()
|
|
|
|
def test_returns_zero_when_key_missing(self, tmp_path):
|
|
"""Returns 0 if db_meta exists but schema_version key is missing."""
|
|
db_path = tmp_path / "test.db"
|
|
conn = sqlite3.connect(db_path)
|
|
conn.execute("""
|
|
CREATE TABLE db_meta (
|
|
key TEXT PRIMARY KEY NOT NULL,
|
|
value TEXT NOT NULL
|
|
)
|
|
""")
|
|
conn.execute(
|
|
"INSERT INTO db_meta (key, value) VALUES ('other_key', 'value')"
|
|
)
|
|
conn.commit()
|
|
|
|
version = _get_schema_version(conn)
|
|
|
|
assert version == 0
|
|
conn.close()
|
|
|
|
|
|
class TestSetSchemaVersion:
|
|
"""Tests for _set_schema_version internal function."""
|
|
|
|
def test_inserts_new_version(self, tmp_path):
|
|
"""Can insert schema version into fresh db_meta."""
|
|
db_path = tmp_path / "test.db"
|
|
conn = sqlite3.connect(db_path)
|
|
conn.execute("""
|
|
CREATE TABLE db_meta (
|
|
key TEXT PRIMARY KEY NOT NULL,
|
|
value TEXT NOT NULL
|
|
)
|
|
""")
|
|
|
|
_set_schema_version(conn, 3)
|
|
conn.commit()
|
|
|
|
cursor = conn.execute(
|
|
"SELECT value FROM db_meta WHERE key = 'schema_version'"
|
|
)
|
|
assert cursor.fetchone()[0] == "3"
|
|
conn.close()
|
|
|
|
def test_updates_existing_version(self, tmp_path):
|
|
"""Can update existing schema version."""
|
|
db_path = tmp_path / "test.db"
|
|
conn = sqlite3.connect(db_path)
|
|
conn.execute("""
|
|
CREATE TABLE db_meta (
|
|
key TEXT PRIMARY KEY NOT NULL,
|
|
value TEXT NOT NULL
|
|
)
|
|
""")
|
|
conn.execute(
|
|
"INSERT INTO db_meta (key, value) VALUES ('schema_version', '1')"
|
|
)
|
|
conn.commit()
|
|
|
|
_set_schema_version(conn, 5)
|
|
conn.commit()
|
|
|
|
cursor = conn.execute(
|
|
"SELECT value FROM db_meta WHERE key = 'schema_version'"
|
|
)
|
|
assert cursor.fetchone()[0] == "5"
|
|
conn.close()
|
|
|
|
|
|
class TestApplyMigrations:
|
|
"""Tests for _apply_migrations function."""
|
|
|
|
def test_applies_all_migrations_to_fresh_db(self, tmp_path, monkeypatch):
|
|
"""Applies all migrations to a fresh database."""
|
|
# Create mock migrations
|
|
migrations_dir = tmp_path / "migrations"
|
|
migrations_dir.mkdir()
|
|
|
|
(migrations_dir / "001_initial.sql").write_text("""
|
|
CREATE TABLE IF NOT EXISTS db_meta (
|
|
key TEXT PRIMARY KEY NOT NULL,
|
|
value TEXT NOT NULL
|
|
);
|
|
CREATE TABLE test1 (id INTEGER);
|
|
""")
|
|
(migrations_dir / "002_second.sql").write_text("""
|
|
CREATE TABLE test2 (id INTEGER);
|
|
""")
|
|
|
|
monkeypatch.setattr("meshmon.db.MIGRATIONS_DIR", migrations_dir)
|
|
|
|
db_path = tmp_path / "test.db"
|
|
conn = sqlite3.connect(db_path)
|
|
|
|
_apply_migrations(conn)
|
|
|
|
# Check both tables exist
|
|
cursor = conn.execute(
|
|
"SELECT name FROM sqlite_master WHERE type='table' ORDER BY name"
|
|
)
|
|
tables = [row[0] for row in cursor]
|
|
assert "test1" in tables
|
|
assert "test2" in tables
|
|
assert "db_meta" in tables
|
|
|
|
# Check version is updated
|
|
assert _get_schema_version(conn) == 2
|
|
conn.close()
|
|
|
|
def test_skips_already_applied_migrations(self, tmp_path, monkeypatch):
|
|
"""Skips migrations that have already been applied."""
|
|
migrations_dir = tmp_path / "migrations"
|
|
migrations_dir.mkdir()
|
|
|
|
(migrations_dir / "001_initial.sql").write_text("""
|
|
CREATE TABLE IF NOT EXISTS db_meta (
|
|
key TEXT PRIMARY KEY NOT NULL,
|
|
value TEXT NOT NULL
|
|
);
|
|
CREATE TABLE test1 (id INTEGER);
|
|
""")
|
|
(migrations_dir / "002_second.sql").write_text("""
|
|
CREATE TABLE test2 (id INTEGER);
|
|
""")
|
|
|
|
monkeypatch.setattr("meshmon.db.MIGRATIONS_DIR", migrations_dir)
|
|
|
|
db_path = tmp_path / "test.db"
|
|
conn = sqlite3.connect(db_path)
|
|
|
|
# Apply first time
|
|
_apply_migrations(conn)
|
|
|
|
# Apply second time - should not fail
|
|
_apply_migrations(conn)
|
|
|
|
assert _get_schema_version(conn) == 2
|
|
conn.close()
|
|
|
|
def test_raises_when_no_migrations(self, tmp_path, monkeypatch):
|
|
"""Raises error when no migration files exist."""
|
|
empty_dir = tmp_path / "empty_migrations"
|
|
empty_dir.mkdir()
|
|
monkeypatch.setattr("meshmon.db.MIGRATIONS_DIR", empty_dir)
|
|
|
|
db_path = tmp_path / "test.db"
|
|
conn = sqlite3.connect(db_path)
|
|
|
|
with pytest.raises(RuntimeError, match="No migration files found"):
|
|
_apply_migrations(conn)
|
|
|
|
conn.close()
|
|
|
|
def test_rolls_back_failed_migration(self, tmp_path, monkeypatch):
|
|
"""Rolls back if a migration fails."""
|
|
migrations_dir = tmp_path / "migrations"
|
|
migrations_dir.mkdir()
|
|
|
|
(migrations_dir / "001_initial.sql").write_text("""
|
|
CREATE TABLE IF NOT EXISTS db_meta (
|
|
key TEXT PRIMARY KEY NOT NULL,
|
|
value TEXT NOT NULL
|
|
);
|
|
CREATE TABLE test1 (id INTEGER);
|
|
""")
|
|
(migrations_dir / "002_broken.sql").write_text("""
|
|
THIS IS NOT VALID SQL;
|
|
""")
|
|
|
|
monkeypatch.setattr("meshmon.db.MIGRATIONS_DIR", migrations_dir)
|
|
|
|
db_path = tmp_path / "test.db"
|
|
conn = sqlite3.connect(db_path)
|
|
|
|
with pytest.raises(RuntimeError, match="Migration.*failed"):
|
|
_apply_migrations(conn)
|
|
|
|
# Version should still be 1 (first migration applied)
|
|
assert _get_schema_version(conn) == 1
|
|
conn.close()
|
|
|
|
|
|
class TestPublicGetSchemaVersion:
|
|
"""Tests for public get_schema_version function."""
|
|
|
|
def test_returns_zero_when_db_missing(self, configured_env):
|
|
"""Returns 0 when database file doesn't exist."""
|
|
version = get_schema_version()
|
|
assert version == 0
|
|
|
|
def test_returns_version_from_existing_db(self, initialized_db):
|
|
"""Returns schema version from initialized database."""
|
|
version = get_schema_version()
|
|
|
|
# Should be at least version 2 (we have 2 migrations)
|
|
assert version >= 2
|
|
|
|
def test_uses_readonly_connection(self, initialized_db, monkeypatch):
|
|
"""Opens database in readonly mode."""
|
|
calls = []
|
|
original_get_connection = __import__(
|
|
"meshmon.db", fromlist=["get_connection"]
|
|
).get_connection
|
|
|
|
from contextlib import contextmanager
|
|
|
|
@contextmanager
|
|
def mock_get_connection(*args, **kwargs):
|
|
calls.append(kwargs)
|
|
with original_get_connection(*args, **kwargs) as conn:
|
|
yield conn
|
|
|
|
monkeypatch.setattr("meshmon.db.get_connection", mock_get_connection)
|
|
|
|
get_schema_version()
|
|
|
|
assert any(call.get("readonly") is True for call in calls)
|