* fix: correct traceroute path orientation when building graph edges
A completed traceroute is observed as a response packet, whose from/to are
reversed with respect to the path being traced: `to` is the node that started
the traceroute and `from` is the node that answered. Meshview assembled paths
as [from, *route, to], so both endpoint-adjacent edges were wrong for every
completed traceroute with at least one intermediate hop. Because the false
edges always attach to the endpoints, a busy initiator or gateway accumulated
false direct links to every remote target it ever traced.
Confirmed against TraceRouteModule::alterReceivedProtobuf, which renders a
response as printRoute(r, p.to, p.from, false), against the meshtastic python
CLI, which starts the forward path at p["to"] and the return path at p["from"],
and against real recorded traceroutes where a request's route[] is a prefix of
the matching response's route[].
Add meshview/traceroute.py and use it from /api/edges, /api/traceroute and
graph_traceroute, which had three separate copies of this logic that had all
drifted. /api/traceroute also gains initiator/target so the traceroute page
stops re-deriving the endpoints itself, which is where a fourth copy lived.
While in /api/edges, skip the NODENUM_BROADCAST placeholders that
insertUnknownHops() writes into route[] (they became a pseudo-node hub in the
graph) and guard against the (gateway, gateway) self edge that
graph_traceroute already guarded against.
* fix: do not invent links across unknown hops or unfinished returns
Review of becf4a8 found two remaining path errors.
Dropping NODENUM_BROADCAST from route[] during assembly joined the nodes
either side of it, so A -> B -> ? -> C -> D became A -> B -> C -> D and a
lone unknown hop collapsed into a false direct A -> D. Keep the placeholder
in the path and skip the edges that touch it instead. On a 2660 row sample
this removes 10 links that do not exist.
done=True only means a response was observed, not that it arrived. A gateway
usually reports one still travelling home with route_back holding just the
hops so far, so always appending the initiator claimed a final link that was
never seen. Append it only when the response reached the initiator, which the
spare snr_back entry from SNRonly=isToUs() marks. Note this is rare in
practice: 2 of 303 real responses, since the entry is added by the initiator
and gateways see packets in flight.
The deduplicated unique_forward_paths and unique_reverse_paths carry no
per-observation provenance, so the traceroute page can no longer tell which
of them reached the far endpoint. It now adds only the adjacent endpoint.
* fix: treat a response as proof the forward path reached the target
Winning path selection required return hops, so a response observed before
its first return hop contributed nothing and the page fell back to the
deduplicated reported paths, which cannot tell which of them reached the
target. A response with route=[B,C] and no route_back rendered A > B > C,
losing the target and the last link.
Select winning paths from response observations instead. A response only
exists because the request arrived, whatever its return trip went on to do.
Dropping the non-empty forward_hops guard at the same time means a zero hop
response contributes its real direct link, so a fully direct traceroute and a
completed direct return are no longer excluded from the graph.
Mark reported forward paths that some response reported, so the page can
close those on the target and they deduplicate against the winning path
instead of drawing a shorter copy underneath it.
* Add alembic DB schema management (#86)
* Use alembic
* add creation helper
* example migration tool
* Store UTC int time in DB (#81)
* use UTC int time
* Remove old index notes script -- no longer needed
* modify alembic to support cleaner migrations
* add /version json endpoint
* move technical docs
* remove old migrate script
* add readme in docs:
* more doc tidy
* rm
* update api docs
* ignore other database files
* health endpoint
* alembic log format
* break out api calls in to their own file to reduce footprint
* ruff and docs
* vuln
* Improves arguments in mvrun.py
* Set dbcleanup.log location configurable
* mvrun work
* fallback if missing config
* remove unused loop
* improve migrations and fix logging problem with mqtt
* Container using slim/uv
* auto build containers
* symlink
* fix symlink
* checkout and containerfile
* make /app owned by ap0p
* Traceroute Return Path logged and displayed (#97)
* traceroute returns are now logged and /packetlist now graphs the correct data for a return route
* now using alembic to update schema
* HOWTO - Alembic
---------
Co-authored-by: Joel Krauska <jkrauska@gmail.com>
* DB Backups
* backups and cleanups are different
* ruff
* Docker Docs
* setup-dev
* graphviz for dot in Container
* Summary of 3.0.0 stuff
* Alembic was blocking mqtt logs
* Add us first/last timestamps to node table too
* Worked on /api/packet. Needed to modify
- Store.py to read the new time data
- api.py to present the new time data
- firehose.html chat.html and map.html now use the new apis and the time is the browser local time
* Worked on /api/packet. Needed to modify
- Store.py to read the new time data
- api.py to present the new time data
- firehose.html chat.html and map.html now use the new apis and the time is the browser local time
* Improves container build (#94)
* Worked on /api/packet. Needed to modify
- Store.py to read the new time data
- api.py to present the new time data
- firehose.html chat.html and map.html now use the new apis and the time is the browser local time
* Worked on /api/packet. Needed to modify
- Store.py to read the new time data
- api.py to present the new time data
- firehose.html chat.html and map.html now use the new apis and the time is the browser local time
* Worked on /api/packet. Needed to modify
- Added new api endpoint /api/packets_seen
- Modified web.py and store.py to support changes to APIs.
- Started to work on new_node.html and new_packet.html for presentation of data.
* Worked on /api/packet. Needed to modify
- Added new api endpoint /api/packets_seen
- Modified web.py and store.py to support changes to APIs.
- Started to work on new_node.html and new_packet.html for presentation of data.
* Finishing up all the pages for the 3.0 release.
Now all pages are functional.
* Finishing up all the pages for the 3.0 release.
Now all pages are functional.
* fix ruff format
* more ruff
* Finishing up all the pages for the 3.0 release.
Now all pages are functional.
* Finishing up all the pages for the 3.0 release.
Now all pages are functional.
* pyproject.toml requirements
* use sys.executable
* fix 0 epoch dates in /chat
* Make the robots do our bidding
* another compatibility fix when _us is empty and we need to sort by BOTH old and new
* Finishing up all the pages for the 3.0 release.
Now all pages are functional.
* Finishing up all the pages for the 3.0 release.
Now all pages are functional.
* Remamed new_node to node. shorter and descriptive.
* Remamed new_node to node. shorter and descriptive.
* Remamed new_node to node. shorter and descriptive.
* Remamed new_node to node. shorter and descriptive.
* Remamed new_node to node. shorter and descriptive.
* Remamed new_node to node. shorter and descriptive.
* More changes... almost ready for release.
Ranamed 2 pages for easy or reading.
* Fix the net page as it was not showing the date information
* Fix the net page as it was not showing the date information
* Fix the net page as it was not showing the date information
* Fix the net page as it was not showing the date information
* ruff
---------
Co-authored-by: Óscar García Amor <ogarcia@connectical.com>
Co-authored-by: Jim Schrempp <jschrempp@users.noreply.github.com>
Co-authored-by: Pablo Revilla <pablorevilla@gmail.com>
pablorevilla-meshtastic