ConnectPick your DJI aircraft & link the camera feed (or Use Webcam to try it).
2
Set your vesselStart GPS, tap the map, or type coordinates — works anywhere.
3
Plan & exportPick a search pattern → Generate → download the DJI .kmz for Pilot 2.
4
Spot & learnMark fish → they build your hotspot map, logbook, and training data.
Press ? any time for keyboard shortcuts.
1 Aircraft
2 Vessel Location
Works anywhere in the world — the map centers on your boat. Start live GPS tracking so the map, search patterns, and flight plans follow your vessel as it moves. No signal? Set it by tapping the map.
Vessel location not set.
3 Camera Feed
No feed connected.
▸ DJI RTMP → browser gateway setup
DJI drones livestream RTMP, which browsers can't play directly. Run a tiny gateway (MediaMTX) that re-publishes it as HLS or WebRTC. Set your gateway host/IP, then push from DJI Pilot 2 → Live Streaming → RTMP.
In DJI Pilot 2, push to:
Then paste this into the stream URL above:
Feed preview
4Catch Logbook → Google Sheets
Every fish you spot is saved on this device and plotted as a hotspot heatmap (LOGBOOK tab). Optionally mirror every spot into a Google Sheet so your whole crew shares one running history of where fish have been found.
Not connected — spots are still saved locally.
▸ One-time Google Sheet setup (2 min)
Create a Google Sheet → top menu Extensions → Apps Script.
Delete the sample code, paste the snippet below, click Deploy → New deployment → Web app.
Set Execute as: Me, Who has access: Anyone, click Deploy, authorize.
Copy the Web app URL and paste it above, then “Save & Send Test Row”.
Organization logo (this edition)Replaces the emblem on the launcher, top bar & splash for this edition (saved on this device). Use a square PNG/SVG for best results.
⚖ Regulations & compliance U.S. · FAA
Quick pre-flight reference for U.S. drone operations. Tap a section to expand.
🎣 Fish-spotting & species rules
Some fisheries restrict aircraft/drone-assisted spotting. Federal rules (50 CFR 635) prohibit using aircraft — a reading that likely includes drones — to locate or catch Atlantic bluefin tuna without a Harpoon/Purse-Seine permit; Florida (FAC 68B-4.013) bans harvesting marine fish with the aid of a spotter plane in state waters, likely extending to drones. Check your state & target species before using OSS to assist fishing. Not legal advice.
✅ Before you fly (Part 107)
Remote Pilot Certificate — required for any business use. Spotting fish for a charter or commercial catch, or paid/again-organized SAR, is commercial → you need Part 107. (Pure hobby flying uses the free TRUST test instead.)
Register your drone (250 g–55 lb): $5 at FAA DroneZone, valid 3 years, mark the aircraft with the registration number. Mavic 3T & Matrice 4T both must be registered.
Remote ID — your drone must broadcast Standard Remote ID (DJI models do) or carry a broadcast module.
🛩️ Flight limits
Altitude ≤ 400 ft AGL — or within 400 ft of a structure.
Groundspeed ≤ 100 mph (87 kn).
Visual line of sight at all times — beyond-VLOS needs a waiver.
Yield right-of-way to all manned aircraft. (See the live ADS-B traffic layer on the map.)
Day or night OK with anti-collision lighting visible 3 sm at night.
One aircraft per remote pilot unless waived.
🗺️ Airspace
Class G (uncontrolled): OK up to 400 ft, no authorization — most open water & rural coast.
Controlled (B/C/D / surface-E): get authorization via LAANC (instant) or FAA DroneZone before flying.
Check TFRs, stadiums, and security-sensitive areas in the B4UFLY app. Never near airports without authorization.
🌊 Over-water & offshore
VLOS is the hard limit offshore — open water gives no visual references; keep the aircraft in sight and mind the marine haze layer.
Plan battery + return-to-home with margin — a ditch over water is a total loss. Watch wind and your vessel's drift.
Deconflict with other spotter planes, helicopters, and Coast Guard aircraft.
🛟 SAR & public-safety ops
Government/organized SAR may operate under a COA or as public aircraft operations — coordinate with the controlling agency and the Incident Commander.
CAP missions fly under Air Force authorization — follow your wing's procedures and mission release.
Maintain comms and altitude separation from manned SAR assets.
⚠️ Quick reference only — not legal advice, and rules change. Verify current requirements before every operation: faa.gov/uas · FAA DroneZone · B4UFLY app.
💾 Where your data lives: every frame is saved in this browser, on this device — private and offline. It does not auto-sync to other computers. To move it: Export backup here → copy the file to the other machine → Import backup there. (For true multi-device sync, run the Cloud Data Hub below.)
Training Footage Library
Aerial fishing clips are great training material. Add YouTube links to save & watch for reference, or a direct video URL / local file to grab and label frames straight into the dataset.
When the vision model goes live it calls these — the console already routes them to the map, logbook, hotspots, Google Sheet, and this dataset. Design the edge/hub against this contract.
Each marked/auto-detected frame is stored as: {id, t, img(jpeg), w, h, lat, lng, alt, heading, species, count, conf, boxes:[{species,x,y,w,h}]} — boxes are normalized 0–1, exported as YOLO labels/*.txt + data.yaml.
▸ Cloud Data Hub (optional · PostGIS backend)
Run the FastAPI + PostGIS hub in backend/ (docker compose up), then point the console at it — every detection also writes to the shared geospatial database. Leave blank to stay fully local.
Not connected — detections stay on this device + Google Sheet.
Data Hub — Stream Monitor
Live health of every drone data stream — video, telemetry, AI, and cloud.
Telemetry sourceNot linked.
Live telemetry (GPS · altitude · gimbal · heading) drives the drone marker, the stream cards, and georeferencing — so AI/feed detections drop at the real ground position, not the boat. No drone yet? Hit Simulate Drone to fly a mission and see it all work.
BackupDetections, missions, config & training frames → one file. Back it up or move it to another device.
Video Feed
—
Telemetry
—
AI Vision
—
Cloud Hub
—
Google Sheet
—
Detections
—
Active-Learning Loop—
1Collect
2Label
3Train
4Deploy
0frames
0labeled
0boxes
0classes
—
—
⚙ How training really works: this device collects & labels frames. The actual model trains in the Colab notebook (GPU) on your exported data — it can’t run in a phone browser. To make all devices learn together, sync data to the Cloud Hub and retrain there, then the new model ships to every device.
Live event log
Source
AI
Sens
LabelDATASET —
◎ AI Vision Lab
Load footage and watch the AI mark fish in real time with tactical target outlines. Pause anytime, fix what it gets wrong with ✎ Correct frame — every correction becomes training data.
Got a YouTube clip? A browser can’t read YouTube video directly. Open the video in another browser tab, press 🖥 Capture screen / tab here, and choose that tab — the AI then runs on what’s on your screen. Local video files and your webcam analyze directly.
No source loaded.
Footage
YouTube can’t be frame-grabbed in the browser (cross-origin). To pull frames from this clip, use backend/ml/youtube_frames.py.
Label schools
Review the AI’s boxes: ✓ confirm by saving as-is · change by picking a species above then clicking a box’s label · circle a missed school by dragging a new box · ✕ removes a wrong one. Every correction becomes training data.
⚙ Claude API key & model
Your key stays in this browser and is sent only to Anthropic to pre-label this frame. Get one at console.anthropic.com. You review every box before it’s saved.
📖 Link Your DJI Mavic 3T
The Mavic 3T is Enterprise-tier, so it runs DJI Pilot 2 — it can fly OSS missions automatically and stream its thermal/visible camera into this console.
A
Live camera feed
On the CONNECT tab, open “DJI RTMP → gateway”, set your gateway IP, and start the MediaMTX command on a laptop on the same network.
In DJI Pilot 2 → ··· → Live Streaming → RTMP, paste rtmp://<gateway>:1935/oss and Start.
Paste the HLS/WebRTC URL back into Camera Feed → Connect Feed. Toggle the payload to IR/thermal in Pilot 2 for heat-contrast spotting.
B
Automated search flight
PLAN FLIGHT → set your vessel → pick a pattern → Generate → Simulate Flight to confirm it fits one battery.
Export DJI Mission (.kmz). Move the file onto the RC (USB-C / microSD / Drive). The RC is Android.
In Pilot 2 → Waypoint → Import → open the .kmz. Confirm takeoff point & altitude, then fly — the M3T runs the grid and returns home on its own.
C
Spot & log fish
Watch the feed on OPERATE; when you see a school, tap Mark Fish on Map (or the AI feed drops it in) — you get an alert and it logs to your hotspot history + Google Sheet.
Review past hotspots any time on the LOGBOOK tab and the map heatmap.
⚠ Fly under 400 ft AGL, keep visual line of sight (or proper BVLOS authorization), and check airspace (B4UFLY / LAANC) before launch. You are the pilot in command.