Automated Intelligence Pipeline
Live Ingestion & Analysis Pipeline
IDLE
1
Run #
Completed ingestion cycles
0
Total Added
New documents across all runs
24h
Interval
Time between automatic runs
115
AI Analyses
Constitutional analyses completed
Pipeline Architecture
1
Congress.gov API
Federal Laws (119th, 118th Congress)
Every 24h — pulls latest public laws, checks for new PL numbers
2
Federal Register API
Final Rules & Proposed Rules
Every 24h — newest regulations ordered by publication date
3
Congress.gov Treaties
Senate Treaty Documents
Every 24h — ratified and pending international agreements
4
DHS / ICE / CBP / USCIS
Immigration & Border Enforcement
Every 24h — 5 agency feeds: DHS, ICE, CBP, USCIS, EOIR
5
Deduplication
Skip Already-Ingested Documents
PK checks on public law number, document number, treaty number
6
AI Analysis Queue
GPT-4o-mini Constitutional Analysis
Continuous — analyzes unanalyzed docs at 22s intervals (3 RPM safe)
7
Metric Recalculation
Martial Law Meter · Rights Alignment
Live — all dashboard metrics recalculate on every page load
Schedule
Last Run
2026-06-29 08:33:25 UTC
Next Run
2026-06-30 08:33:25 UTC
Countdown to Next Run
--:--:--
Database Snapshot
LIVE
Last Run Results
+0
laws
+0
regulations
+0
treaties
+0
immigration
403 Client Error: Forbidden for url: https://www.federalregister.gov/api/v1/documents.json?per_page=30&order=newest&conditions%5Btype%5D%5B%5D=RULE
Pipeline Log
Last 20 events
[08:33:25 UTC] Next run in 24h. Sleeping…
[08:33:25 UTC] Cycle complete. +0 total new documents ingested.
[08:33:25 UTC] immigration: +0 new documents
[08:33:08 UTC] Ingesting immigration…
[08:33:08 UTC] treaties: +0 new documents
[08:32:58 UTC] Ingesting treaties…
[08:32:58 UTC] regulations ERROR: 403 Client Error: Forbidden for url: https://www.federalregister.gov/api/v1/documents.json?per_page=30&order=newest&conditions%5Btype%5D%5B%5D=RULE
[08:32:55 UTC] Ingesting regulations…
[08:32:55 UTC] laws: +0 new documents
[08:32:43 UTC] Ingesting laws…
[08:32:43 UTC] === Starting scheduled ingestion run #1 ===
[08:31:58 UTC] Scheduler started. First run in 45s…