Automated Intelligence Pipeline
Live Ingestion & Analysis Pipeline
IDLE
1
Run #
Completed ingestion cycles
0
Total Added
New documents across all runs
24h
Interval
Time between automatic runs
99
AI Analyses
Constitutional analyses completed
Pipeline Architecture
1
Congress.gov API
Federal Laws (119th, 118th Congress)
Every 24h — pulls latest public laws, checks for new PL numbers
2
Federal Register API
Final Rules & Proposed Rules
Every 24h — newest regulations ordered by publication date
3
Congress.gov Treaties
Senate Treaty Documents
Every 24h — ratified and pending international agreements
4
DHS / ICE / CBP / USCIS
Immigration & Border Enforcement
Every 24h — 5 agency feeds: DHS, ICE, CBP, USCIS, EOIR
5
Deduplication
Skip Already-Ingested Documents
PK checks on public law number, document number, treaty number
6
AI Analysis Queue
GPT-4o-mini Constitutional Analysis
Continuous — analyzes unanalyzed docs at 22s intervals (3 RPM safe)
7
Metric Recalculation
Martial Law Meter · Rights Alignment
Live — all dashboard metrics recalculate on every page load
Pipeline Log
Last 20 events
[18:14:11 UTC] Next run in 24h. Sleeping…
[18:14:11 UTC] Cycle complete. +0 total new documents ingested.
[18:14:11 UTC] immigration: +0 new documents
[18:13:30 UTC] Ingesting immigration…
[18:13:30 UTC] treaties: +0 new documents
[18:13:21 UTC] Ingesting treaties…
[18:13:21 UTC] regulations: +0 new documents
[18:13:13 UTC] Ingesting regulations…
[18:13:13 UTC] laws: +0 new documents
[18:13:06 UTC] Ingesting laws…
[18:13:06 UTC] === Starting scheduled ingestion run #1 ===
[18:12:21 UTC] Scheduler started. First run in 45s…