We are building a DDoS mitigation filter monitoring billions of network packets per minute. We need to count the frequency of each source IP address in real-time to detect anomalous spikes. Using a standard hash map of counters would require tens ...Read more
Home/Data Structures & Algorithms/System-Scale & Probabilistic Structures
RTSALL Latest Questions
We need dynamic prefix sums and range sum queries over a stream of financial ledger transactions where numbers are constantly updated. A standard array has O(1) update but O(N) range sum. A prefix sum array has O(1) range sum but O(N) ...Read more
I am indexing a table with 2,000,000 vectors (1,536 dimensions, OpenAI text-embedding-3-small) in PostgreSQL 16 using the pgvector extension. When executing: CREATE INDEX ON documents USING hnsw (embedding vector_cosine_ops) WITH (m = 16, ...Read more