What is the page size?
What is the exact assertion error message?
Historically speaking, there have been problems when "a large number of X conflicts with a small page size Y"; e.g., millions of locks versus a 2K page size where the page size affected the internal space available to record the locks.
That may not have anything to do with your symptom, but your mention of "data structure within the server" raises the suspicion.