fix(timeline): avoid adding non-pinned events when back paginating

fix(timeline): avoid adding non-pinned events when back paginating #14367