I have some dreams where there is not even just an absence of a sense of I, but also of a human self.
These dreams are more like movies: there is a setting and usually several different actors interacting. Yet, my own human self is not there, and there is no I anywhere among the characters either. There is just pure seeing. All the drama is there among the actors, not in the seeing of it.
From talking with others, it seems that this is not an unusual type of dream, and they are a faint reflection of Ground - absent of I anywhere, and in this case also absent of any human self.