Provide a non-collecting iterator for `history()`

[chiragjn]

delta-rs/crates/core/src/table/mod.rs

Lines 232 to 242 in 80d3bb9

	pub async fn history(&self, limit: Option<usize>) -> Result<Vec<CommitInfo>, DeltaTableError> {
	let infos = self
	.snapshot()?
	.snapshot
	.snapshot()
	.commit_infos(&self.log_store(), limit)
	.await?
	.try_collect::<Vec<_>>()
	.await?;
	Ok(infos.into_iter().flatten().collect())
	}

Since the history commits are yielded in reverse chronological order it would be beneficial for use-cases where we want to break early and not scan lots of small .json files from object store

We can also work with a time filter to just get commits since a given timestamp - I can open a separate issue for this if it sounds reasonable

[rtyler]

I'm tempted to put this as a bug 😆 I think in almost all cases we should probably be returning iterators from Rust APIs rather than collecting directly

[chiragjn]

Actually this is still collecting with .try_collect::<Vec<_>>() .await?, right?
Our aim is to reduce the get network calls since we have conditions to break early

    pub async fn history_stream(
        &self,
        limit: Option<usize>,
    ) -> DeltaResult<BoxStream<'_, DeltaResult<Option<CommitInfo>>>> {
        self.snapshot()?
            .snapshot()
            .snapshot()
            .commit_infos(&self.log_store(), limit)
            .await
    }