fix: Add Spark-compatible schema validation for native_datafusion scan #4979

Job	Run time
Lint	37s
Build Native Library (macOS)	3m 25s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [shuffle]	41m 58s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [expressions]	23m 59s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [csv]	11m 41s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [exec]	26m 52s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [parquet]	20m 58s
macos-14/Spark 3.5, JDK 17, Scala 2.13 [exec]	24m 1s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [exec]	21m 28s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [sql]	10m 6s
macos-14/Spark 3.5, JDK 17, Scala 2.13 [fuzz]	19m 14s
macos-14/Spark 3.5, JDK 17, Scala 2.13 [parquet]	19m 32s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [fuzz]	28m 46s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [fuzz]	41m 45s
macos-14/Spark 3.5, JDK 17, Scala 2.13 [expressions]	23m 57s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [sql]	11m 24s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [csv]	8m 19s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [shuffle]	35m 10s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [expressions]	23m 14s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [parquet]	17m 38s
macos-14/Spark 3.5, JDK 17, Scala 2.13 [csv]	10m 16s
macos-14/Spark 3.5, JDK 17, Scala 2.13 [shuffle]	29m 19s
macos-14/Spark 3.5, JDK 17, Scala 2.13 [sql]	8m 14s
	7h 41m 53s

Provide feedback