fix: Add Spark-compatible schema validation for native_datafusion scan #10225

Job	Run time
Build Native Library	3m 2s
spark-sql-auto-catalyst/spark-4.0.1	17m 13s
spark-sql-auto-sql_core-1/spark-3.4.3	55m 43s
spark-sql-native_datafusion-sql_core-1/spark-3.5.8	57m 10s
spark-sql-native_datafusion-sql_core-2/spark-3.5.8	38m 58s
spark-sql-auto-sql_core-1/spark-3.5.8	57m 19s
spark-sql-auto-catalyst/spark-3.4.3	16m 59s
spark-sql-native_datafusion-catalyst/spark-3.5.8	17m 18s
spark-sql-auto-sql_core-2/spark-3.4.3	33m 37s
spark-sql-auto-sql_core-2/spark-3.5.8	37m 26s
spark-sql-auto-sql_core-1/spark-4.0.1	1h 15m 50s
spark-sql-auto-sql_hive-2/spark-3.4.3	15m 31s
spark-sql-auto-sql_core-3/spark-3.5.8	44m 29s
spark-sql-native_datafusion-sql_hive-1/spark-3.5.8	43m 50s
spark-sql-auto-catalyst/spark-3.5.8	16m 19s
spark-sql-auto-sql_core-2/spark-4.0.1	41m 7s
spark-sql-auto-sql_core-3/spark-4.0.1	52m 19s
spark-sql-auto-sql_hive-1/spark-3.5.8	48m 8s
spark-sql-auto-sql_core-3/spark-3.4.3	34m 48s
spark-sql-auto-sql_hive-3/spark-3.4.3	30m 7s
spark-sql-native_datafusion-sql_core-3/spark-3.5.8	39m 34s
spark-sql-auto-sql_hive-1/spark-3.4.3	46m 31s
spark-sql-auto-sql_hive-2/spark-3.5.8	15m 8s
spark-sql-native_datafusion-sql_hive-2/spark-3.5.8	16m 10s
spark-sql-auto-sql_hive-3/spark-4.0.1	31m 12s
spark-sql-native_datafusion-sql_hive-3/spark-3.5.8	29m 46s
spark-sql-auto-sql_hive-3/spark-3.5.8	30m 15s
spark-sql-auto-sql_hive-2/spark-4.0.1	23m 16s
merge-fallback-logs	0s
	16h 9m 5s

Provide feedback