Is your feature request related to a problem or challenge? Please describe what you are trying to do.
I want to load files from multiple locations. In Spark, I can just give a list of paths and it works. Would like to do the same with read_csv, read_avro and read_parquet methods.
Describe the solution you'd like
Read a list of files using methods like so: read_csv(vec![String::new()])
Describe alternatives you've considered
I can read the paths one by one and then concatenate the dataframes but not sure if it is ok to do so.
Additional context
I have files from S3 in multiple locations and use the above methods to read them.
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
I want to load files from multiple locations. In Spark, I can just give a list of paths and it works. Would like to do the same with read_csv, read_avro and read_parquet methods.
Describe the solution you'd like
Read a list of files using methods like so: read_csv(vec![String::new()])
Describe alternatives you've considered
I can read the paths one by one and then concatenate the dataframes but not sure if it is ok to do so.
Additional context
I have files from S3 in multiple locations and use the above methods to read them.