Does Bigtable have concept of URI or anything similar?

[matthewmturner]

I'm trying to think if this could be accessed using just SQL. I was thinking something like
CREATE EXTERNAL TABLE abc STORED AS BIGTABLE LOCATION uri

[jychen7]

yes (or no), bigtable have uri like https://googleapis.com/bigtable/projects/project_id/instances/instance_id/tables/table_name (source)

it does not have friendly name/schema like gs://, however, we can support custom format in Datafusion, e.g. bigtable://{project_id}/{instance_id}/{table_name}

[matthewmturner]

Ok, thx. Im focusing on cfg driven approach for now. Will revist uri in the future if needed. I will close this unless its something you are interested in.

[jychen7]

I think about adding to datafusion DDL, but it seems requiring datafusion requires datafusion-bigtable as optional dependency similar to apache/datafusion#2111?

[matthewmturner]

I was hoping to eventually enable custom SQL in which case the relevant SQL keywords could be bundled with packages such as this rather than in datafusion itself.

[jychen7]

yes, agree

[jychen7]

I will close this unless its something you are interested in.

@matthewmturner thanks, I agree we can close it first