Failed to connect: HTTP response 500

[junyuanZhang-cb]

The issue was when I tried to query Databricks using the Go sql driver (https://docs.databricks.com/dev-tools/go-sql-driver.html)
I got the following error: driver: bad connection: HTTP Response code: 500 . It was flaky at first but now it is 100% failing. After further debugging, I found that the error happened when trying to acquire a connection, before actually sending the query.

the error is thrown from here
https://github.com/databricks/databricks-sql-go/blob/main/hive/client.go#L43

error : error(*github.com/apache/thrift/lib/go/thrift.tTransportException) *{typeId: 0, err: error(*errors.errorString) *{s: "HTTP Response code: 500"}}

[ericsun2]

A more meaningful Thrift error code is needed with server side retry mechanism.

[jadewang-db]

@JunyuanZhangCoin what is your workspace name? is this happens on all your workspace or just for this workspace?

[junyuanZhang-cb]

It happens in the dev workspace: coinbase-development.cloud.databricks.com. Didn't try it in the production workspace cause the code hasn't been merged into master.

[jadewang-db]

@JunyuanZhangCoin do you have a timeframe when this error happens?

[moderakh]

could it be that we are not closing sessions/resources and we ran out of resources?
@susodapop are the symptoms similar to pysql bug you worked on (databricks/databricks-sql-python#38)?

[junyuanZhang-cb]

The errors showed up since last Tuesday (9/13) and kept happening

[junyuanZhang-cb]

The snippet reproducing the error:

	db, _ := sql.Open("databricks", "databricks://:dapi***************@coinbase-development.cloud.databricks.com/sql/1.0/endpoints/d72dcf4b8344ab11")
	conn, _ := db.Conn(context.Background())
	_, err := conn.QueryContext(context.Background(), "select * from fqs_test.user_features LIMIT 1")
	assert.NotNil(t, err)

[mohit-zs]

Hey, I am also facing the same issue (bad connection) while trying to connect on my dev environment.

the error I am getting is
Error - driver: bad connection: Post "https://token:***@[Workspace_hostname]:443/[Endpoint_HTTP_Path]"

otherwise, it is able to connect to the same host via my local machine

[andrefurlan-db]

Hi @mohit-zs , @JunyuanZhangCoin. Is this still an issue? Can you try with the latest version and let me know? Check the DNS changes to make sure it works or use the With.. option connector functions

[mohit-zs]

@andrefurlan-db I am no longer facing the issue. It was a firewall issue for me.

[andrefurlan-db]

Okay, I'll close this issue for now. If anyone still has any problems, please open a new issue. Thanks!

[rahulanand90]

I am still facing the same issue.
databricks://:dapi*****************************a@dbc-*******-******.cloud.databricks.com/sql/1.0/endpoints/************
and then I am passing the DSN to the below function.

sql.Open("databricks", dsn)

One observation, things were working fine when I was using
github.com/databricks/databricks-sql-go v0.1.4
github.com/apache/thrift v0.12.0 // indirect

thrift version depends on databricks-sql-go, so definitely something with wrong withe the latest version of databricks-sql-go

ERROR:
Error: invalid DSN: invalid DSN port: strconv.Atoi: parsing "": invalid syntax

[tauseef-h]

@rahulanand90 - Regarding the Error: invalid DSN: invalid DSN port: strconv.Atoi: parsing "": invalid syntax, I believe the DATABRICKS_PORT variable needs to be exported/passed. By default, this should be 443. You should also be able to pass all the configs/variables using .env file and using https://github.com/joho/godotenv for loading env variables. If it still errors, please open a new issue. Thanks.

[rahulanand90]

Thanks @tauseef-h but I have already tried this. I created a new .env file with
DATABRICKS_PORT=443

and then also checked that it is giving me the same in the print statement.

_ := godotenv.Load()
databricksPort := os.Getenv("DATABRICKS_PORT")
fmt.Println(databricksPort)

I would like to stress again this is giving me errors only after the upgrade as mentioned above. I guess it would be better to open a new issue for tracking or more help. Thanks