Pycharm Unable to Access TiSpark

Translated
1

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: pycharm无法访问TiSpark

| username: TiDBer_77DemBHR

Incident:

I first installed Spark, then installed TiSpark, resulting in two Spark environments on the Linux machine. Normally, I start TiSpark on the Linux machine using the /tidb-deploy/tispark-master-7077/bin/spark-shell command.

Recently, I needed to run SQL using user-defined functions, so I wanted to use PyCharm on my computer to connect to the Linux machine and operate TiSpark.

However, I found that I couldn’t connect to the TiSpark environment. I even deleted the Spark folder and environment variables, but still couldn’t connect.

I also modified SPARK_HOME, but it didn’t work…

Does anyone know what the problem might be?

2
| username: 数据小黑 | Original post link

I haven’t really used PySpark before, but TiDB can only be connected through configuration. After referencing the ${SPARK_HOME}/conf/spark-defaults.conf file in /tidb-deploy/tispark-master-7077/bin/spark-shell, the connection was established. For example, it was maintained as follows:

1
1946×263 6.91 KB

Does PySpark also need to set such parameters?

3
| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.