Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.
Original topic: pyspark 提示 warn:Unable to find
Version:
spark-3.3.1-bin-hadoop2
tispark-assembly-3.3_2.12-3.2.2.jar
5.7.25-TiDB-v7.2.0
As shown in the figure, every time I enter pyspark, a warning is reported. I don’t know if it’s an issue with the TiKV client. TiSpark doesn’t require configuration parameters starting with tikv by default.
>>> spark.sql("use tidb_catalog")
23/07/20 17:18:47 WARN TiConfiguration: Unable to find tikv.properties
}
private static void loadFromConfigurationFile() {
try (InputStream input =
TiConfiguration.class
.getClassLoader()
.getResourceAsStream(ConfigUtils.TIKV_CONFIGURATION_FILENAME)) {
Properties properties = new Properties();
if (input == null) {
logger.warn("Unable to find " + ConfigUtils.TIKV_CONFIGURATION_FILENAME);
return;
}
logger.info("loading " + ConfigUtils.TIKV_CONFIGURATION_FILENAME);
properties.load(input);
for (String key : properties.stringPropertyNames()) {
if (key.startsWith("tikv.")) {
String value = properties.getProperty(key);
setIfMissing(key, value);
}
Have you confirmed the TiSpark JAR package?
It does seem that the log level is not quite appropriate, but it does not affect normal functionality. You are welcome to contribute to client-java.
This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.