I’m using below code to convert form data to pandas dataframe and then writting it in delta table, but getting issue with Sparksession.builder.getOrCreate().
PySparkRuntimeError: [JAVA_GATEWAY_EXITED"java gateway process exited before sending its port number.
Traceback:
File "/app/python/source_code/.venv/lib/python3.11/site-packages/streamlit/run
result = func()
File "/app/python/source_code/.venv/lib/python3.l1/site-packages/streamlit/run
exec (cide,、 module.dict.
File “/app/python/source_code/app.py”, line63, in
spark - Sparksession.builder.getOrCreate()…
df = pd.DataFrame([form_data])
from pyspark.sql import SparkSession
spark = SparkSession.builder.getOrCreate()
spark_df = spark.createDataFrame(df)
spark_df.write.mode(“append”).saveAsTable(“test.test.intake_forms”)