Apache Spark for Azure Synapse Guidance - Microsoft

The Dataframe also utilizes the Catalyst Optimizer improving performance of your Spark operations. Avoid UDFs Conventional UDFs operate serially one by one. It is best to implement needed functionality with built-in functions (i.e. spark.sql.functions). If UDFs must be used utilize them in this order: ................
................