This is a dedicated watch page for a single video.
A data engineer has a MLFlow model logged in a given “model_url”. They have registered the model as a Spark UDF using the following code: predict_udf = mlflow.pyfunc.spark_udf(spark, "model_url") The data engineer wants to apply this model UDF to a test dataset loaded in the “test_df” DataFrame in order to calculate predictions in a new column “prediction” Which of the following code blocks allows the data engineer to accomplish this task ?