How to create a dataframe from ElasticSearch?

Then using the “load” API, specify the index and the type details. Here it is company-es/employees-es. "company-es” is the index name and “employees-es” is the type name.

This creates the dataframe.

display(df)

Now that we have created a dataframe from ElasticSearch index, let’s store the dataframe contents into an ElasticSearch index.

Additionally, I am specifying the “mode” option, as “overwrite” to tell the spark API whether to overwrite an existing data or not