When I try to start the service, it fails and the following appears in the Application log within Event Viewer:
Source: MSSQL$SQLEXPRESS
Event ID: 17058
Task Category: Server
Level: Error
Keywords: Classic
User: N/A
Description:
initerrlog: Could not open error log file ''. Operating system error = 3(The system cannot find the path specified.).
To fix this I had to change the Log on as property of the service from Local Service to Local System