ESP8266WebServer conflict with pubsubclient/WiFiClientSecure

[AdamMiltonBarker]

I have developed a program that boots into an AP to allow you to enter credentials needed for MQTT broker and wifi etc.

Once the credentials have been saved using SPIFFS, the program will then connect to MQTT and carry on, or it should do, I was getting exception 29 and narrowed it down to ESP8266WebServer was conflicting.

`Exception (29):
epc1=0x4000e1b2 epc2=0x00000000 epc3=0x00000000 excvaddr=0x00000100 depc=0x00000000

ctx: cont
sp: 3fff2b60 end: 3fff30c0 offset: 01a0

stack>>>
3fff2d00: 00020202 00000000 00000000 4022c2b7
3fff2d10: 3fffba1c 3fff715c 3fff7444 4022c450
3fff2d20: 00000000 ffffffff 3fffba0c 3fff715c
3fff2d30: 00000040 3fff715c 3fff9d3c 4022c84d
3fff2d40: 3fff755c 3fff715c 3fff9d3c 4022d244
3fff2d50: 3fff71ec 35055c08 5b929020 00000001
3fff2d60: 3fff715c 3fff4c8c 3fff9d3c 00000001
3fff2d70: 00000010 3fff715c 0000000f 4022d4b5
3fff2d80: 3fff7444 3fff742c 0000000f 00000001
3fff2d90: 00000001 3fff7774 41f3a73c 4022c31c
3fff2da0: 00000100 3fff4fbf 3fff4fbf 00000000
3fff2db0: 00000100 3fff4fbf 3fff71bc 4022e660
3fff2dc0: 00000000 000000d0 3fff2df0 00000030
3fff2dd0: 29105076 9199df31 5996515b 00000004
3fff2de0: 00000004 3fff4efc 3fff4fb9 4022a73e
3fff2df0: 16f10203 1236ade7 7c9da7b8 b1a7f801
3fff2e00: 3929f22d 22ec2af4 f2b67d79 390f24dc
3fff2e10: dfbf7c55 1a6d1648 e4e199fe 5076b44e
3fff2e20: 00000004 3fff4fb9 3fff4efc 4022ab3d
3fff2e30: 40235b33 4a9711d7 debd6f0a 40235b41
3fff2e40: 40208f07 00000004 00000004 00000000
3fff2e50: 3fff4fbd 3fff4fb9 3fff6aa4 00001500
3fff2e60: 00001553 3fff64ff 0000000c 00000004
3fff2e70: 3fff4efc 3fff4fb9 00000004 00000004
3fff2e80: 00000004 3fff4fb9 3fff4efc 4022a574
3fff2e90: 00000000 3fff4fb9 3fff4efc 4022a8d8
3fff2ea0: 3ffea4b8 3fff324c 3fff4efc 4022928c
3fff2eb0: 3fff2ef0 0000000e 00000010 00000000
3fff2ec0: 00000000 3fff324c 3fff4efc 00001387
3fff2ed0: 001bd461 3fff4efc 3fff321c 4022a6aa
3fff2ee0: 3fff1f58 3fff1f10 3fff321c 4020935c
3fff2ef0: 3fff4bac 3fff1f10 3fff1f10 402087c6
3fff2f00: c64b3025 00000000 4020d68c 00000000
3fff2f10: 3fff1c78 000022b3 3fff1f10 402094ee
3fff2f20: 3ffe9f18 c64b3025 72746e45 6e655379
3fff2f30: 000000dd 000022b3 3fff1f10 40208745
3fff2f40: 3ffe9f18 c64b3025 3ffe9f18 c64b3025
3fff2f50: 3ffe9820 3fff40d4 3fff416c 00000000
3fff2f60: 3fff32a4 3fff1dd4 00000000 40209504
3fff2f70: 00000010 3fff1dd4 00000000 4020ba15
3fff2f80: 00000031 00000031 3ffe925d 3fff2090
3fff2f90: 3fff1c14 3fff1cdc 00000000 4020ca19
3fff2fa0: 3ffe8c78 3fff1dd4 3fff2064 3fff2090
3fff2fb0: 3fffdad0 3fff1dd4 3fff2064 4020bb68
3fff2fc0: 00000000 00000000 3fff2064 4020ca90
3fff2fd0: 00000034 3fff1dd4 3fff2064 40207045
3fff2fe0: 3fff301e 00000000 3fff1dd4 4020727a
3fff2ff0: 402084a4 3fff4ca0 3fff301d 4020cb2d
3fff3000: 3fff2064 0000000a 00000003 4020cbc6
3fff3010: ff4b843f 00000001 3ffe8c79 4020ec88
3fff3020: 40212400 00000003 3ffe9747 3fff1da4
3fff3030: 3fff1db0 00000004 3fff2064 4020ca19
3fff3040: 3ffe8c78 ffffffd0 3fff2064 4020ca19
3fff3050: 3ffe9744 ffffffd0 3fff2064 4020ca44
3fff3060: 0000000a 00ffffff 3fff2064 4020988c
3fff3070: 3fff1db0 ffffffd0 3fff2064 4020780d
3fff3080: 3ffe9f18 0c01a8c0 00000000 4020e690
3fff3090: feefeffe feefeffe feefeffe 3fff2090
3fff30a0: 3fffdad0 00000000 3fff2088 4020d6d8
3fff30b0: feefeffe feefeffe 3fff20a0 40100718
<<<stack<<<

ets Jan 8 2013,rst cause:4, boot mode:(1,6)
wdt reset
ets Jan 8 2013,rst cause:4, boot mode:(1,6)
wdt reset`

I have tried putting it all in one individual function that is only called if wifi was not successful and get:

In lambda function:

IntelliLanEntrySenseESPDevConfs:375: error: 'server' is not captured

I have tried recoding a program that took weeks to get sorted and nothing works. I have also tried to find a way to destroy the ESP8266WebServer that is defined if Wifi is connected and I have tried moving the define inside of functions that only run when wifi is connected and none of this allows me to destroy the ESP8266WebServer instance and free up the memory or let the rest of the program continue.

The exception 29 happens on connection attempt to the broker, the exact same program without ESP8266WebServer works as expected, can anyone put me out of my misery on how to either not define the server or destroy it if not needed please. Would be really appreciative this is the last thing in a very long project.

[WereCatf]

or destroy it if not needed please.
You could allocate the server dynamically, like with the following pseudocode:

#include <ESP8266WiFi.h>
#include <WiFiClient.h>
#include <ESP8266WebServer.h>
#include <ESP8266mDNS.h>

ESP8266WebServer *server;

void setup(){
  //This allocates a new instance of ESP8266WebServer
  server=new(ESP8266WebServer);
  if(server==NULL) //Insert code to handle allocation-error
  //Setup your server here
  server->begin();
}

servernolongerneeded(){
  //This destroys the allocated server and frees up all the resources it used
  delete(server);
}

That said, I doubt it fixes your error.

[AdamMiltonBarker]

Thank you for the quick reply do you have any docs on setting up the server dynamically please, been a long night would be great to find the docs.

[AdamMiltonBarker]

Oh just seen this "That said, I doubt it fixes your error." what can fix the error then. The error is not there if the server is not created when not needed ie if wifi is connected there is no need to start a server or it will conflict.

[WereCatf]

I just provided you with a pseudocode-example. You set it up just like you set up a statically defined one, but use server-> instead of server. when calling its functions.

[AdamMiltonBarker]

OK thanks, The issue is as far as I can see that when pubsub tries to connect it tries to write to the same blocks, so the solution is to not have the server start when it is not needed, will the above fix it or am I better giving up on it ?

[WereCatf]

I do not know. Try it, that's the easiest way of knowing whether it works or not.

[AdamMiltonBarker]

Am doing now hopefully it will thanks again.

[AdamMiltonBarker]

Exception 28 now

Exception (28):
epc1=0x40209613 epc2=0x00000000 epc3=0x00000000 excvaddr=0x00000014 depc=0x00000000

ctx: cont
sp: 3fff25d0 end: 3fff27e0 offset: 01a0

stack>>>
3fff2770: 3ffe9744 ffffffcd 3fff178c 4020c9bc
3fff2780: 0000000a 00ffffff 3fff178c 4020ca08
3fff2790: 3fff14d4 ffffffcd 3fff178c 4020781c
3fff27a0: 3ffe9f18 0c01a8c0 00000000 4020e608
3fff27b0: feefeffe feefeffe feefeffe 3fff17b8
3fff27c0: 3fffdad0 00000000 3fff17b0 4020d648
3fff27d0: feefeffe feefeffe 3fff17c0 40100718
<<<stack<<<

ets Jan 8 2013,rst cause:2, boot mode:(1,6)

ets Jan 8 2013,rst cause:4, boot mode:(1,6)

wdt reset

[WereCatf]

Lemme guess: your code tries to use server without you having allocated anything in it?

[AdamMiltonBarker]

The server doesn't get allocated unless it is needed I will post the code:

`/*
Copyright (c) 2016 TechBubble Technologies and other Contributors.

The MIT License (MIT)
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.

Contributors:
Adam Milton-Barker - Initial Contribution
Adam Mosely - Tester
John Ducrest - Tester
*/

#include <FS.h>
#include <ESP8266WiFi.h>
#include <ESP8266WebServer.h>
#include <PubSubClient.h>
#include <WiFiClientSecure.h>
#include <ArduinoJson.h>
#include <ESP8266mDNS.h>

ESP8266WebServer *server;

WiFiClientSecure espClient;
PubSubClient client(espClient);

const char* ssid = "TechBubbleAP";
const char* passphrase = "thereisnospoon";
String st;
String content;
int statusCode;
String serverType ="";

String esid = "";
String epass = "";

String locationID = "";
String zoneID = "";
String deviceID = "";

char charBuf[50];
char deviceName[100];
char mqttUsername[100];
char mqttPassword[100];

const char* mqtt_server = "iot.techbubbletechnologies.com";
int mqttPort = 8883;

const int actuator1Pin = 2;
String lastStatus = "";

long lastMsg = 0;
char msg[50];
int value = 0;

bool checkWifiConnection(void) {
int connectAttempt = 0;
Serial.println("Waiting for Wifi to connect...");
while ( connectAttempt < 20 ) {
if (WiFi.status() == WL_CONNECTED) { return true; }
delay(500);
Serial.print(".");
connectAttempt++;
}
Serial.println("");
Serial.println("WiFi connection failed, initiating Access Point");
return false;
}

int scanNetworks(void) {

int networks = WiFi.scanNetworks();
Serial.println("Network scan done");

if (networks == 0){

Serial.println("No networks found");

} else {

Serial.print(networks);
Serial.println(" networks found");
for (int i = 0; i < networks; ++i){

  Serial.print(i + 1);
  Serial.print(": ");
  Serial.print(WiFi.SSID(i));
  Serial.print(" (");
  Serial.print(WiFi.RSSI(i));
  Serial.print(")");
  Serial.println((WiFi.encryptionType(i) == ENC_TYPE_NONE)?" ":"*");
  delay(10);

 }

}

return networks;

}

void getNetworkList(int networks) {

st = ""; for (int i = 0; i < networks; ++i){ st += "<option value='"; st += WiFi.SSID(i); st += "'>"; st += WiFi.SSID(i); st += " "; st += (WiFi.encryptionType(i) == ENC_TYPE_NONE)?" ":"*"; st += "</option>"; } st += "";

}

void readSpiffs(){

if (SPIFFS.begin()) {
Serial.println("Mounted file system!");
if (SPIFFS.exists("/IntelliLanEntrySenseESP.json")) {
Serial.println("Reading config file...");
File configFile = SPIFFS.open("/IntelliLanEntrySenseESP.json", "r");
if (configFile) {
Serial.println("Opened config file...");
size_t size = configFile.size();
std::unique_ptr<char[]> buf(new char[size]);
configFile.readBytes(buf.get(), size);
DynamicJsonBuffer jsonBuffer;
JsonObject& json = jsonBuffer.parseObject(buf.get());
if (json.success()) {
Serial.println("\nParsed json!");
if(json["locationID"]!="") {
Serial.println("Setting Location ID");
locationID = json["locationID"].asString();
} else {
Serial.println("No location ID in config!");
}
if(json["zoneID"]!="") {
Serial.println("Setting Zone ID");
zoneID = json["zoneID"].asString();
} else {
Serial.println("No zone ID in config!");
}
if(json["deviceID"]!="") {
Serial.println("Setting Device ID");
deviceID = json["deviceID"].asString();
} else {
Serial.println("No device ID in config!");
}
if(json["epass"]!="") {
Serial.println("Setting EPass ID");
epass = json["epass"].asString();
} else {
Serial.println("No epass in config!");
}
if(json["esid"]!="") {
Serial.println("Setting ESid ID");
esid = json["esid"].asString();
} else {
Serial.println("No esid in config!");
}
if(json["deviceName"]!="") {
Serial.println("Setting Device Name");
strcpy(deviceName, json["deviceName"]);
} else {
Serial.println("No deviceName in config!");
}
if(json["mqttUsername"]!="") {
Serial.println("Setting MQTT UserName");
strcpy(mqttUsername, json["mqttUsername"]);
} else {
Serial.println("No mqttUsername in config!");
}
if(json["mqttPassword"]!="") {
Serial.println("Setting MQTT Password");
strcpy(mqttPassword, json["mqttPassword"]);
} else {
Serial.println("No mqttPassword in config!");
}
} else {
Serial.println("Failed to load json config");
}
configFile.close();
}
}
} else {
Serial.println("failed to mount FS");
}
}

void callback(char* topic, byte* payload, unsigned int length) {
Serial.print("Message arrived [");
Serial.print(topic);
Serial.print("] ");
String readString = "";
for (int i = 0; i < length; i++) {
readString += (char)payload[i];
}
Serial.println(readString);
StaticJsonBuffer<200> jsonBuffer;
JsonObject& root = jsonBuffer.parseObject(readString);
String CommandValue = root["CommandValue"];
Serial.println(CommandValue);
if(CommandValue=="ON"){
Serial.println("TURNING ON");
digitalWrite(actuator1Pin, HIGH);
}else if(CommandValue=="OFF"){
Serial.println("TURNING OFF");
digitalWrite(actuator1Pin, LOW);
}
Serial.println();
}

void subscribeToDeviceCommands(){
String commandTopic = locationID+"/Devices/"+zoneID+"/"+deviceID+"/Commands";
commandTopic.toCharArray(charBuf, 50);
client.subscribe(charBuf);
}

void publishToDeviceStatus(const char* data){
String statusTopic = locationID+"/Devices/"+zoneID+"/"+deviceID+"/Status";
statusTopic.toCharArray(charBuf, 50);
client.publish(charBuf,data);
}

void publishToDeviceSensors(const char* data){
String sensorsTopic = locationID+"/Devices/"+zoneID+"/"+deviceID+"/Sensors";
sensorsTopic.toCharArray(charBuf, 50);
client.publish(charBuf,data);
}

void publishToDeviceActuators(const char* data){
String actuatorsTopic = locationID+"/Devices/"+zoneID+"/"+deviceID+"/Actuators";
actuatorsTopic.toCharArray(charBuf, 50);
client.publish(charBuf,data);
}

void publishToDeviceWarnings(const char* data){
String warningsTopic = locationID+"/Devices/"+zoneID+"/"+deviceID+"/Warnings";
warningsTopic.toCharArray(charBuf, 50);
client.publish(charBuf,data);
}

bool checkDoorSense(){

if(digitalRead(actuator1Pin)){

return true;    

}

return false;

}

void reconnect() {
while (!client.connected()) {
Serial.println("Attempting connection to TechBubble IoT JumpWay...");
if (client.connect(deviceName, mqttUsername, mqttPassword)) {
Serial.println("Connected to TechBubble IoT JumpWay!");
publishToDeviceStatus("ONLINE");
//subscribeToDeviceCommands();
} else {
Serial.print("Failed to connect to TechBubble IoT JumpWay, rc=");
Serial.print(client.state());
Serial.println("... trying again in 5 seconds");
delay(5000);
}
}
}

void createWebServer(int webtype){

if ( webtype == 1 ) {
server->on("/", {

    content = "<!DOCTYPE HTML>";
    content = "<html>\r\n";
    content = "<head></head>\r\n";
    content = "<body style='width: 340px;'>\r\n";
    content += "<div style='width: 340px; margin: auto auto;'>";
    content += "<h1 style='color: #01AEEE; font-size: 25px;'>IntelliLan EntrySense</h1>";
    content += "<form method='get' action='setting'>";
    content += "<br /><label>Location ID: </label> <input name='locationID' length=64 style='width: 100%;' value='1'>";
    content += "<br /><label>Zone ID: </label> <input name='zoneID' length=64 style='width: 100%;' value='1'>";
    content += "<br /><label>Device ID: </label> <input name='deviceID' length=64 style='width: 100%;' value='1'>";
    content += "<br /><label>Device Name: </label> <input name='deviceName' length=64 style='width: 100%;' value=''>";
    content += "<br /><br /><label>WiFi SSID: </label> ";
    content += st;
    content += "<br /><label>WiFi Password: </label> <input name='pass' length=64 style='width: 100%;' value=''>";
    content += "<br /><br /><label>MQTT User: </label> <input name='mqttUsername' length=64 style='width: 100%;' value=''>";
    content += "<br /><label>MQTT Password: </label> <input name='mqttPassword' length=64 style='width: 100%;' value=''>";
    content += "<br /><br /><input type='submit' style='width: 100%;'>";
    content += "</form>";
    content += "</div>";
    content += "</body>";
    content += "</html>";

});
server->on("/setting", []() {

    String qsid = server->arg("ssid");
    String qpass = server->arg("pass");
    String locationIDr = server->arg("locationID");
    String zoneIDr = server->arg("zoneID");
    String deviceIDr = server->arg("deviceID");
    String deviceNamer = server->arg("deviceName"); 
    String mqttUsernamer  = server->arg("mqttUsername"); 
    String mqttPasswordr  = server->arg("mqttPassword"); 

    if (qsid.length() > 0 && qpass.length() > 0 && locationIDr.length() > 0 && zoneIDr.length() > 0 && deviceIDr.length() > 0 && deviceNamer.length() > 0 && mqttUsernamer.length() > 0 && mqttPasswordr.length() > 0) {

      Serial.println(qsid);
      Serial.println("");
      Serial.println(qpass);
      Serial.println("");
      Serial.println("Saving Config...");
      DynamicJsonBuffer jsonBuffer;
      JsonObject& json = jsonBuffer.createObject();
      json["esid"] = qsid;
      json["epass"] = qpass;
      json["locationID"] = locationIDr;
      json["zoneID"] = zoneIDr;
      json["deviceID"] = deviceIDr;
      json["deviceName"] = deviceNamer;
      json["mqttUsername"] = mqttUsernamer;
      json["mqttPassword"] = mqttPasswordr;

      File configFile = SPIFFS.open("/IntelliLanEntrySenseESP.json", "w");
      if (!configFile) {
        Serial.println("Failed to open config file for writing!");
      }

      json.prettyPrintTo(Serial);
      json.printTo(configFile);
      configFile.close();

      content = "<!DOCTYPE HTML>";
      content = "<html>\r\n";
      content = "<head></head>\r\n";
      content = "<body style='width: 340px;'>\r\n";
      content += "<div style='width: 340px; margin: auto auto;'>";
      content += "<h1 style='color: #01AEEE; font-size: 25px;'>IntelliLan EntrySense</h1>";
      content += "<h2>SUCCESS!</h2>";
      content += "<p>Reboot to start up your device.</p>";
      content += "</div>";
      content += "</body>";
      content += "</html>";
      server->send(200, "text/html", content); 

    } else {

      content = "<!DOCTYPE HTML>";
      content = "<html>\r\n";
      content = "<head></head>\r\n";
      content = "<body style='width: 340px;'>\r\n";
      content += "<div style='width: 340px; margin: auto auto;'>";
      content += "<h1 style='color: #01AEEE; font-size: 25px;'>IntelliLan EntrySense</h1>";
      content += "<h2>ERROR!</h2>";
      content += "<p>Please fill in all details!</p>";
      content += "</div>";
      content += "</body>";
      content += "</html>";

    }
      server->send(200, "text/html", content); 
});

}
}

void initiateServerType(int webtype) {
Serial.println("");
Serial.println("WiFi connected");
Serial.print("Local IP: ");
Serial.println(WiFi.localIP());
Serial.print("SoftAP IP: ");
Serial.println(WiFi.softAPIP());
createWebServer(webtype);
server->begin();
Serial.println("Server started");
}

void initiateAccessPoint(void) {

Serial.println("Initiating access point...");
WiFi.mode(WIFI_STA);
WiFi.disconnect();
delay(100);

int networks = scanNetworks();
Serial.println("");
getNetworkList(networks);
delay(100);
WiFi.softAP(ssid, passphrase, 6);
Serial.println("SoftAP initiated");
initiateServerType(1);
Serial.println("Completed");
}

void setup() {

Serial.begin(115200);
pinMode(actuator1Pin, INPUT_PULLUP);
delay(10);
Serial.println();
Serial.println("System Initiating...");

client.setServer(mqtt_server,mqttPort);
client.setCallback(callback);
readSpiffs();

if ( esid != "" ) {

  WiFi.begin(esid.c_str(), epass.c_str());

  if (checkWifiConnection()) {

    serverType = "WC";

    Serial.println("Successfully connected to WiFi");

    Serial.print("SSID: ");
    Serial.println(WiFi.SSID());
    IPAddress ip = WiFi.localIP();
    Serial.print("IP Address: ");
    Serial.println(ip);
    long rssi = WiFi.RSSI();
    Serial.print("Signal strength (RSSI): ");
    Serial.print(rssi);
    Serial.println(" dBm");
    server->close();

    return;

  } 

}

serverType = "AP";
server=new(ESP8266WebServer);
initiateAccessPoint();

}

void loop() {
if(serverType=="AP"){
server->handleClient();
}else{
if (!client.connected()) {
reconnect();
}
client.loop();
long now = millis();
if (now - lastMsg > 2000) {
lastMsg = now;
if(checkDoorSense()){
Serial.println("OPEN");
if(lastStatus != "OPEN"){
lastStatus = "OPEN";
char json[] = "{"Sensor":"DoorSense1000","SensorID":1,"SensorValue": "OPEN"}";
publishToDeviceSensors(json);
char jsonW[] = "{"WarningType":"Entry","WarningOrigin":"DoorSense1000","WarningValue": "OPEN","WarningMessage": "Door is open"}";
publishToDeviceWarnings(jsonW);
}
} else {
Serial.println("CLOSED");
if(lastStatus != "CLOSED"){
lastStatus = "CLOSED";
char json[] = "{"Sensor":"DoorSense1000","SensorID":1,"SensorValue": "CLOSED"}";
publishToDeviceSensors(json);
}
}
}
}
}`

[WereCatf]

You know... you're calling server->close(); before it is created.

[AdamMiltonBarker]

Ah that was was in from before I spoke to you I tried it everywhere one second, thanks for pointing it out will check again, sorry been awake all night and day trying to fix, eyes are going a bit funny lol.

[AdamMiltonBarker]

That solved the issue with the errors when wifi was connected but after clearing the configs and booting again the AP starts up but it is not possible to connect to it to view the config page.

[AdamMiltonBarker]

Never mind I think I know why, 2 mins.

[AdamMiltonBarker]

I cannot thank you enough :D All complete and project now complete. Thanks again buddy.