Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Arduino ESP32 v3.0 based on ESP-IDF v5.1 #1225

Open
ivankravets opened this issue Nov 4, 2023 · 135 comments
Open

Support Arduino ESP32 v3.0 based on ESP-IDF v5.1 #1225

ivankravets opened this issue Nov 4, 2023 · 135 comments
Labels

Comments

@ivankravets
Copy link
Member

ivankravets commented Nov 4, 2023

The ESP32 Core for Arduino 2.x is the most recent major version currently recommended for use with PlatformIO. The decision to discontinue support was made by the Espressif company, as indicated in their official statement: espressif/arduino-esp32#8606

If you're an Espressif user who relies on PlatformIO for your projects, kindly share your thoughts in the comments below and cast your vote on this matter. Once we gather enough interest from the Espressif community, we plan to reach out to the Espressif company and request a reconsideration of support for PlatformIO.

@thijstriemstra
Copy link

thijstriemstra commented Nov 8, 2023

I've been trying this with following config:

; see https://docs.espressif.com/projects/arduino-esp32/en/latest/installing.html#how-to-update-to-the-latest-code
[env:arduino-latest]
platform = https://github.com/platformio/platform-espressif32.git
board = az-delivery-devkit-v4
framework = arduino
platform_packages =
    framework-arduinoespressif32 @ https://github.com/espressif/arduino-esp32#master

but the build fails with KeyError: 'framework-arduinoespressif32-libs':

Processing arduino-latest (platform: https://github.com/platformio/platform-espressif32.git; board: az-delivery-devkit-v4; framework: arduino)
--------------------------------------------------------------------------------
Platform Manager: Installing git+https://github.com/platformio/platform-espressif32.git
git version 2.42.0
Cloning into '/home/runner/.platformio/.cache/tmp/pkg-installing-uz1yxjz0'...
Platform Manager: espressif32@6.4.0+sha.f6ec392 has been installed!
Tool Manager: Installing git+https://github.com/espressif/arduino-esp32#master
git version 2.42.0
Cloning into '/home/runner/.platformio/.cache/tmp/pkg-installing-kih232ry'...
Tool Manager: framework-arduinoespressif32@3.0.0+sha.bf822ef has been installed!
Library Manager: Installing fortyseveneffects/MIDI Library @ ^5.0.2
Unpacking 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Library Manager: MIDI Library@5.0.2 has been installed!
Verbose mode can be enabled via `-v, --verbose` option
CONFIGURATION: https://docs.platformio.org/page/boards/espressif32/az-delivery-devkit-v4.html
PLATFORM: Espressif 32 (6.4.0+sha.f6ec392) > AZ-Delivery ESP-32 Dev Kit C V4
HARDWARE: ESP32 240MHz, 520KB RAM, 4MB Flash
DEBUG: Current (cmsis-dap) External (cmsis-dap, esp-bridge, esp-prog, iot-bus-jtag, jlink, minimodule, olimex-arm-usb-ocd, olimex-arm-usb-ocd-h, olimex-arm-usb-tiny-h, olimex-jtag-tiny, tumpa)
PACKAGES: 
 - framework-arduinoespressif32 @ 3.0.0+sha.bf822ef 
 - tool-esptoolpy @ 1.40501.0 (4.5.1) 
 - toolchain-xtensa-esp32 @ 8.4.0+2021r2-patch5
Converting edrumulus.ino
/tmp/tmpj5gstour/src/edrumulus.ino:45: warning: "MYMIDI" redefined
 #  define MYMIDI                     usbMIDI
 
/tmp/tmpj5gstour/src/edrumulus.ino:39: note: this is the location of the previous definition
 #  define MYMIDI                     MIDI
 
/tmp/tmpj5gstour/src/edrumulus.ino:46: warning: "MIDI_CONTROL_CHANGE_TYPE" redefined
 #  define MIDI_CONTROL_CHANGE_TYPE   usbMIDI.ControlChange
 
/tmp/tmpj5gstour/src/edrumulus.ino:40: note: this is the location of the previous definition
 #  define MIDI_CONTROL_CHANGE_TYPE   midi::ControlChange
 
/tmp/tmpj5gstour/src/edrumulus.ino:47: warning: "MIDI_SEND_AFTER_TOUCH" redefined
 #  define MIDI_SEND_AFTER_TOUCH      sendAfterTouchPoly
 
/tmp/tmpj5gstour/src/edrumulus.ino:41: note: this is the location of the previous definition
 #  define MIDI_SEND_AFTER_TOUCH      sendAfterTouch
 
KeyError: 'framework-arduinoespressif32-libs':
  File "/opt/hostedtoolcache/Python/3.12.0/x64/lib/python3.12/site-packages/platformio/builder/main.py", line 173:
    env.SConscript("$BUILD_SCRIPT")
  File "/home/runner/.platformio/packages/tool-scons/scons-local-4.5.2/SCons/Script/SConscript.py", line 598:
    return _SConscript(self.fs, *files, **subst_kw)
  File "/home/runner/.platformio/packages/tool-scons/scons-local-4.5.2/SCons/Script/SConscript.py", line 285:
    exec(compile(scriptdata, scriptname, 'exec'), call_stack[-1].globals)
  File "/home/runner/.platformio/platforms/espressif32@src-5f117260f75b328038ec9d3fd0e14a68/builder/main.py", line 346:
    target_elf = env.BuildProgram()
  File "/home/runner/.platformio/packages/tool-scons/scons-local-4.5.2/SCons/Util/envs.py", line 242:
    return self.method(*nargs, **kwargs)
  File "/opt/hostedtoolcache/Python/3.12.0/x64/lib/python3.12/site-packages/platformio/builder/tools/piobuild.py", line 61:
    env.ProcessProgramDeps()
  File "/home/runner/.platformio/packages/tool-scons/scons-local-4.5.2/SCons/Util/envs.py", line 242:
    return self.method(*nargs, **kwargs)
  File "/opt/hostedtoolcache/Python/3.12.0/x64/lib/python3.12/site-packages/platformio/builder/tools/piobuild.py", line 121:
    env.BuildFrameworks(env.get("PIOFRAMEWORK"))
  File "/home/runner/.platformio/packages/tool-scons/scons-local-4.5.2/SCons/Util/envs.py", line 242:
    return self.method(*nargs, **kwargs)
  File "/opt/hostedtoolcache/Python/3.12.0/x64/lib/python3.12/site-packages/platformio/builder/tools/piobuild.py", line 342:
    SConscript(env.GetFrameworkScript(name), exports="env")
  File "/home/runner/.platformio/packages/tool-scons/scons-local-4.5.2/SCons/Script/SConscript.py", line 662:
    return method(*args, **kw)
  File "/home/runner/.platformio/packages/tool-scons/scons-local-4.5.2/SCons/Script/SConscript.py", line 598:
    return _SConscript(self.fs, *files, **subst_kw)
  File "/home/runner/.platformio/packages/tool-scons/scons-local-4.5.2/SCons/Script/SConscript.py", line 285:
    exec(compile(scriptdata, scriptname, 'exec'), call_stack[-1].globals)
  File "/home/runner/.platformio/platforms/espressif32@src-5f117260f75b328038ec9d3fd0e14a68/builder/frameworks/arduino.py", line 41:
    SConscript(
  File "/home/runner/.platformio/packages/tool-scons/scons-local-4.5.2/SCons/Script/SConscript.py", line 662:
    return method(*args, **kw)
  File "/home/runner/.platformio/packages/tool-scons/scons-local-4.5.2/SCons/Script/SConscript.py", line 598:
    return _SConscript(self.fs, *files, **subst_kw)
  File "/home/runner/.platformio/packages/tool-scons/scons-local-4.5.2/SCons/Script/SConscript.py", line 285:
    exec(compile(scriptdata, scriptname, 'exec'), call_stack[-1].globals)
  File "/home/runner/.platformio/packages/framework-arduinoespressif32/tools/platformio-build.py", line 40:
    FRAMEWORK_LIBS_DIR = platform.get_package_dir("framework-arduinoespressif32-libs")
  File "/opt/hostedtoolcache/Python/3.12.0/x64/lib/python3.12/site-packages/platformio/platform/_packages.py", line 32:
    pkg = self.get_package(name)
  File "/opt/hostedtoolcache/Python/3.12.0/x64/lib/python3.12/site-packages/platformio/platform/_packages.py", line 29:
    return self.pm.get_package(spec or self.get_package_spec(name))
  File "/opt/hostedtoolcache/Python/3.12.0/x64/lib/python3.12/site-packages/platformio/platform/_packages.py", line 21:
    owner=self.packages[name].get("owner"),
========================== [FAILED] Took 4.31 seconds ==========================

@ivankravets
Copy link
Member Author

See the updated comment #1225 (comment)

@Jason2866
Copy link
Contributor

Jason2866 commented Nov 10, 2023

Adding Arduino 3.0.0 support is the only way to make the ESP32-C6 available for Arduino projects.
The needed changes are not that many, i have added Arduino 3.0.x alpha support in my Fork and bulding Arduino and IDF projects with the C6 are working.
We have ported Arduino project Tasmota to the C6 and it runs already surprisingly stable.

@Jason2866
Copy link
Contributor

Jason2866 commented Nov 10, 2023

If you're an Espressif user who relies on PlatformIO for your projects, kindly share your thoughts in the comments below and cast your vote on this matter. Once we gather enough interest from the Espressif community, we plan to reach out to the Espressif company and request a reconsideration of support for PlatformIO.

@ivankravets Does this mean that Espressif has dropped any support? Looking in current Arduino 3.0.0 code (branch master) everything regarding Platformio support is there.

@VojtechBartoska
Copy link

Hello all,

I do work in Arduino Core ESP32 project as a Project Manager so I would like to clarify this from our Team point of view.

Please take a look on this comment in original Pull request.

We also update a warning note in our documentation which should be a bit confusing.

To not duplicate what is written in original PR, we will be glad if PlatformIO supports our latest version and we are open to any contributions.

@ivankravets Feel free to contact us any time directly, we will be happy to discuss this if you see any points we can do differently.

Thanks

@0x0fe
Copy link

0x0fe commented Nov 22, 2023

Adding Arduino 3.0.0 support is the only way to make the ESP32-C6 available for Arduino projects.
The needed changes are not that many, i have added Arduino 3.0.x alpha support in my Fork and bulding Arduino and IDF projects with the C6 are working.
We have ported Arduino project Tasmota to the C6 and it runs already surprisingly stable.

@Jason2866
Do you know how i can setup the .ini file in a new project for using your 3.0.0 fork and 5.1 IDF at the same time (to keep the SDK menuConfig)?

@0x0fe
Copy link

0x0fe commented Nov 22, 2023

@ivankravets
there is something i dont understand, why is there a separate platformespressif32 core? It is based on arduinoespressif32, but always lags behind, and arduinoesp32 already lags behind IDF. So what is the point of this separate core? Why is PIO not using arduinoesp32 core as is directly?

I think a reason why many users use PIO is also to keep some of the arduinoesp32 APIs while having the possibility to modify the IDF SDK configuration (menuconfig) which is necessary in many cases and not possible in arduino, unless using the libbuilder (buggy and not convenient).

Maybe it would be wise for PIO to directly use arduinoesp32 core as is, and just focus on allowing users to run arduinoesp32 core along with IDF to keep access to menuconfig.

@mhaberler
Copy link

I am concerned about the viability of this repo long-term as folks like @Jason2866 have started to roll their own and this repo not catching up

I am currently using his https://github.com/tasmota/platform-espressif32/tree/Arduino/IDF5 branch and it works mostly great for me - even if I feel uneasy about relying on a private effort with unclear future - how do you see the longer-term perspective of your fork?

This fork has diverged from this repo massively - not sure this can brought back here easily

the other issue I have is the abysmal debugging experience esp32/pio/arduino compared to using straight IDF

@0x0fe
Copy link

0x0fe commented Nov 23, 2023

@mhaberler i did the same yesterday and used https://github.com/tasmota/platform-espressif32/tree/Arduino/IDF5

platform = https://github.com/Jason2866/platform-espressif32.git#Arduino/IDF5
platform_packages = framework-arduinoespressif32 @ https://github.com/espressif/arduino-esp32.git#3.0.0-alpha2
framework = 
	arduino
	espidf
board = esp32dev

But then when building it complained of missing SPIFFS, i added it manually from previous version (in components directory) but then i get a dependancy error with esp_partition.h, despite it is well present in "components".

   17 | #include "esp_partition.h"
      |          ^~~~~~~~~~~~~~~~~
compilation terminated.
Compiling .pio\build\esp32dev\tcp_transport\transport.o
Compiling .pio\build\esp32dev\tcp_transport\transport_ssl.o
Compiling .pio\build\esp32dev\tcp_transport\transport_internal.o
*** [.pio\build\esp32dev\spiffs\esp_spiffs.o] Error 1
*** [.pio\build\esp32dev\spiffs\spiffs_api.o] Error 1

Did you met this issue too?

@Jason2866
Copy link
Contributor

Jason2866 commented Nov 23, 2023

@0x0fe @mhaberler My fork has not the goal to be compatible to anything official.
The fork is made for project Tasmota. Everything is optimized for that use. The sdkconfig settings differs a lot from the official espressif ones. There are components added and others are removed (for example SPIFFS).
Breaking changes can and will happen.
Imho no reason to be concerned about support of Arduino Espressif. Platformio always do a release when a RELEASED core is available. Core 3.0.0 is in ALPHA state!

Since project Tasmota is always in first row for new stuff, and is active in contributing to espressif Arduino Core, there was the need to have the development version of Arduino Core available with Platformio.
Project Tasmota is only possible with Platformio. Thx again to the Team of Platformio (@ivankravets ) for this awesome IDE!!

The needed changes for Arduino 3.0 in Platformio are not many. A small job for @valeros

@0x0fe
Copy link

0x0fe commented Nov 23, 2023

@Jason2866 oh, i see, that explains the error with SPIFFS

@mhaberler
Copy link

alpha stage - fair enough.

Now assume Core 3.0.0 gets released - does this have any bearing on the debugging situation?

who has the ticket to make that work?

I'm talking about openocd + gdb versions and matching debug configs which work - at least somewhat like Nordic Connect and Segger

I admit I am slightly confused about players and the who-does-what-and-why-not - I might be barking up the wrong tree (or repo) for that matter

@Jason2866
Copy link
Contributor

@mhaberler Does debugging work in espressif IDF env setup? If yes imho Platformio has the job for the devices which are currently supported with IDF 5.1. Not saying it will be easy to solve or it will be done soon. The debug issue for the C6 is known and there is an open issue.

@mhaberler
Copy link

Did you met this issue too?

@0x0fe yes, same here `Failed to resolve component 'spiffs'

@mhaberler
Copy link

@mhaberler Does debugging work in espressif IDF env setup? If yes imho Platformio has the job for the devices which are currently supported with IDF 5.1. Not saying it will be easy to solve or it will be done soon. The debug issue for the C6 is known and there is an open issue.

you mean like command line/shell? yes, repeatably

@0x0fe
Copy link

0x0fe commented Nov 23, 2023

@mhaberler It makes sense, well SPIFFS yo ucan add it manually from previous version but then you will get an error with esp_partition, and i am not sure where to re-enable the SPIFFS module and dependencies correctly.

@ivankravets
Copy link
Member Author

I'm a bit confused. Why is there a separate platform-espressif32 core? It seems to be based on arduino-espressif32, but it always seems to lag behind...

https://github.com/platformio/platform-espressif32 isn't a core itself. It's a software piece that makes the PlatformIO Build API work seamlessly with Espressif 32 products within the PlatformIO ecosystem. If you check the source code of this repository, you'll find other integrations, like ESP-IDF. If we support Zephyr/ESP32, it'll also be found here.

Would it be smarter for PIO to directly use the arduinoesp32 core as it is?

We do use it directly (https://registry.platformio.org/tools/platformio/framework-arduinoespressif32). There's no common ground between Arduino IDE and PlatformIO. The "arduino" in PlatformIO is just a framework. PlatformIO supports over 10+ different frameworks. The reason many developers see PlatformIO as a "replacement for Arduino IDE" is due to source code compatibility and advanced project management with lots of configuration and collaboration features based on PlatformIO's unique declarative principles.

If you've tried another framework besides "arduino", you'd notice there's no difference in the configuration aspect. You and your team can focus on project development without wrestling with bootstrapping and collaboration issues.

Lastly, for a VSCode-based solution with native ESP32/Arduino core support, I recommend the Arduino IDE for VSCode extension backed by Microsoft. It's similar to Arduino IDE 2.0 but uses VSCode as the editor. Both leverage "arduino-cli", so the build system and workflows are the same.

@0x0fe
Copy link

0x0fe commented Nov 23, 2023

@ivankravets I see, glue logic layer. the totally different versioning between these platforms and the cores they implement is rather annoying, though.

@mhaberler
Copy link

@ivankravets make me understand what your recommendation means - are you saying:

When I prefer to use VSCode, I should take the Microsoft Arduino extension for VSCode and drop Platformio?

@ivankravets
Copy link
Member Author

@mhaberler, we value openness in our community and aim to give you the freedom to choose. If there's a newer version of the software not yet supported by PlatformIO, we won't hide it.

The current supported version is Arduino Core v2.x for ESP32. Our collaboration with Espressif, including discussions about renewal, is ongoing. It's worth noting that we have @VojtechBartoska, a project manager from Espressif, in this thread. We're all working together to ensure you receive the best features and support. We'll keep everyone posted on any updates to ensure a smooth continuation of our services.

@hoeken
Copy link

hoeken commented Nov 25, 2023

I can see there's a bit of political project stuff happening, but as an end-user, all I want to do is be able to use the latest Arduino framework. Consider this a vote of support for making that happen, however it needs to be.

@ivankravets
Copy link
Member Author

PlatformIO is a commercial open-source project. In the past, it used to be a paid service before 2020, following a business-to-consumer (B2C) model. Unexpectedly, PlatformIO gained widespread popularity among millions of developers globally. Consequently, we shifted our strategy to make powerful tools for professional embedded development freely accessible to everyone.

The active development and maintenance of PlatformIO, along with its infrastructure, are now supported by technology partners dedicated to delivering an excellent developer experience. Espressif was one such partner, and we appreciate their long-standing collaboration.

Currently, Espressif has ceased support for new products in PlatformIO, but rest assured, we are committed to providing support for existing Espressif products integrated before this change, as per our technology licensing policy. Your projects won't face disruptions, and services will continue as usual.

If there's significant interest from Espressif customers in PlatformIO, we'll reach out to Espressif and explore the possibility of continuing our collaboration.

If you have any questions or need clarification, feel free to ask. We're here to provide all the answers you need.

@mhaberler
Copy link

ok, so Espressif jumped ship

@ivankravets what does that mean for the subject topic - Arduino3?

your wording would suggest to me "no new Espressif releases - be it Arduino or ESP-IDF, existing releases go on life support"

are you saying this repo stops at ESP-IDF 5.1.1/Arduino2 until Espressif changes its mind ?

@Jason2866
Copy link
Contributor

Jason2866 commented Nov 28, 2023

@mhaberler Looks like: as long there is not enough feedback from Platformio users wanting actual espressif framework support, there is no good position from Platformio side to argument why espressif should invest money having Platformio support.
espressif is thinking supporting the ArduinoIDE toy is enough :-(

@sgryphon
Copy link

sgryphon commented Jun 2, 2024

This issue is fixed in arduino-esp32 3.0.0 (since 3.0.0-rc3), but if we're not going to get support for that any time soon, @ivankravets and company might consider dropping back to 2.0.14.

This is not true. Espressif and Platform IO still work fine together, although you had to manually apply some changes while it was in betaa/alpha.

The original post and reference was an error/misinterpretation (Espressif removed -- and subsequently put back, in the same pull request -- links to Platform IO). The original link was to some work-in-progress, not any official statement.

Espressif still works fine with Platform IO.

@sgryphon
Copy link

sgryphon commented Jun 2, 2024

+1 for espressif to support Pio 👍

It already does. See the documentation here: https://docs.espressif.com/projects/arduino-esp32/en/latest/installing.html#installing-using-platformio

@softhack007
Copy link

softhack007 commented Jun 2, 2024

If you're an Espressif user who relies on PlatformIO for your projects, kindly share your thoughts in the comments below and cast your vote on this matter. Once we gather enough interest from the Espressif community, we plan to reach out to the Espressif company and request a reconsideration of support for PlatformIO.

From my point of view, as one of the maintainers of WLED, a very feature rich app for controlling addressable LEDs with esp32:

  • we have moved from Arduino-IDE to platformIO (and platform-espressif32) a few years ago. Today our firmware build system relies on platformIO, and we cannot (and don't want to) go back to arduino-ide. Moving to ESP-IDF without arduino is not an option for us, either.
  • it was a real pain to adopt arduino-esp32 v2.0.x, which is required for supporting esp32-C3/-S2/-S3. But we managed to get that job done.
  • whatever new hardware espressif wants to sell to our thousands of users - we don't even need to think about that as long as "arduino" support in platformIO is missing.
  • even worse, we will not be able to upgrade any of our currently supported MCUs (esp32, S3, S2, C3) to the new arduino-esp32 v3.0.x if we cannot build in platformIO.
  • there is a lot of of interest from our users to exploit the new features of esp32-C6, and -just one example- maybe create a usermod to interact with LEDs using zigbee. Again, we do not even think about this while the chip is not supported in arduino platform-espressif32.

I guess many open source projects would tell a similar story.

Open source firmware is used by lots of individuals and professionals, and today they happily purchase espressif hardware to run their favourite application. But if we don't have arduino support in platformIO for some newer chips, the chances of supporting these chips is absolutely zero.
Arduino-IDE support is good for a few years. Then the community project grows, and Arduino-IDE show its limits;
so platformIO is the logical next step when you can't afford to rewrite everything.

@Hedda
Copy link

Hedda commented Jun 3, 2024

+1 for espressif to support Pio 👍

It already does. See the documentation here: https://docs.espressif.com/projects/arduino-esp32/en/latest/installing.html#installing-using-platformio

@sgryphon check that again and read the warning that sais that explicitly says that PlatformIO is not supported by Espressif, but support is only provided by PlatformIO (and the community). So while it might still work fine for now, (at least for Arduino core 2.x.x users), PlatformIO and this platform-espressif32 library is not officially supported by Espressif, and with that warning Espressif tries to make it clear that they do not want users opening issues about PlatformIO to Espressif.

Warning

Integration of the Arduino Core ESP32 project in PlatformIO is maintained by PlatformIO developers. Arduino Core ESP32 Project Team cannot support PlatformIO-specific issues. Please report these issues in official PlatformIO repositories.

@heidi-bmec-co
Copy link

We have several production systems relying on ongoing support (whether financial or otherwise) between Espressif and PlatformIO. Dropping this support would be seriously detrimental to these projects, especially as time goes on.

@ivankravets
Copy link
Member Author

Hi friends, sorry for the delay. A lot has been happening around PlatformIO and Espressif in the past few days:

Let us share some updates.

The original post and reference was an error/misinterpretation (Espressif removed -- and subsequently put back, in the same pull request

Yes, the PR appears to be a mistake by Espressif's development team, and it's unclear if this action was approved by Espressif management. We continue to provide official support for ESP32 Core v2.0 for Arduino. The new warning indicates there is no official support for ESP32 Core v3.0.

Arduino-IDE shows its limits;

This is a common issue in the semiconductor industry and a reason why many embedded developers prefer alternatives to official vendor tools. Larger silicon vendors often have a disconnect with their customers. Developer reviews of the official VSCode extension highlight numerous issues. Vendors sometimes opt for paid solutions over investing in their tools, misunderstanding the needs of end developers. While they can replicate features, they can't duplicate the vision that makes successful tools effective.

We have several production systems relying on ongoing support (whether financial or otherwise) between Espressif and PlatformIO. Dropping this support would be seriously detrimental to these projects, especially as time goes on.

We are in active discussions with the Espressif team to help them understand the significant ROI they receive from collaborating with PlatformIO. PlatformIO has contributed immense value to Espressif's business over the past decade and is the leading alternative IDE solution for Espressif products. As a larger company now, Espressif has the resources to invest in its tools, which we understand is part of their business strategy. However, it's important to recognize that almost every silicon vendor tries to lock their customers into their tools, which can hinder switching to better competitive products.

Your feedback is crucial. I will tag a few people from the Espressif team. The information you provide is very important to them. There is a high demand for Thread/Zigbee solutions (such as this request), and having support for new Espressif products in PlatformIO is exactly what customers need for the future.

As always, we are committed to providing a superior developer experience and boosting your project development.

cc: @rftafas, @igrr, @pedrominatel, @VojtechBartoska

Regards,
Your friends at PlatformIO Labs

@HamzaHajeir
Copy link

I believe the future is longer than what have passed, holding more than what already left. Espressif's lean to the developers demands would reflect positively in adopting their products continuously.

Naturally, Arduino developers would be looking for better experience that enable them be more productive, turning to PIO is a seamless shift with great productivity yield, which also offers another seamless shift to ESP-IDF Framework. Finally when it comes to some requirements, ESP-IDF would be their final step regarding Espressif products.

This gradual view looks more natural than imagining a hard shift from completely simple hobbyist Arduino IDE to completely tight proffessionalist IDE.

While PlatformIO fills the gap between both, it also adds a lot by the environments concept, which is the reason why lots of libraries developers use.

I understand the mentality of Espressif as a manufacturing company, as they're responsible; they keep focusing on developing their own IDE to meet the demand of their customers, they also maintain the arduino core themselves to help and facilitate to newcomers. What's left is supporting the natural journey of newcomers with all of its details, already provided by PIO and supported by libraries developers.

Regards,

@BCsabaEngine
Copy link

BCsabaEngine commented Jun 7, 2024

Easy upgrade to 2.0.17

[env:default]
platform = espressif32@6.7.0
platform_packages =
    platformio/framework-arduinoespressif32 @ https://github.com/espressif/arduino-esp32/releases/download/2.0.17/esp32-2.0.17.zip

@BCsabaEngine
Copy link

BCsabaEngine commented Jun 7, 2024

With

platform_packages=
  framework-arduinoespressif32 @ https://github.com/espressif/arduino-esp32.git#3.0.1
  framework-arduinoespressif32-libs @ https://github.com/espressif/arduino-esp32/releases/download/3.0.1/esp32-arduino-libs-3.0.1.zip

I successfully compiled my project, and it runs is esp32-s3.
FastLED has some warning and error, and I had to work with breaking chamges. Result binary is larger about +22%

Should I use Arduino 3.0.1?

@teddybee
Copy link

teddybee commented Jun 7, 2024

arduino-esp32 3.0.1 is needed for esp32-c6 boards.

@Jason2866
Copy link
Contributor

Definitely use Arduino Core 3.0.1. It is stable and many bug and issues from core 2.0.x are fixed.

@fredlcore
Copy link

platform_packages=
  framework-arduinoespressif32 @ https://github.com/espressif/arduino-esp32.git#3.0.1
  framework-arduinoespressif32-libs @ https://github.com/espressif/arduino-esp32/releases/download/3.0.1/esp32-arduino-libs-3.0.1.zip

For my project this also works great, binary size is 10% larger compared to 2.0.16. Would that also be the case when compiling with Arduino IDE?
And why is this no "official" solution? This is done easily and uses the official Espressif sources, so no need to rely on some third party solution. Can we recommend this to the users of our projects or is there something to look out for?

@Jason2866
Copy link
Contributor

@fredlcore There is no size difference if you use ArduinoIDE. The workaround via platform_packages does work only for the MCUs which are supported with core 2.0.x
So no easy way to use the C6 and H2. For the C6 this can be solved by adding custom boards.json. For the H2 there is no way, since it needs changes in Platformio code.

@fredlcore
Copy link

Ah, ok, good to know. For my project, we have a fixed set of MCUs (Olimex EVB/POE-ISO as well as Joy-It ESP32 Dev Kit), so it really helps to know that I can adjust the code to 3.x without the need to maintain two different code-bases.
As for the size, it's really strange to see the difference for the same code:
PlatformIO with 2.0.16: 1290429 Bytes
PlatformIO with 3.0.1: 1415581 Bytes
Arduino IDE with 3.0.1: 1342017 Bytes
RAM usage is the same between Arduino IDE and PlatformIO for 3.0.1 (52380 Bytes) and is actually higher (55528) with 2.0.16.

@Jason2866
Copy link
Contributor

Jason2866 commented Jun 14, 2024

Mhh, could be that some compile/linker flag settings are different, since the settings from core 2.x are used in Platformio. This would indeed end in different sizes.
For example using-mno-target-align will decrease firmware size. Afaik not active in Platformio setup for core 2.0.x

@fredlcore
Copy link

Ok, understood (but then 2.0.16 should be larger than 3.0.1, not the other way round, if -mno-target-align was not used in 2.0.x, right?)

@Jason2866
Copy link
Contributor

Jason2866 commented Jun 14, 2024

No, core 2.x has a lower footprint at all. And don't use this option with core 2.x. The compiler toolchains used for core 2.x doesn't have it correctly implemented.

@softhack007
Copy link

@sivar2311
Copy link

looks like there is news? https://piolabs.com/blog/press-releases/espressif-leverages-platformio-labs-technology.html

Take a closer look! "Published on 6th Jun 2022"

@softhack007
Copy link

🤦

@cziter15
Copy link

cziter15 commented Jun 18, 2024

I've opened my fork and changed platform.json to pull 3.0.1 release for my ksIotFrameworkLib

All you have to do is to modify platform property inside platformio.ini:

[env]
platform = https://github.com/cziter15/platform-espressif32.git

I've also had to add some magic in my lib via extra script due to their network refactoring:

if (int(cpp_defines_dict.get('ARDUINO', None)) >= 10812):
  e.ProcessFlags("-DWiFiClientSecure=NetworkClientSecure")
  e.ProcessFlags("-DWiFiClient=NetworkClient")
  e.ProcessFlags("-DWiFiServer=NetworkServer")
  e.ProcessFlags("-DWiFiUDP=NetworkUDP")

Might look like nonsense, but they've just defined things like this...

#define WiFiClient NetworkClient

which causes a lot of pain, when you've used forward declarations, which is required by unique_ptr for example.

Despite the difficulties, I managed to move all my ESP32 projects to 3.0.1 / IDF 5.1

  • The binaries are a bit bigger, among others because of the chip-debug-report feature.
  • The network system has been refactored which can also make things bigger in size.

@sivar2311
Copy link

Hi @cziter15 !

if (int(cpp_defines_dict.get('ARDUINO', None)) >= 10812):
  e.ProcessFlags("-DWiFiClientSecure=NetworkClientSecure")
  e.ProcessFlags("-DWiFiClient=NetworkClient")
  e.ProcessFlags("-DWiFiServer=NetworkServer")
  e.ProcessFlags("-DWiFiUDP=NetworkUDP")

Why is this necessary?

WiFiClient, WiFiClientSecure, WiFiSever and WiFiUDP are available via
WiFiClient.h, WiFiClientSecure.h, WiFiServer.h and WiFiUdp.h.
This should ensure backwards compatibility.

@cziter15
Copy link

cziter15 commented Jun 18, 2024

As I said earlier, if you use forward declaration, then the compiler won't know what WiFiClient is, because it will be overriden in cpp file.

It's like you have class WiFiClient in .h file, but .cpp sees NetworkClient name everywhere, #define works like text replace and has nothing to do with types.

Usually it's handled via separate typedef related headers, see Wintypes.h for reference
https://github.com/LudovicRousseau/PCSC/blob/master/src/PCSC/wintypes.h

@sivar2311
Copy link

Ah yes, of course. That makes sense.
Thanks for the clarification 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests