New LTE Firmware releases v1.18.1.r4 (stable) & 1.19.0.b5 (development) & NB-IoT firmware 40343

[robert-hh]

@xykon Hi @Xykon Did you push that to master or is it the same code as in branch lte-xykon?

[Xykon]

@robert-hh said in New LTE Firmware releases v1.18.1.r4 (stable) & 1.19.0.b5 (development) & NB-IoT firmware 40343:

@xykon Hi @Xykon Did you push that to master or is it the same code as in branch lte-xykon?

The stable firmware is only in the lte-xykon branch for now.

[tlanier]

@xykon
With v1.18.1.r4 installed I now get an error when I try to do a socket connect.

[serafimsaudade]

@tlanier

I'm getting the same error, but don't happens all the time. It seems a DNS problem.
If a use the IP address the error disappears.

Tested with MEO/Altice Portugal

[reidfo]

Will you be adding an option to the updater to use LittleFS?

[dan]

@reidfo If you use the development version of the firmware and updater, you have an option to choose file systems (check Show Advanced Settings).

[tlanier]

@serafimsaudade

I get the same error even if I use an IP address. I don't think it's a DNS problem.

[reidfo]

@dan Thanks, not sure how I missed that. I updated to 1.19.0.b5 using the updater and it broke LTE on my FiPy. The board would initially attach, then after several seconds the connection seemed to hang. AT commands took several seconds to complete. I downgraded back to my previous firmware (1.19.0.b4 built myself from the development branch) and it started working again.

[dan]

@serafimsaudade @tlanier we are looking into the issue with sockets

[danielm]

@dan
Is there any time estimation for fix of socket issue?

[tlanier]

@dan
If it helps, note that the socket error occurs even if I'm using WIFI and connecting to a static IP. I don't think the problem has anything to do with the LTE module.

[danielm]

@tlanier
Is the behaviour identical on 1.19.0.b5 and 1.18.1.r4?

[serafimsaudade]

@tlanier
I'm using mqtt that use sockets over wifi connection with no problem.

[tlanier]

@tlanier

The problem with the previous code was my own fault. The "ssl.wrap_socket(s)" line should not be used when connecting to a non-secure site.

I now believe that the problem only occurs when connecting to a secure site. I can successfully connect using WIFI to a non-secure site. If I try to connect to a secure site (www.google.com), I get a stack overflow error.

[tlanier]

@tlanier
I'm now successfully connecting and downloading from a non-secure site using either LTE or WIFI. The errors occur if I try to connect to a secure site (www.google.com) using either LTE or WIFI.

# TEST - uses cell modem
def get1():
    try:
        log('creating LTE object - carrier verizon')
        # lte = LTE()
        lte = LTE(carrier="verizon")
        # lte = LTE(carrier="at&t")         # instantiate the LTE object
        log('resetting modem, may take up to 5 secs...')
        lte.reset()
        log('attaching...')
        lte.attach(apn='apn.hologram.io')        # attach the cellular modem to a base station
        # lte.attach(band=13)        # attach the cellular modem to a base station
        
        i = 0
        while not lte.isattached():
            log('waiting for isattached...')
            utime.sleep_ms(1000)

        log('connecting...')
        # lte.connect()       # start a data session and obtain an IP address
        lte.connect(cid=3)    # cid=3 for verizon - start a data session and obtain an IP address
        while not lte.isconnected():
            log('waiting for isconnected...')
            utime.sleep_ms(500)

        log('create socket')
        s = socket.socket()

        log("Connect to: www.ces-web.com")
        sockaddr = socket.getaddrinfo('www.ces-web.com', 80)[0][-1]

        #log("Connect to: www.google.com")
        #s = ssl.wrap_socket(s)
        #sockaddr = socket.getaddrinfo('www.google.com', 443)[0][-1]

        log("socket address: {}".format(sockaddr))

        s.connect(sockaddr)
        log("send GET request")
        s.send(b"GET / HTTP/1.0\r\n\r\n")
        log("receive response")
        log(s.recv(16))
        s.close()
        log("socket closed")
        lte.disconnect()
        log("disconnected")
        lte.dettach()
        log("dettached")
        lte.deinit()
        log("deinit")
    except Exception as ex:
        sys.print_exception(ex)
        sys.exit()

[panda]

With this latest version on a GPy and latest CAT M1 modem firmware I can no longer connect with hologram SIM.

lte.connect() will dettach the modem and the REPL input hangs.

Previously I could successfully do:

lte = LTE('verizon')
lte.attach(apn='apn.hologram.io')
...
lte.connect(cid=3)

Going back to 1.18.1.r1 and 38638 modem fw works fine. Why would this change? How do I connect to Hologram with the latest updates?

The creg info is:

['+CEREG: 2,5,"3D03","00F0F703",7', 'OK']

[Xykon]

Thanks everyone for the reports.

@iwahdan is looking into the SSL issue as this doesn't seem to be directly related to the LTE changes I made.

@panda Unfortunately we don't have hologram.io in The Netherlands so all I can do is emulate Verizon on our Amarisoft eNB.

Could you please try the following 3 commands between attach and connect?

print(lte.send_at_cmd('AT+CGATT?'))
print(lte.send_at_cmd('AT+CFUN?'))
print(lte.send_at_cmd('AT!="showphy"'))

You mention that the REPL input hangs after connect()... if you do a hard reset does it keep hanging?

If you are able to reset the module and enter code, can you please run the 3 commands again without calling attach first?

[panda]

@xykon said in New LTE Firmware releases v1.18.1.r4 (stable) & 1.19.0.b5 (development) & NB-IoT firmware 40343:

Could you please try the following 3 commands between attach and connect?

text
print(lte.send_at_cmd('AT+CGATT?'))
print(lte.send_at_cmd('AT+CFUN?'))
print(lte.send_at_cmd('AT!="showphy"'))

['+CGATT: 1', 'OK']

['+CFUN: 1', 'OK']

['DL SYNCHRO STATISTICS', '=====================', ' Synchro state : DRX_SLEEP', ' PPU SIB1 ACQ watchdog : 0', ' Frequency Hypothesis RF (Hz) : 0', ' RSRP (dBm) : -94.06', ' RSRQ (dB) : -10.79', ' Channel estimation state (Cell-spec.) : HIGH CINR', ' Channel estimation state (UE-spec.) : LOW CINR', ' Channel estimation state (MBSFN) : LOW CINR', ' Channel estimation CINR : 10.10', ' Channel length : SHORT', ' AGC', ' AGC RX gain (dB) : 53.71', ' RX PSD BO (dBFs) : -20.63', ' RX PSD (dBm) : -99.33', ' Noise level RS (dBm) : -104.16', ' Digital gain (dB) : 9.03', ' CINR RS (dB) : 10.10', ' NARROWBANDS', ' Last DL NB : Central', ' Last UL NB : N/A', ' AFC', ' Frequency offset RF (Hz) : -316', ' Frequency offset BB (Hz) : 0', ' PBCH', ' MIB received quantity : 1239', ' MIB timeout quantity : 0', 'OK']

You mention that the REPL input hangs after connect()... if you do a hard reset does it keep hanging?

No, reset solves it.

If you are able to reset the module and enter code, can you please run the 3 commands again without calling attach first?

['+CGATT: 0', 'OK']

['+CFUN: 4', 'OK']

['DL SYNCHRO STATISTICS', '=====================', ' Synchro state : OFF', ' PPU SIB1 ACQwatchdog : 0', ' Frequency Hypothesis RF (Hz) : 0', ' RSRP (dBm) : 0.00', ' RSRQ (dB) : 0.00', ' Channel estimation state (Cell-spec.) : LOW CINR',' Channel estimation state (UE-spec.) : LOW CINR', ' Channel estimation state (MBSFN) : LOW CINR', ' Channel estimation CINR : 0.00', ' Channel length : SHORT', ' AGC', ' AGC RX gain (dB) : 0.00', ' RX PSD BO (dBFs) : 0.00', ' RX PSD (dBm) : 0.00', ' Noise level RS (dBm) : 0.00', ' Digital gain (dB) : 0.00', ' CINR RS (dB) : 0.00', ' NARROWBANDS', ' Last DL NB :0', ' Last UL NB : 0', ' AFC', ' Frequency offset RF (Hz) : 0', ' Frequency offset BB (Hz) : 0', ' PBCH', ' MIB received quantity : 0', ' MIB timeout quantity : 0', 'OK']

[iwahdan]

Hi @tlanier ,I am not able to reproduce the stack overflow issue you got yet, however I've made some improvements to LTE and sockets in a pre-release v1.18.1.r5 :
https://github.com/pycom/pycom-micropython-sigfox/releases/tag/v1.18.1.r5
maybe you can see if that solves the problem.

[danielm]

@iwahdan
I am testing 1.18.1.r5 on FiPy with NB1-40343 running following code in main.py:

import network
import time
import urequests

class httpPostTest():
	def __init__(self):	
		self.apn = None
		self.band = None
		self.LTEisAttached = False
		self.LTEisAttachedLast = False
		self.LTEisConnected = False
		self.LTEisConnectedLast = False

		self.start = True

	def initLTE(self, band, apn):
		self.apn = apn
		self.band = band
		print("INFO", "Starting initialization of LTE")
		
		try:
			self.lte = network.LTE()
			print("INFO", "LTE initialized")
		except:
			print("WARNING", "LTE init command failed")	

		print("LTE is attached after init:", self.lte.isattached())
		print("LTE is connected after init:", self.lte.isconnected())

	def run(self, url):	
		n = 0
		while True:

			self.LTEisAttached = self.lte.isattached()

			if not self.LTEisAttached and (self.LTEisAttachedLast or self.start):
				if not self.start:
					print("WARNING", "Dettached from LTE network")
				try:
					self.lte.attach(band = self.band, apn = self.apn)
					print("INFO", "LTE attach command sent")
					self.start = False
				except:
					print("WARNING", "LTE attach command failed")

			if self.LTEisAttached and not self.LTEisAttachedLast:
				print("INFO", "Attached to LTE network")
				try:
					self.lte.connect()
					print("INFO", "LTE connect command sent")
				except:
					print("WARNING", "LTE connect command failed")

			self.LTEisAttachedLast = self.LTEisAttached

			self.LTEisConnected = self.lte.isconnected()

			if self.LTEisConnected and not self.LTEisConnectedLast:
				print("INFO", "Connected to LTE network")

			elif not self.LTEisConnected and self.LTEisConnectedLast:
				print("WARNING", "Disconnected from LTE network")

			self.LTEisConnectedLast = self.LTEisConnected

			if self.LTEisConnected:
				n+=1
				try:
					response = urequests.post(url, headers={"Content-Type": "application/json", "Accept": "application/json"}, data='{"time": "%s"}' % (time.time()))
					print("INFO", "%s. HTTP POST successful: %s" % (n, response.text))
				except Exception as e:
					print("WARNING", "%s. HTTP POST failed: %s" % (n, e))

			time.sleep(0.25)

test = httpPostTest()
test.initLTE(20, "nbiot.telekom.sk")
test.run(url = "https://54.167.116.227/post")

It is also available here for download including slightly modified urequests library:
https://drive.google.com/open?id=19hA2KGq4iwkkv36d2cuW1M4j0Tab9_YP

Issues:

1. The code often hangs during LTE initialization (self.lte = network.LTE())
2. If it makes it through init only first request is sent successfully and then the modem seems to dettach from the network:

INFO Starting initialization of LTE
INFO LTE initialized
LTE is attached after init: False
LTE is connected after init: False
INFO LTE attached command sent
INFO Attached to LTE network
INFO LTE connect command sent
INFO Connected to LTE network
INFO 1. HTTP POST successful: {"args":{},"data":{"time":"13"},"files":{},"form":{},"headers":{"x-forwarded-proto":"https","host":"54.167.116.227","content-length":"14","accept":"application/json","content-type":"application/json","x-forwarded-port":"443"},"json":{"time":"13"},"url":"https://54.167.116.227/post"}
WARNING 2. HTTP POST failed: Avialable Interfaces are down
WARNING Dettached from LTE network

Application code written for our product behaves in a similar way since 1.18.1.r3.