Ubuntu 18.04 / 20.04 base minimal image for RK3399 with camera support (NanoPi M4 v1 - 2GB / 4 GB)
OS Image for development with the following tidbits:
- Kernel 4.4.y (with the best of both world, rockchip bsp kernel + kernel.org 4.4.y)
- Gbps
- Wifi
- Bluetooth
- 3D mali gpu (fbdev / gbm / x11)
- VPU (GBM / X11 / lxde)
- camera (WiP)
OS Image
BSP Kernel 4.4
- Release v1.0
- Release v1.1
- Remote access - ssh
- mali - fbdev
- Wifi - wlan
- GBM - mali
- Release v1.0
- Kodi Media Center on RK3399
- Release v1.3 - Kernel 4.4.168
- Release v1.4 - Kernel 4.4.169
- Release v1.8 - Kernel 4.4.169 eMMC install
- Release v1.9 - Kernel 4.4.170
- Release v1.10 - Kernel 4.4.171
- Release v1.11 - Kernel 4.4.172
- Release v1.13 - Kernel 4.4.173
- Release v1.15 - Kernel 4.4.173-rk3399
- Release v1.18 - Kernel 4.4.175-rk3399
- Release v1.19 - Kernel 4.4.177-rk3399
- Fix for memory leak and crash
- Bluetooth
- Kodi on login
- Kodi 19
- Building Kodi 19
Mainline Kernel 5.x
- Mainline Kernel on NanoPi M4
- Mainline Kernel 5.0-rc2
- Release v1.14 - Experimental
- Mainline Kernel 5.1-rc6
- Mainline Kernel 5.2.0
- Mainline Kernel 5.6.2
- Building Mainline Instructions
Ubuntu 19.10 - EOAN Ermine
- Ubuntu 19.10
- Kernel 5.3.0-rc7
- Kernel 5.3.1
- Kernel 5.4.0-rc4
- Bluetooth Ubuntu 19.10
- Building Kernel 5.3.1 on board
Status of the Mainline Kernel 5.4.y
Fixing Wifi on Mainline Kernel
Status of the Mainline Kernel 5.7.y
BSP Kernel 4.19
Mainline u-boot
Mainline Kernel 5.9
Mainline Kernel 5.10
Camera experiments with Kernel 4.19
Camera experiments with Kernel 5.10
Screenshot comparison - OV13850 / OV4689
Dual-camera with Kernel 4.19.y
Dual camera with Mainline Kernel 5.11.0
- Kernel 5.11.0
- Linux kernel headers for 5.11.0 (https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/1.42a)
Here we are going to fix the reboot issue i had with my u-boot Android like build. We are going to build the latest u-boot on NanoPi M4 (2GB) running from SD CARD.
-
Install dependencies
sudo apt-get install device-tree-compiler python3-dev python3-distutils swig sudo apt-get install gcc-arm-none-eabi -
Build u-boot
mkdir u-boot cd u-boot/ git clone https://github.com/ARM-software/arm-trusted-firmware cd arm-trusted-firmware/ make PLAT=rk3399 DEBUG=0 bl31 cd .. export BL31=$PWD/arm-trusted-firmware/build/rk3399/release/bl31/bl31.elf git clone https://gitlab.denx.de/u-boot/u-boot.git make -C u-boot distclean make -C u-boot nanopi-m4-2gb-rk3399_defconfig make -C u-boot -
install
sudo dd if=u-boot/idbloader.img of=/dev/mmcblk1 seek=64 sudo dd if=u-boot/u-boot.itb of=/dev/mmcblk1 seek=16384 -
reboot
sync && sudo reboot
Testing and Benchmarking 5.10 RC (WiP) in Ubuntu 20.04 LTS Simple benchmarks in progress for the nanoPi M4 2G (DDR3).
| SBC Dev Board tested | NanoPi M4 |
|---|---|
| kernel version | 5.10.0-rc3 |
| gcc version | 10 |
| display | hdmi |
| graphical interface | CLI |
| idle Temp ºC / freq | 25 ºC / 408 Mhz |
| full Temp ºC / freq | 55 ºC / 1.5 GHz - 2.0 GHz |
| RAM memory usage (avg) | 97 Mbytes |
| i2c | |
| spi | |
| hdmi sound out | |
| rt5651 | |
| spdif | |
| Camera | |
| Wifi | |
| BT | BCM4356A2 |
| ethernet | Gbps |
| sound | hdmi-sound and Bluetooth |
| gpu | panfrost |
| vpu | |
| DVFS | |
| ------------------------ | ------------------------------ |
-
Kernel 5.10.0-rc3
- hdmi
- hdmi sound
- analog sound
- Wifi
- BT
- Mainline u-boot
- reboot (ok)
- shutdown (ok)
- gpu panfrost
- vpu hantro
Building Vanilla Kernel natively on NanoPi M4 with gcc 10.2.0
-
Build your kernel
cd kernel export KVD=$PWD make nanopim4_full_defconfig make oldconfig make -j6 INSTALL_MOD_PATH=output Image make -j6 INSTALL_MOD_PATH=output dtbs make -j6 INSTALL_MOD_PATH=output modules make -j6 INSTALL_MOD_PATH=output modules_install export KV="5.10.0-rc3" make -j6 INSTALL_HDR_PATH=output/usr/src/linux-headers-${KV} headers_install -
Install your kernel
sudo cp -fv ./arch/arm64/boot/Image /boot/Image_${KV} sudo cp -vf ./arch/arm64/boot/dts/rockchip/rk3399-nanopi-m4.dtb /boot/rk3399-nanopi-m4.dtb_${KV} sudo cp -vfr ./output/usr/* /usr/ sudo cp -vfr ./output/lib/* /usr/lib -
Make it current kernel
cd /boot sudo ln -sf Image_${KV} Image sudo ln -sf rk3399-nanopi-m4.dtb_${KV} dtb cd ${KVD} sync -
Reboot
sync && sudo reboot
The kernel 5.10.0-rc3
-
Testing the kernel 5.10 RC (WIP)
-
GPU
Testing the panfrost with GBM (OpenGLES2)
-
VPU
Very simple tests
-
Wifi
Testing Wifi with iperf3
-
2.4 GHz
./iperf3 -c 192.168.254.49 Connecting to host 192.168.254.49, port 5201 [ 5] local 192.168.254.253 port 33722 connected to 192.168.254.49 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 11.7 MBytes 98.4 Mbits/sec 8 66.5 KBytes [ 5] 1.00-2.00 sec 11.2 MBytes 93.6 Mbits/sec 5 83.4 KBytes [ 5] 2.00-3.00 sec 11.2 MBytes 94.1 Mbits/sec 7 69.3 KBytes [ 5] 3.00-4.00 sec 11.2 MBytes 93.6 Mbits/sec 3 83.4 KBytes [ 5] 4.00-5.00 sec 11.4 MBytes 95.6 Mbits/sec 6 83.4 KBytes [ 5] 5.00-6.00 sec 11.2 MBytes 93.6 Mbits/sec 7 84.8 KBytes [ 5] 6.00-7.00 sec 11.2 MBytes 94.1 Mbits/sec 7 67.9 KBytes [ 5] 7.00-8.00 sec 11.2 MBytes 94.1 Mbits/sec 4 83.4 KBytes [ 5] 8.00-9.00 sec 11.2 MBytes 93.6 Mbits/sec 7 52.3 KBytes [ 5] 9.00-10.00 sec 11.2 MBytes 93.6 Mbits/sec 5 69.3 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 113 MBytes 94.5 Mbits/sec 59 sender [ 5] 0.00-10.01 sec 112 MBytes 94.1 Mbits/sec receiver -
5 GHz
./iperf3 -c 192.168.254.49 Connecting to host 192.168.254.49, port 5201 [ 5] local 192.168.254.253 port 33958 connected to 192.168.254.49 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 23.0 MBytes 193 Mbits/sec 10 197 KBytes [ 5] 1.00-2.00 sec 19.2 MBytes 161 Mbits/sec 0 260 KBytes [ 5] 2.00-3.00 sec 22.1 MBytes 186 Mbits/sec 24 304 KBytes [ 5] 3.00-4.00 sec 22.4 MBytes 188 Mbits/sec 0 354 KBytes [ 5] 4.00-5.00 sec 22.6 MBytes 190 Mbits/sec 5 396 KBytes [ 5] 5.00-6.00 sec 24.1 MBytes 202 Mbits/sec 0 437 KBytes [ 5] 6.00-7.00 sec 22.8 MBytes 191 Mbits/sec 9 355 KBytes [ 5] 7.00-8.00 sec 22.9 MBytes 192 Mbits/sec 14 393 KBytes [ 5] 8.00-9.00 sec 23.5 MBytes 197 Mbits/sec 15 433 KBytes [ 5] 9.00-10.00 sec 23.3 MBytes 196 Mbits/sec 0 469 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 226 MBytes 190 Mbits/sec 77 sender [ 5] 0.00-10.01 sec 224 MBytes 188 Mbits/sec receiver
-
-
RTL8211E Gigabit Ethernet
Testing Eth0 with iperf3
-
100 Mbit
./iperf3 -c 192.168.254.69 Connecting to host 192.168.254.69, port 5201 [ 5] local 192.168.254.253 port 46714 connected to 192.168.254.69 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 11.7 MBytes 98.2 Mbits/sec 9 46.7 KBytes [ 5] 1.00-2.00 sec 11.2 MBytes 93.6 Mbits/sec 6 69.3 KBytes [ 5] 2.00-3.00 sec 11.4 MBytes 95.6 Mbits/sec 7 50.9 KBytes [ 5] 3.00-4.00 sec 11.2 MBytes 94.1 Mbits/sec 5 69.3 KBytes [ 5] 4.00-5.00 sec 11.2 MBytes 93.7 Mbits/sec 6 83.4 KBytes [ 5] 5.00-6.00 sec 11.3 MBytes 94.6 Mbits/sec 6 70.7 KBytes [ 5] 6.00-7.00 sec 11.2 MBytes 93.6 Mbits/sec 6 86.3 KBytes [ 5] 7.00-8.00 sec 11.2 MBytes 93.6 Mbits/sec 6 69.3 KBytes [ 5] 8.00-9.00 sec 11.2 MBytes 93.6 Mbits/sec 6 83.4 KBytes [ 5] 9.00-10.00 sec 11.4 MBytes 95.6 Mbits/sec 7 86.3 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 113 MBytes 94.6 Mbits/sec 64 sender [ 5] 0.00-10.01 sec 112 MBytes 94.1 Mbits/sec receiver -
1 Gbit
Having problems with rgmii and rgmii-id to get IP from the router. Possibly wrong configuration. NanoPi M4 Board acts strange when can't get tthe IP
./iperf3 -c 192.168.254.70 Connecting to host 192.168.254.70, port 5201 [ 5] local 192.168.254.253 port 45954 connected to 192.168.254.70 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 114 MBytes 955 Mbits/sec 0 342 KBytes [ 5] 1.00-2.00 sec 112 MBytes 939 Mbits/sec 0 342 KBytes [ 5] 2.00-3.00 sec 112 MBytes 939 Mbits/sec 0 356 KBytes [ 5] 3.00-4.00 sec 113 MBytes 946 Mbits/sec 0 356 KBytes [ 5] 4.00-5.00 sec 112 MBytes 941 Mbits/sec 0 356 KBytes [ 5] 5.00-6.00 sec 112 MBytes 941 Mbits/sec 0 356 KBytes [ 5] 6.00-7.00 sec 112 MBytes 938 Mbits/sec 0 356 KBytes [ 5] 7.00-8.00 sec 112 MBytes 943 Mbits/sec 0 356 KBytes [ 5] 8.00-9.00 sec 112 MBytes 939 Mbits/sec 0 356 KBytes [ 5] 9.00-10.00 sec 112 MBytes 942 Mbits/sec 0 356 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 1.10 GBytes 942 Mbits/sec 0 sender [ 5] 0.00-10.01 sec 1.10 GBytes 940 Mbits/sec receiverRevrese
./iperf3 -c 192.168.254.70 -R Connecting to host 192.168.254.70, port 5201 Reverse mode, remote host 192.168.254.70 is sending [ 5] local 192.168.254.253 port 45902 connected to 192.168.254.70 port 5201 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 111 MBytes 931 Mbits/sec [ 5] 1.00-2.00 sec 112 MBytes 941 Mbits/sec [ 5] 2.00-3.00 sec 112 MBytes 940 Mbits/sec [ 5] 3.00-4.00 sec 112 MBytes 941 Mbits/sec [ 5] 4.00-5.00 sec 112 MBytes 940 Mbits/sec [ 5] 5.00-6.00 sec 112 MBytes 941 Mbits/sec [ 5] 6.00-7.00 sec 112 MBytes 941 Mbits/sec [ 5] 7.00-8.00 sec 112 MBytes 941 Mbits/sec [ 5] 8.00-9.00 sec 112 MBytes 941 Mbits/sec [ 5] 9.00-10.00 sec 112 MBytes 936 Mbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 1.10 GBytes 942 Mbits/sec 58 sender [ 5] 0.00-10.00 sec 1.09 GBytes 940 Mbits/sec receiver
-
-
Bluetooth
Testing conectivity with some hardware.
-
HDMI sound
Testing sound output to HDMI.
-
Headphone jack sound
Testing sound output to jack.
-
7z b
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21 p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE) LE CPU Freq: - 64000000 - - - 256000000 - - 2048000000 RAM size: 1922 MB, # CPU hardware threads: 6 RAM usage: 1323 MB, # Benchmark threads: 6 Compressing | Decompressing Dict Speed Usage R/U Rating | Speed Usage R/U Rating KiB/s % MIPS MIPS | KiB/s % MIPS MIPS 22: 6248 524 1161 6078 | 102582 519 1685 8748 23: 6323 552 1167 6443 | 100510 519 1676 8697 24: 6027 527 1231 6481 | 98711 518 1671 8664 25: 5856 514 1301 6687 | 97221 519 1666 8652 ---------------------------------- | ------------------------------ Avr: 529 1215 6422 | 519 1675 8690 Tot: 524 1445 7556
-
| SBC Dev Board tested | NanoPi M4 |
|---|---|
| kernel version | 5.9 |
| gcc version | 10 |
| display | hdmi |
| graphical interface | CLI |
| idle Temp ºC / freq | 25 ºC / 408 Mhz |
| full Temp ºC / freq | 55 ºC / 1.5 GHz - 2.0 GHz |
| RAM memory usage (avg) | 92 Mbytes |
| i2c | yes |
| spi | |
| hdmi sound out | yes |
| rt5651 | yes |
| spdif | |
| Camera | |
| Wifi | yes |
| BT | yes |
| ethernet | Gbps |
| sound | hdmi-sound and Bluetooth |
| gpu | panfrost |
| vpu | wip |
| DVFS | yes |
| ------------------------ | ------------------------------ |
-
Kernel 5.9.0
OS Image file (8GB): https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.41
- hdmi
- hdmi sound
- analog sound
- Wifi
- BT
- Mainline u-boot
- reboot (ok)
- shutdown (ok)
- gpu panfrost
- vpu hantro
-
Kernel 5.9.0-rc7
Kernel 5.9.0-rc7 with working:
- hdmi
- hdmi sound
- analog sound
- Wifi
- BT
- Mainline u-boot
- reboot (ok)
- shutdown (ok)
- gpu panfrost
- vpu hantro
Boot log: https://gist.github.com/avafinger/ba6af660751c3e2917868bb3060beb13
The OS Image file for 2GB DRAM and 4 GB DRAM: Image file: https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.40
The OS Image file with mainline u-boot for 2GB DRAM only: Image file: https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.39
-
Kernel 5.9.0-rc6
The OS Image file will be here: Image file: https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.38
ubuntu@nanopi-m4:~$ uname -ra Linux nanopi-m4 5.9.0-rc6 #1 SMP PREEMPT Sat Sep 26 19:07:46 -03 2020 aarch64 aarch64 aarch64 GNU/Linux ubuntu@nanopi-m4:/$ gcc --version gcc (Ubuntu 10-20200411-0ubuntu1) 10.0.1 20200411 (experimental) [master revision bb87d5cc77d:75961caccb7:f883c46b4877f637e0fa5025b4d6b5c9040ec566] Copyright (C) 2020 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. ubuntu@nanopi-m4:~$ 7z b 7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21 p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE) LE CPU Freq: - - - - - - - - - RAM size: 1924 MB, # CPU hardware threads: 6 RAM usage: 1323 MB, # Benchmark threads: 6 Compressing | Decompressing Dict Speed Usage R/U Rating | Speed Usage R/U Rating KiB/s % MIPS MIPS | KiB/s % MIPS MIPS 22: 6511 550 1151 6335 | 102629 519 1687 8752 23: 6050 513 1202 6165 | 100584 519 1677 8703 24: 5864 505 1248 6306 | 98898 522 1663 8680 25: 6128 544 1286 6997 | 96949 519 1662 8628 ---------------------------------- | ------------------------------ Avr: 528 1222 6451 | 520 1672 8691 Tot: 524 1447 7571 ubuntu@nanopi-m4:~$ sudo ifconfig -a wlan0 wlan0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet 192.168.254.49 netmask 255.255.0.0 broadcast 192.168.255.255 inet6 fe80::ce4b:73ff:fe23:d432 prefixlen 64 scopeid 0x20<link> ether cc:4b:73:23:d4:32 txqueuelen 1000 (Ethernet) RX packets 11530 bytes 15347454 (15.3 MB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 5520 bytes 647408 (647.4 KB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 ubuntu@nanopi-m4:~$ iw wlan0 info Interface wlan0 ifindex 3 wdev 0x1 addr cc:4b:73:23:d4:32 ssid FIB-8784-5G type managed wiphy 0 channel 149 (5745 MHz), width: 80 MHz, center1: 5775 MHz txpower 31.00 dBm ubuntu@nanopi-m4:~$ sudo iw dev wlan0 scan | egrep "signal:|SSID:" | sed -e "s/\tsignal: //" -e "s/\tSSID: //" | awk '{ORS = (NR % 2 == 0)? "\n" : " "; print}' | sort -43.00 dBm FIB-8784-5G -44.00 dBm FIB-8784 -51.00 dBm FIB-8784 -59.00 dBm foxy ubuntu@nanopi-m4:~$ hcitool dev Devices: hci0 CC:4B:73:23:D4:33 ubuntu@nanopi-m4:~$ ubuntu@nanopi-m4:~$ cat /proc/asound/cards 0 [realtekrt5651co]: realtek_rt5651- - realtek,rt5651-codec realtek,rt5651-codec 1 [ROCKCHIPSPDIF ]: ROCKCHIP_SPDIF - ROCKCHIP,SPDIF ROCKCHIP,SPDIF 2 [hdmisound ]: hdmi-sound - hdmi-sound hdmi-sound
Benchmarks with u-boot mainline and the board with nice cooler, a heatsink and ceramic, just for fun.
buntu@nanopi-m4:~$ 7z b
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE)
LE
CPU Freq: - - - - - - - - -
RAM size: 1924 MB, # CPU hardware threads: 6
RAM usage: 1323 MB, # Benchmark threads: 6
Compressing | Decompressing
Dict Speed Usage R/U Rating | Speed Usage R/U Rating
KiB/s % MIPS MIPS | KiB/s % MIPS MIPS
22: 6338 530 1164 6166 | 102348 519 1682 8728
23: 5901 501 1200 6013 | 100372 518 1677 8685
24: 6377 565 1214 6857 | 98519 518 1668 8647
25: 6299 560 1285 7193 | 97049 518 1666 8637
---------------------------------- | ------------------------------
Avr: 539 1216 6557 | 518 1673 8674
Tot: 529 1445 7616
ubuntu@nanopi-m4:~$ openssl speed sha256 aes-128-cbc aes-256-cbc rsa2048
Doing sha256 for 3s on 16 size blocks: 19452925 sha256's in 3.00s
Doing sha256 for 3s on 64 size blocks: 13864911 sha256's in 3.00s
Doing sha256 for 3s on 256 size blocks: 7367936 sha256's in 2.99s
Doing sha256 for 3s on 1024 size blocks: 2553850 sha256's in 3.00s
Doing sha256 for 3s on 8192 size blocks: 359438 sha256's in 3.00s
Doing sha256 for 3s on 16384 size blocks: 180700 sha256's in 2.99s
Doing aes-128 cbc for 3s on 16 size blocks: 14735693 aes-128 cbc's in 3.00s
Doing aes-128 cbc for 3s on 64 size blocks: 4431648 aes-128 cbc's in 3.00s
Doing aes-128 cbc for 3s on 256 size blocks: 1164991 aes-128 cbc's in 3.00s
Doing aes-128 cbc for 3s on 1024 size blocks: 296218 aes-128 cbc's in 2.99s
Doing aes-128 cbc for 3s on 8192 size blocks: 37173 aes-128 cbc's in 3.00s
Doing aes-128 cbc for 3s on 16384 size blocks: 18591 aes-128 cbc's in 3.00s
Doing aes-256 cbc for 3s on 16 size blocks: 11725626 aes-256 cbc's in 2.99s
Doing aes-256 cbc for 3s on 64 size blocks: 3385548 aes-256 cbc's in 3.00s
Doing aes-256 cbc for 3s on 256 size blocks: 879341 aes-256 cbc's in 3.00s
Doing aes-256 cbc for 3s on 1024 size blocks: 222662 aes-256 cbc's in 3.00s
Doing aes-256 cbc for 3s on 8192 size blocks: 27923 aes-256 cbc's in 2.99s
Doing aes-256 cbc for 3s on 16384 size blocks: 13956 aes-256 cbc's in 3.00s
Doing 2048 bits private rsa's for 10s: 2222 2048 bits private RSA's in 9.98s
Doing 2048 bits public rsa's for 10s: 83572 2048 bits public RSA's in 9.99s
OpenSSL 1.1.1c 28 May 2019
built on: Wed May 27 19:04:47 2020 UTC
options:bn(64,64) rc4(char) des(int) aes(partial) blowfish(ptr)
compiler: gcc -fPIC -pthread -Wa,--noexecstack -Wall -Wa,--noexecstack -g -O2 -fdebug-prefix-map=/build/openssl-KZTQCo/openssl-1.1.1c=. -fstack-protector-strong -Wformat -Werror=format-security -DOPENSSL_USE_NODELETE -DOPENSSL_PIC -DOPENSSL_CPUID_OBJ -DOPENSSL_BN_ASM_MONT -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DKECCAK1600_ASM -DVPAES_ASM -DECP_NISTZ256_ASM -DPOLY1305_ASM -DNDEBUG -Wdate-time -D_FORTIFY_SOURCE=2
The 'numbers' are in 1000s of bytes per second processed.
type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes 16384 bytes
aes-128 cbc 78590.36k 94541.82k 99412.57k 101447.23k 101507.07k 101531.65k
aes-256 cbc 62745.82k 72225.02k 75037.10k 76001.96k 76503.42k 76218.37k
sha256 103748.93k 295784.77k 630833.32k 871714.13k 981505.37k 990163.48k
sign verify sign/s verify/s
rsa 2048 bits 0.004491s 0.000120s 222.6 8365.6
Experiments with Kernel 4.19
- Boot log (kernel 4.19.111)
https://gist.github.com/avafinger/64085a755c717db2263aaa64c9aa91c2
| SBC Dev Board tested | NanoPi M4 |
|---|---|
| kernel version | 4.19.111 |
| gcc version | 7.5.0 |
| display | hdmi |
| graphical interface | CLI |
| idle Temp ºC / freq | 25 ºC / 408 Mhz |
| full Temp ºC / freq | 55 ºC / 1.4 GHz - 1.8 GHz |
| RAM memory usage (avg) | 71 Mbytes |
| i2c | yes |
| spi | |
| hdmi sound out | yes |
| rt5651 | yes |
| spdif | |
| Camera | |
| Wifi | yes (?) |
| BT | yes |
| ethernet | Gbps / 100Mbps |
| sound | hdmi-sound and Bluetooth |
| gpu | mali T860 |
| vpu | |
| DVFS | yes |
| ------------------------ | ------------------------------ |
Kodi GPU (hw accel)
| SBC Dev Board tested | NanoPi M4 |
|---|---|
| kernel version | 5.7.9 |
| gcc version | 9.2.1 |
| display | hdmi |
| graphical interface | CLI |
| idle Temp ºC / freq | 33 ºC / 408 Mhz |
| full Temp ºC / freq | 55 ºC / 1.20 GHz - 1.99 GHz |
| RAM memory usage (avg) | 101 Mbytes |
| i2c | yes |
| spi | |
| hdmi sound out | yes |
| rt5651 | yes |
| spdif | yes (need someone to test) |
| Camera | |
| Wifi | yes (new firmware) |
| BT | yes |
| ethernet | Gbps / 100Mbps |
| sound | hdmi-sound and Bluetooth |
| gpu | panfrost |
| vpu | yes (common formats) |
| DVFS | yes |
| ------------------------ | ------------------------------ |
(*) Problems / Issues
- Reboot
You can build Kodi for mainline with current kernel using the same instructions used in the kernel 4.4 but you get limited decoding capabilities. Support basic video codecs.
To build Kodi with your own kernel version you will need:
- Latest kernel with V4L2 / VPU patches and Panfrost enabled
- FFmpeg with patches from Kwiboo / jernejsk
- Build Mesa
This is the Image file for booting from SD CARD for NanoPi M4 v1 (2G), with pre-built Kernel 5.7.9. The Ubuntu EOAN 19.10 OS Image has the following working:
- DVFS
- panfrost
- eth0
- wlan0
- rt5651
- BT
- spdif (?)
- i2c
- hdmi
- hdmi-sound
- GBM / DRM
- GPU / VPU
This Image is not to be used with NanoPi M4 v2 and possibly with 4GB DRAM. Image file: https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.36
-
Kernel
Linux nanopi-m4 5.7.9 #1 SMP PREEMPT Sat Jul 18 18:14:35 -03 2020 aarch64 aarch64 aarch64 GNU/Linux -
Finding sound device
aplay -l **** List of PLAYBACK Hardware Devices **** card 0: realtekrt5651co [realtek,rt5651-codec], device 0: ff890000.i2s-rt5651-aif1 rt5651-aif1-0 [ff890000.i2s-rt5651-aif1 rt5651-aif1-0] Subdevices: 1/1 Subdevice #0: subdevice #0 card 1: ROCKCHIPSPDIF [ROCKCHIP,SPDIF], device 0: ff870000.spdif-dit-hifi dit-hifi-0 [ff870000.spdif-dit-hifi dit-hifi-0] Subdevices: 1/1 Subdevice #0: subdevice #0 card 2: hdmisound [hdmi-sound], device 0: ff8a0000.i2s-i2s-hifi i2s-hifi-0 [ff8a0000.i2s-i2s-hifi i2s-hifi-0] Subdevices: 1/1 Subdevice #0: subdevice #0 -
Play sound (HDMI output)
aplay -D sysdefault:CARD=2 /usr/share/sounds/alsa/Front_Right.wavor
AUDIODEV=hw:2,0 play ff-16b-2c-44100hz.mp3 play WARN alsa: can't encode 0-bit Unknown or not applicable ff-16b-2c-44100hz.mp3: File Size: 2.99M Bit Rate: 128k Encoding: MPEG audio Info: 2016-04-12 Channels: 2 @ 16-bit Samplerate: 44100Hz Replaygain: off Duration: 00:03:07.12 In:25.2% 00:00:47.18 [00:02:19.93] Out:2.08M [-=====|=====-] Hd:1.0 Clip:0 -
Play sound rt5651 (Jack)
AUDIODEV=hw:0,0 play ff-16b-2c-44100hz.mp3 play WARN alsa: can't encode 0-bit Unknown or not applicable ff-16b-2c-44100hz.mp3: File Size: 2.99M Bit Rate: 128k Encoding: MPEG audio Info: 2016-04-12 Channels: 2 @ 16-bit Samplerate: 44100Hz Replaygain: off Duration: 00:03:07.12 In:100% 00:03:07.12 [00:00:00.00] Out:8.25M [ | ] Clip:14 play WARN sox: `alsa' output clipped 14 samples; decrease volume? Done. -
Bluetooth
hcitool dev Devices: hci0 CC:4B:73:23:D4:33 -
Ethernet and Wlan interfaces
ifconfig eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet 192.168.254.42 netmask 255.255.0.0 broadcast 192.168.255.255 inet6 2804:7f4:3582:cf22:3835:48ff:fe87:d8e2 prefixlen 64 scopeid 0x0<global> inet6 fe80::3835:48ff:fe87:d8e2 prefixlen 64 scopeid 0x20<link> inet6 2804:7f4:3582:cf22:b4a6:8573:441a:ec4a prefixlen 64 scopeid 0x0<global> ether 3a:35:48:87:d8:e2 txqueuelen 1000 (Ethernet) RX packets 8478 bytes 674293 (674.2 KB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 6468 bytes 1331171 (1.3 MB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 device interrupt 27 lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536 inet 127.0.0.1 netmask 255.0.0.0 inet6 ::1 prefixlen 128 scopeid 0x10<host> loop txqueuelen 1000 (Local Loopback) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 wlan0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet 192.168.254.102 netmask 255.255.0.0 broadcast 192.168.255.255 inet6 2804:7f4:3582:cf22:b5fe:bcdb:1728:273a prefixlen 64 scopeid 0x0<global> inet6 fe80::ce4b:73ff:fe23:d432 prefixlen 64 scopeid 0x20<link> inet6 2804:7f4:3582:cf22:ce4b:73ff:fe23:d432 prefixlen 64 scopeid 0x0<global> ether cc:4b:73:23:d4:32 txqueuelen 1000 (Ethernet) RX packets 1810 bytes 185266 (185.2 KB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 663 bytes 88989 (88.9 KB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 -
testing VPU (decoding and displaying video on fb)
ffmpeg -hwaccel drm -i Jellyfish_1080_10s_30MB.mp4 -pix_fmt bgra -f fbdev /dev/fb0 ffmpeg version 4.2.2-Matrix-Alpha1-26-g6029b361f2-Kodi Copyright (c) 2000-2019 the FFmpeg developers built with gcc 9 (Ubuntu 9.2.1-9ubuntu2) configuration: --prefix=/usr --enable-nonfree --enable-gpl --enable-version3 --enable-libmp3lame --enable-libpulse --enable-libv4l2 --enable-v4l2-request --enable-v4l2-m2m --enable-libudev --enable-libdrm --enable-shared libavutil 56. 31.100 / 56. 31.100 libavcodec 58. 54.100 / 58. 54.100 libavformat 58. 29.100 / 58. 29.100 libavdevice 58. 8.100 / 58. 8.100 libavfilter 7. 57.100 / 7. 57.100 libswscale 5. 5.100 / 5. 5.100 libswresample 3. 5.100 / 3. 5.100 libpostproc 55. 5.100 / 55. 5.100 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'Jellyfish_1080_10s_30MB.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2avc1mp41 encoder : Lavf57.63.100 Duration: 00:00:10.00, start: 0.000000, bitrate: 25030 kb/s Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], 25026 kb/s, 30 fps, 30 tbr, 15360 tbn, 60 tbc (default) Metadata: handler_name : VideoHandler Stream mapping: Stream #0:0 -> #0:0 (h264 (native) -> rawvideo (native)) Press [q] to stop, [?] for help [h264 @ 0xaaaad4f4f320] v4l2_request_try_format: pixelformat 875967059 not supported for type 10 [h264 @ 0xaaaad4f4f320] v4l2_request_probe_video_device: try output format failed Output #0, fbdev, to '/dev/fb0': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2avc1mp41 encoder : Lavf58.29.100 Stream #0:0(und): Video: rawvideo (BGRA / 0x41524742), bgra, 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 1990656 kb/s, 30 fps, 30 tbn, 30 tbc (default) Metadata: handler_name : VideoHandler encoder : Lavc58.54.100 rawvideo frame= 300 fps= 56 q=-0.0 Lsize=N/A time=00:00:10.00 bitrate=N/A speed=1.88x video:2430000kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
Bootlog: https://gist.github.com/avafinger/54a1d590308215a37e437d1a93033c15
Support for:
- DVFS
- GPU / VPU
- Wifi
- Eth
- BT
- hdmi
- hdmi-sound
- rt5651 (jack)
- spdif (?)
Basic Benchmark
-
7z b
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21 p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE) LE CPU Freq: - - - - - - 512000000 - - RAM size: 1924 MB, # CPU hardware threads: 6 RAM usage: 1323 MB, # Benchmark threads: 6 Compressing | Decompressing Dict Speed Usage R/U Rating | Speed Usage R/U Rating KiB/s % MIPS MIPS | KiB/s % MIPS MIPS 22: 5692 502 1102 5538 | 98576 504 1668 8407 23: 4857 431 1147 4949 | 96575 504 1658 8357 24: 4589 431 1144 4935 | 94597 503 1650 8303 25: 5601 527 1213 6396 | 93156 505 1643 8290 ---------------------------------- | ------------------------------ Avr: 473 1152 5454 | 504 1654 8339 Tot: 489 1403 6897 -
openssl speed sha256 aes-128-cbc rsa2048
Doing sha256 for 3s on 16 size blocks: 9658979 sha256's in 2.99s Doing sha256 for 3s on 64 size blocks: 7291386 sha256's in 3.00s Doing sha256 for 3s on 256 size blocks: 4299091 sha256's in 2.99s Doing sha256 for 3s on 1024 size blocks: 1621935 sha256's in 3.00s Doing sha256 for 3s on 8192 size blocks: 238842 sha256's in 2.99s Doing sha256 for 3s on 16384 size blocks: 120378 sha256's in 2.99s Doing aes-128 cbc for 3s on 16 size blocks: 10267243 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 64 size blocks: 2790474 aes-128 cbc's in 2.99s Doing aes-128 cbc for 3s on 256 size blocks: 718036 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 1024 size blocks: 180829 aes-128 cbc's in 2.99s Doing aes-128 cbc for 3s on 8192 size blocks: 22646 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 16384 size blocks: 11302 aes-128 cbc's in 2.99s Doing 2048 bits private rsa's for 10s: 1400 2048 bits private RSA's in 9.98s Doing 2048 bits public rsa's for 10s: 52169 2048 bits public RSA's in 9.98s OpenSSL 1.1.1c 28 May 2019 built on: Wed May 27 19:04:47 2020 UTC options:bn(64,64) rc4(char) des(int) aes(partial) blowfish(ptr) compiler: gcc -fPIC -pthread -Wa,--noexecstack -Wall -Wa,--noexecstack -g -O2 -fdebug-prefix-map=/build/openssl-KZTQCo/openssl-1.1.1c=. -fstack-protector-strong -Wformat -Werror=format-security -DOPENSSL_USE_NODELETE -DOPENSSL_PIC -DOPENSSL_CPUID_OBJ -DOPENSSL_BN_ASM_MONT -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DKECCAK1600_ASM -DVPAES_ASM -DECP_NISTZ256_ASM -DPOLY1305_ASM -DNDEBUG -Wdate-time -D_FORTIFY_SOURCE=2 The 'numbers' are in 1000s of bytes per second processed. type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes 16384 bytes aes-128 cbc 54758.63k 59729.21k 61272.41k 61929.40k 61838.68k 61930.42k sha256 51686.84k 155549.57k 368082.71k 553620.48k 654379.15k 659623.13k sign verify sign/s verify/s rsa 2048 bits 0.007129s 0.000191s 140.3 5227.4
- linux-image 5.7.0
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.35
There is support for rt5651 but the trick to make it work is described on Armbian forum. Alsamixer must set the following:
amixer set 'HPO L' on
amixer set 'HPO R' on
amixer set 'HPOVOL L' on
amixer set 'HPOVOL R' on
amixer set 'HPO MIX HPVOL' on
amixer set 'OUT MIXL DAC L1' on
amixer set 'OUT MIXR DAC R1' on
amixer set 'Stereo DAC MIXL DAC L1' on
amixer set 'Stereo DAC MIXR DAC R1' on
-
Check sound devices
ubuntu@nanopi-m4:~$ aplay -l **** List of PLAYBACK Hardware Devices **** card 0: realtekrt5651co [realtek,rt5651-codec], device 0: ff890000.i2s-rt5651-aif1 rt5651-aif1-0 [ff890000.i2s-rt5651-aif1 rt5651-aif1-0] Subdevices: 1/1 Subdevice #0: subdevice #0 card 1: ROCKCHIPSPDIF [ROCKCHIP,SPDIF], device 0: ff870000.spdif-dit-hifi dit-hifi-0 [ff870000.spdif-dit-hifi dit-hifi-0] Subdevices: 1/1 Subdevice #0: subdevice #0 card 2: hdmisound [hdmi-sound], device 0: ff8a0000.i2s-i2s-hifi i2s-hifi-0 [ff8a0000.i2s-i2s-hifi i2s-hifi-0] Subdevices: 1/1 Subdevice #0: subdevice #0
Playing sound on every device:
rt5651
aplay -D sysdefault:CARD=0 /usr/share/sounds/alsa/Front_Right.wav
SPDIF
aplay -D sysdefault:CARD=1 /usr/share/sounds/alsa/Front_Right.wav
hdmi-sound
aplay -D sysdefault:CARD=2 /usr/share/sounds/alsa/Front_Right.wav
There is support for GPU (panfrost) and VPU (hantro and rkvdec). Most H264 (1920x1080) works smooth. You can also build Kodi.
If you output decoded video to a framebuffer:
ffmpeg -hwaccel drm -i Big_Buck_Bunny_1080_10s_30MB.mp4 -pix_fmt bgra -f fbdev /dev/fb0
There is a small penalty to be paid for converting the drm_prime format to bgra that increases CPU usage, while output to a drm_prime surface like Kodi does not.
FFmpeg used to test hw decoding: ffmpeg version 4.2.2-Matrix-Alpha1-26-g6029b361f2-Kodi
You can learn more reading Mainline VPU on Armbian forum
Wifi and BT works fine with the latest brcm firmware provided on previous image. 2.4 GHz and 5 GHz has been working without any glitch, read the previous info.
- linux-image 5.7.0-rc4 plus brcm firmware update
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.34
Panfrost works on linux-image 5.4.0-rc8. It has been tested with latest Mesa 3D and kmscube.
Mesa 3D: https://gitlab.freedesktop.org/mesa/mesa Kmscube: https://gitlab.freedesktop.org/mesa/kmscube
Panfrost Output:
ubuntu@nanopi-m4:~/kmscube$ sudo ./kmscube
[sudo] password for ubuntu:
Using display 0xaaaad69887e0 with EGL version 1.4
===================================
EGL information:
version: "1.4"
vendor: "Mesa Project"
client extensions: "EGL_EXT_client_extensions EGL_EXT_device_base EGL_EXT_device_enumeration EGL_EXT_device_query EGL_EXT_platform_base EGL_KHR_client_get_all_proc_addresses EGL_KHR_debug EGL_EXT_platform_wayland EGL_EXT_platform_x11 EGL_MESA_platform_gbm EGL_MESA_platform_surfaceless EGL_EXT_platform_device"
display extensions: "EGL_ANDROID_blob_cache EGL_EXT_buffer_age EGL_EXT_image_dma_buf_import EGL_KHR_cl_event2 EGL_KHR_config_attribs EGL_KHR_create_context EGL_KHR_create_context_no_error EGL_KHR_fence_sync EGL_KHR_get_all_proc_addresses EGL_KHR_gl_colorspace EGL_KHR_gl_renderbuffer_image EGL_KHR_gl_texture_2D_image EGL_KHR_gl_texture_3D_image EGL_KHR_gl_texture_cubemap_image EGL_KHR_image EGL_KHR_image_base EGL_KHR_image_pixmap EGL_KHR_no_config_context EGL_KHR_partial_update EGL_KHR_reusable_sync EGL_KHR_surfaceless_context EGL_EXT_pixel_format_float EGL_KHR_wait_sync EGL_MESA_configless_context EGL_MESA_drm_image EGL_MESA_image_dma_buf_export EGL_MESA_query_driver EGL_WL_bind_wayland_display "
===================================
OpenGL ES 2.x information:
version: "OpenGL ES 2.0 Mesa 20.0.0-devel (git-02d63ee5a4)"
shading language version: "OpenGL ES GLSL ES 1.0.16"
vendor: "panfrost"
renderer: "panfrost"
extensions: "GL_EXT_blend_minmax GL_EXT_multi_draw_arrays GL_EXT_texture_format_BGRA8888 GL_OES_compressed_ETC1_RGB8_texture GL_OES_depth24 GL_OES_element_index_uint GL_OES_fbo_render_mipmap GL_OES_mapbuffer GL_OES_rgb8_rgba8 GL_OES_stencil8 GL_OES_texture_3D GL_OES_texture_float GL_OES_texture_float_linear GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_npot GL_OES_vertex_half_float GL_OES_EGL_image GL_OES_depth_texture GL_OES_packed_depth_stencil GL_EXT_texture_type_2_10_10_10_REV GL_OES_get_program_binary GL_APPLE_texture_max_level GL_EXT_discard_framebuffer GL_EXT_read_format_bgra GL_EXT_frag_depth GL_NV_fbo_color_attachments GL_OES_EGL_image_external GL_OES_EGL_sync GL_OES_vertex_array_object GL_EXT_occlusion_query_boolean GL_EXT_texture_rg GL_EXT_unpack_subimage GL_NV_draw_buffers GL_NV_read_buffer GL_NV_read_depth GL_NV_read_depth_stencil GL_NV_read_stencil GL_EXT_draw_buffers GL_EXT_map_buffer_range GL_KHR_debug GL_KHR_texture_compression_astc_ldr GL_OES_required_internalformat GL_OES_surfaceless_context GL_EXT_separate_shader_objects GL_EXT_compressed_ETC1_RGB8_sub_texture GL_EXT_draw_elements_base_vertex GL_EXT_texture_border_clamp GL_KHR_context_flush_control GL_OES_draw_elements_base_vertex GL_OES_texture_border_clamp GL_KHR_no_error GL_KHR_texture_compression_astc_sliced_3d GL_KHR_parallel_shader_compile "
===================================
Using modifier ffffffffffffff
Modifiers failed!
Using modifier ffffffffffffff
Modifiers failed!
-
Update Kernel and packages
-
Install dependencies (libdrm, libgbm, wayland protocols, x11 protocols)
-
Install meson build
https://mesonbuild.com/Quick-guide.html -
Build and install
I have built Kodi with same parameters as for the Mali way, but for some reason it crashed when launched. It is known to be possible to run Kodi with Panfrost since Kernel 5.2, but something is missing on my Kodi build. No luck yet.
-
Kernel 5.4.0-rc8 Boot log with hdmi-sound
https://gist.github.com/avafinger/c0651125c1209b4c8a7920a1595ed239 -
Kernel 5.4.0-rc7 Boot log
https://gist.github.com/avafinger/99108b3255596080490f3b4d0030230d -
linux-image 5.4.0-rc8 Deb package
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.30 -
linux-image 5.4.0 Deb package
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.31 -
linux-image 5.4.1 Deb package
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.32Wifi enabled generates cpu load and heat, not recommended. https://gist.github.com/avafinger/bc9b1a8b0ea4fb482afee088b7c711d1
To activate Wlan0 you need to recompile kernel 5.4.1 with BRCM module enabled and edit /etc/networks/interface and enable wlan
-
linux-image 5.4.8 Deb package
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.33
-
Image file (8GB SD card) is available here:
https://mega.nz/#!YLZhlYJb!uqvCIjpeBoGyfhaNYPJwb67kma7wmGTn5ZObe-CPrb4 (use 7z / zip to unzip and flash into SD card with Win32DiskImager or etcher) -
Flash SD CARD from Linux Box:
You need wget and curl installed to grab the files in a Linux distro.
Get the latest files by running (or seee below to fetch specific Release version files):
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases/latest | grep -oP '"browser_download_url": "\K(.*)(?=")')
then
sudo ./flash_sd.sh /dev/sdX (or /dev/mmcblkY) where X is a letter from b,c.. and Y is a number from 0,1..)
WARNING Find the correct device letter for your USB SD CARD or you may wipe your hdd.
These are the raw files for building the OS Image with kernel 4.4.166-rockchip
-
minor fixes and optimizations (4K, journaling , heart-beat)
-
DHCP enabled (default)
-
We're ready to roll
user: ubuntu password: ubuntu
Get v1.1 files:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.1)
Boot takes about 10 seconds or less depending on SD card in use. Tip: If you can't see anything on screen, type enter twice!
On first login:
sudo apt-get update
sudo apt-get dist-upgrade
Tip: You may need to update the file resolver.conf to reflect you network (DNS)
type in the shell: df -lh
Filesystem Size Used Avail Use% Mounted on
/dev/mmcblk0p2 7.3G 582M 6.4G 9% /
devtmpfs 963M 0 963M 0% /dev
tmpfs 964M 0 964M 0% /dev/shm
tmpfs 964M 17M 947M 2% /run
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 964M 0 964M 0% /sys/fs/cgroup
/dev/mmcblk0p1 113M 21M 84M 20% /boot
tmpfs 193M 0 193M 0% /run/user/1000
type in the shell: free -m
total used free shared buff/cache available
Mem: 1926 47 1798 24 80 1793
Swap: 0 0 0
Now we can start installing and/or configuring things:
- ssh
- wifi
- 3D mali user space for OpenGLES 3.1 / OpenCL 1.2 ( fbdev and X11 )
- bluetooth
- VPU ( encode / decoding )
- camera ( when ready !?! )
Instructions and DEB packages coming soon
Install ssh to be able to login remotely:
sudo apt-get install ssh
from your PC:
ssh ubuntu@IP
where IP is the board IP assigned by DHCP
To be able to use OpenGL ES 2 / 3 we need to install the Mali user space lib.
-
Download files:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.2) -
Install the necessary packages:
sudo apt-get install libjpeg-turbo8 libjpeg8 libpng16-16 libegl1 libegl-mesa0 libpng-dev libjpeg-dev sudo apt-get install libgles2-mesa-dev ocl-icd-opencl-dev -
Install Mali
sudo dpkg -i --force-all mali-t86x-rk3399-linux-4.4.y_1.0-1.debIgnore the warnings.
-
Install enhanced htop:
You can monitor the health of you RK3399 (CPU Temp, CPU Freq and CPU VCore, enter F2 and add these monitors)
sudo dpkg -i htop_2.1.1-3_arm64.deb -
Install tools for benchmarking mali on fbdev:
sudo dpkg -i glmark2-data_2014.03+git20150611.fa71af2d-0ubuntu5_all.deb sudo dpkg -i glmark2-es2-fbdev_2014.03+git20150611.fa71af2d-0ubuntu5_arm64.debIf everything is Okay, then you can test it:
sudo glmark2-es2-fbdev (test it remotely)
Install packages:
sudo apt-get install crda wpasupplicant
Enable wifi editing the file /etc/network/interfaces and adding:
allow-hotplug wlan0
iface wlan0 inet dhcp
wpa-ssid SID
#psk="00012345678901234567890"
wpa-psk afde07531d767050796db24c3d449e26a449c15b98bfaf20148970ec43242078
dns-nameservers 8.8.8.8 8.8.4.4
wireless-power off
Where SID os you AP name and xxxxxxxxx is your encrypted password. Generate encrypted password like so:
wpa_passphrase SSID xxxxxxxxx
and finally boot and connect to Wifi
We have now fbdev working and with OpenGLES 3.2 (fbdev) we can go further and install GBM (Graphic Buffer Management) libraries to be able to use DRM for a non-Desktop environment (no X11/Wayland). VPU has support for DRM/GBM and not for fbdev yet.
There is a DEB package ready to install VPU support. Mali user space for GBM is needed in order to be able to use GL and/or GLES 2/3. The nice thing here is that we can have Kodi Media Center to run on NanoPi M4 / NEO / T4 or any other RK3399 if you wish.
Install the gbm libraries and VPU deb package so we can have Hardware Decoding and HW accelerated display with Mali T86x.
sudo apt-get install libgbm-dev
Test if GBM is fully working with gbm_es2_demo (170 Kb) or kmscube (1.4 Mb) Get file with in https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.7
./gbm_es2_demo
using card: '/dev/dri/card0': Success
Using display 0x557241ccf0 with EGL version 1.4
EGL Version "1.4 Midgard-"r14p0-01rel0""
EGL Vendor "ARM"
EGL Extensions "EGL_KHR_partial_update EGL_KHR_image_pixmap EGL_EXT_image_dma_buf_import EGL_KHR_config_attribs EGL_KHR_image EGL_KHR_image_base EGL_KHR_fence_sync EGL_KHR_wait_sync EGL_KHR_gl_colorspace EGL_KHR_get_all_proc_addresses EGL_IMG_context_priority EGL_ARM_pixmap_multisample_discard EGL_KHR_gl_texture_2D_image EGL_KHR_gl_renderbuffer_image EGL_KHR_create_context EGL_KHR_surfaceless_context EGL_KHR_gl_texture_cubemap_image EGL_EXT_create_context_robustness EGL_KHR_cl_event2"
FPS: 0.002751
FPS: 59.027754
FPS: 59.989142
FPS: 60.001338
FPS: 60.008244
FPS: 60.007122
FPS: 59.988592
FPS: 60.013970
FPS: 59.988422
FPS: 60.008008
FPS: 60.001338
FPS: 60.000630
FPS: 59.995440
FPS: 60.001102
FPS: 60.006768
FPS: 59.995967
FPS: 60.001397
FPS: 60.007831
or kmscube
./kmscube
Using display 0x55b89fca00 with EGL version 1.4
===================================
EGL information:
version: "1.4 Midgard-"r14p0-01rel0""
vendor: "ARM"
client extensions: "EGL_EXT_client_extensions EGL_EXT_platform_base EGL_KHR_client_get_all_proc_addresses EGL_KHR_platform_gbm EGL_MESA_platform_gbm"
display extensions: "EGL_KHR_partial_update EGL_KHR_image_pixmap EGL_EXT_image_dma_buf_import EGL_KHR_config_attribs EGL_KHR_image EGL_KHR_image_base EGL_KHR_fence_sync EGL_KHR_wait_sync EGL_KHR_gl_colorspace EGL_KHR_get_all_proc_addresses EGL_IMG_context_priority EGL_ARM_pixmap_multisample_discard EGL_KHR_gl_texture_2D_image EGL_KHR_gl_renderbuffer_image EGL_KHR_create_context EGL_KHR_surfaceless_context EGL_KHR_gl_texture_cubemap_image EGL_EXT_create_context_robustness EGL_KHR_cl_event2"
===================================
OpenGL ES 2.x information:
version: "OpenGL ES 3.2 v1.r14p0-01rel0-git(966ed26).2e3fa7564ebca70897f04bd9fb7bc67e"
shading language version: "OpenGL ES GLSL ES 3.20"
vendor: "ARM"
renderer: "Mali-T860"
extensions: "GL_ARM_rgba8 GL_ARM_mali_shader_binary GL_OES_depth24 GL_OES_depth_texture GL_OES_depth_texture_cube_map GL_OES_packed_depth_stencil GL_OES_rgb8_rgba8 GL_EXT_read_format_bgra GL_OES_compressed_paletted_texture GL_OES_compressed_ETC1_RGB8_texture GL_OES_standard_derivatives GL_OES_EGL_image GL_OES_EGL_image_external GL_OES_EGL_image_external_essl3 GL_OES_EGL_sync GL_OES_texture_npot GL_OES_vertex_half_float GL_OES_required_internalformat GL_OES_vertex_array_object GL_OES_mapbuffer GL_EXT_texture_format_BGRA8888 GL_EXT_texture_rg GL_EXT_texture_type_2_10_10_10_REV GL_OES_fbo_render_mipmap GL_OES_element_index_uint GL_EXT_shadow_samplers GL_OES_texture_compression_astc GL_KHR_texture_compression_astc_ldr GL_KHR_texture_compression_astc_hdr GL_KHR_texture_compression_astc_sliced_3d GL_KHR_debug GL_EXT_occlusion_query_boolean GL_EXT_disjoint_timer_query GL_EXT_blend_minmax GL_EXT_discard_framebuffer GL_OES_get_program_binary GL_OES_texture_3D GL_EXT_texture_storage GL_EXT_multisampled_render_to_texture GL_OES_surfaceless_context GL_OES_texture_stencil8 GL_EXT_shader_pixel_local_storage GL_ARM_shader_framebuffer_fetch GL_ARM_shader_framebuffer_fetch_depth_stencil GL_ARM_mali_program_binary GL_EXT_sRGB GL_EXT_sRGB_write_control GL_EXT_texture_sRGB_decode GL_KHR_blend_equation_advanced GL_KHR_blend_equation_advanced_coherent GL_OES_texture_storage_multisample_2d_array GL_OES_shader_image_atomic GL_EXT_robustness GL_EXT_draw_buffers_indexed GL_OES_draw_buffers_indexed GL_EXT_texture_border_clamp GL_OES_texture_border_clamp GL_EXT_texture_cube_map_array GL_OES_texture_cube_map_array GL_OES_sample_variables GL_OES_sample_shading GL_OES_shader_multisample_interpolation GL_EXT_shader_io_blocks GL_OES_shader_io_blocks GL_EXT_tessellation_shader GL_OES_tessellation_shader GL_EXT_primitive_bounding_box GL_OES_primitive_bounding_box GL_EXT_geometry_shader GL_OES_geometry_shader GL_ANDROID_extension_pack_es31a GL_EXT_gpu_shader5 GL_OES_gpu_shader5 GL_EXT_texture_buffer GL_OES_texture_buffer GL_EXT_copy_image GL_OES_copy_image GL_EXT_color_buffer_half_float GL_EXT_color_buffer_float GL_EXT_YUV_target GL_OVR_multiview GL_OVR_multiview2 GL_OVR_multiview_multisampled_render_to_texture GL_KHR_robustness GL_KHR_robust_buffer_access_behavior GL_EXT_draw_elements_base_vertex GL_OES_draw_elements_base_vertex "
===================================
If the installation is Okay, you will see a spinning 3D cube.
Kodi has support for GBM (DRM) and can run on our NanoPi M4 setup. Kodi 18-RC5 has been compiled succesfully. Building instructions are provided here: https://github.com/xbmc/xbmc/blob/master/docs/README.Linux.md#4-build-kodi
Tips to build Kodi v18.0 RC5 on RK3399:
- Install gcc8 and cpp8
- Install GBM and libdrm on top of fbdev (mali-gbm user space)
- Install VPU support (rkmpp)
- Build ffmpeg-rockchip and add the codecs missing
- Install ffmpeg (rkmpp)
- Build Kodi
If you installed Kodi v18.0 B5 remove it and install Kodi v18.0 rc5 for RK3399
sudo apt-get remove --purge kodi-18b5-rk3399-gbm
then install Kodi 18.0 RC5
sudo dpkg -i kodi-18rc5-rk3399-gbm_1.0-2.deb
Splash screen Kodi 18rc5 on NanoPi M4 (RK3399)
Kodi 18rc5 on NanoPi M4
Kodi 18rc5 on NanoPi M4 with kernel 4.4.169-rk3399
Kodi 18rc5 screenshot 1
Kodi 18rc5 screenshot 2
Kodi 18rc5 screenshot 3
Kodi 18rc5 screenshot 4
Kodi 18rc5 screenshot 5
Splash screen Kodi 18b5
ScreenShot 1
ScreenShot 2
ScreenShot 3
ScreenShot 4
ScreenShot 5
ScreenShot 6
- Kernel 4.4.168
- Faster boot times (~7 secs)
- gcc (Ubuntu 8.2.0-1ubuntu2~18.04) 8.2.0
- All dependencies updated and installed for Kodi Multimedia Theather (18rc3) - RK3399
- eDP LCD was removed from the tree, for some reason, EDP-1 is the main output and HDMI-1 is the second monitor this can be trouble if you want to install a Graphics Desktop, you get a dual header even if eDP LCD is not attached.
- Rootfs ready to deploy Kodi Multimedia Center giving your NanoPi M4 / NEO4 a full-blown Media Center (hopefully ;)
Instructions:
-
Download files:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.3) -
Flash Image
sudo ./flash_kodi_sd.sh /dev/sdX (or /dev/mmcblkY) where X is a letter from b,c.. and Y is a number from 0,1..)
- Kernel 4.4.169 (linux-image && kernel headers)
- The best of BSP and mainline in one kernel
Instructions:
-
Download deb file:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.4) -
Install
sudo dpkg -i linux-image-4.4.169-rk3399_1.0-1.deb sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)
- Boot from eMMC
- Kernel 4.4.169 (linux-image && kernel headers)
- The best of BSP and mainline in one kernel
- KODI 18.0 RC5
Instructions:
-
boot from SD CARD and with eMMC attached
-
install parted:
sudo apt-get install parted -
create a temporary directory:
mkdir -p emmc cd emmc -
Download the files to flash eMMC:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.8)Make sure the download is complete, check with md5sum atfer download! (bad SD card or bad USB sdhc writer can corrupt the file contents):
0521a81ed44c7274c906ae3d98769bc4 boot_kodi_emmc.tar.gz e88855ba0775235475618309381c3759 rootfs_kodi.tar.gz -
Install (Burn OS Image to eMMC)
sudo ./flash_kodi_emmc.sh /dev/mmcblk1 sudo shutdown -h now (remone power and sd card)Boot without the sd card
- Kernel 4.4.170 (linux-image && kernel headers)
- The best of BSP and mainline in one kernel
Instructions:
-
Download deb file:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.9) -
Install
sudo dpkg -i linux-image-4.4.170-rk3399_1.0-2.deb sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)
- Kernel 4.4.171 (linux-image && kernel headers)
- Changelog here (if worth upgrade): https://cdn.kernel.org/pub/linux/kernel/v4.x/ChangeLog-4.4.171
- The best of BSP and mainline in one kernel
Instructions:
-
Download deb file:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.10) -
Install
sudo dpkg -i linux-image-4.4.171-rk3399_1.0-3.deb sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)
- Kernel 4.4.172 (linux-image && kernel headers)
- support for ov13850 + ov4689 included
- F2FS code has been touched only, minor fix, need a complete re-write so it is more BSP than Mainline (you have been warned)
Instructions:
-
Download deb file:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.11) -
Install
sudo dpkg -i linux-image-4.4.172-rk3399_1.0-4.deb sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)
- Kernel 4.4.173 (linux-image && kernel headers)
- modified rfkill-bt
- modified wifi
- mainline 4.4.173 patches
Instructions:
-
Download deb file:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.13) -
Install
You need at least 20 Mbytes free on /boot
sudo dpkg -i linux-image-4.4.173_1.0-5.deb
sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)
- Linux Image 4.4.174-rk3399 (linux-image && kernel headers)
- built with gcc 8.2
- mainline 4.4.174 patches (https://cdn.kernel.org/pub/linux/kernel/v4.x/ChangeLog-4.4.174)
Instructions:
-
Download deb file:
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.15
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.15) -
Install
You need at least 20 Mbytes free on /boot
sudo dpkg -i linux-image-4.4.174-rk3399_1.0-7.deb
sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)
- Linux Image 4.4.175-rk3399 (linux-image && kernel headers)
- built with gcc 7.3
- CPU freq back to 2 GHz (2.0 / 1.5 Ghz)
- mainline 4.4.175 patches (https://cdn.kernel.org/pub/linux/kernel/v4.x/ChangeLog-4.4.175)
Instructions:
-
Download deb file:
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.18
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.18) -
Install
You need at least 20 Mbytes free on /boot
sudo dpkg -i linux-image-4.4.175-rk3399_1.0-8.deb
sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)
- Linux Image 4.4.177-rk3399 (linux-image && kernel headers)
- built with gcc 7.3
- CPU freq back to 2 GHz (2.0 / 1.5 Ghz)
- DRM workaround to run latest Kodi
Instructions:
-
Download deb file:
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.19
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.19) -
Install
You need at least 20 Mbytes free on /boot
sudo dpkg -i linux-image-4.4.177-rk3399_1.0-9.deb
sudo shutdown -h now (or **sync && sudo reboot** if you are **brave**)
We are going to set up the BT in an old fashioned way to bypass some limitations and later install a systemd service to boot with BT enabled. Kernel has been patched to hopefully fix the "timeout" issue with Bluez but still have some issues with hctool. For this we will use brcm_patchram_plus to load the firmware and turn ON the BT and have a stable BT experience.
-
Install BT service
sudo dpkg -i bluetooth-rk3399_1.0-1.deb sudo sync && sudo rebootAfter a reboot you can check if BT is on with:
hcitool devi Devices: hci0 CC:4B:73:23:D4:33The service should be the last service to be run, if not you get the "timeout" issue and BT will be useless. A trick to make BT stable is as follow:
-
Disable the BT service
sudo systemctl disable brcm_patchram_plus.service -
Install our trick to rc.local service that is the last service that gets pulled from systemd
Copy and past each complete command line below:
sudo printf '%s\n' '#!/bin/bash' 'pulseaudio -D' 'brcm_patchram_plus -d --enable_hci --no2bytes --use_baudrate_for_download --tosleep 200000 --baudrate 1500000 --patchram /system/etc/firmware/bcm4356a2.hcd --enable_lpm /dev/ttyS0 > /tmp/bt.log 2>&1 &' 'exit 0' | sudo tee -a /etc/rc.local sudo chmod +x /etc/rc.local sync && sudo reboot
Check with :
hcitool devi Devices: hci0 CC:4B:73:23:D4:33 -
-
Pairing a Phone with our NanoPi M4
Install the packages if not already installed:
sudo apt-get install rfkill bluezRun pulseaudio required to pair with a phone (if not running!).
pulseaudio -DIf you have not installed pulse and alsa you need to to do it and check if it is working:
ubuntu@nanopi-m4:~$ ps -e |grep pulse 583 ? 00:00:00 pulseaudioCheck alsamixer and turn on everything:
alsamixer aplay -l **** List of PLAYBACK Hardware Devices **** card 0: realtekrt5651co [realtek,rt5651-codec], device 0: ff890000.i2s-rt5651-aif1 rt5651-aif1-0 [] Subdevices: 0/1 Subdevice #0: subdevice #0 card 1: rockchiphdmi [rockchip,hdmi], device 0: ff8a0000.i2s-i2s-hifi i2s-hifi-0 [] Subdevices: 0/1 Subdevice #0: subdevice #0 -
Pairing test
ubuntu@nanopi-m4:~$ sudo bluetoothctl [sudo] password for ubuntu: [NEW] Controller CC:4B:73:23:D4:33 nanopi-m4 [default] Agent registered [bluetooth]# list Controller CC:4B:73:23:D4:33 nanopi-m4 [default] [bluetooth]# power on Changing power on succeeded [bluetooth]# agent on Agent is already registered [bluetooth]# default-agent Default agent request successful [bluetooth]# scan on Discovery started [CHG] Controller CC:4B:73:23:D4:33 Discovering: yes [NEW] Device 00:17:CA:F7:38:18 Haier HW-W910 [bluetooth]# pair 00:17:CA:F7:38:18 Attempting to pair with 00:17:CA:F7:38:18 [CHG] Device 00:17:CA:F7:38:18 Connected: yes Request confirmation [Haie1m[agent] Confirm passkey 552791 (yes/no): Request canceled [agent] Confirm passkey 552791 (yes/no): Failed to pair: org.bluez.Error.AuthenticationFailed [CHG] Device 00:17:CA:F7:38:18 Connected: no [bluetooth]# pair 00:17:CA:F7:38:18 Attempting to pair with 00:17:CA:F7:38:18 [CHG] Device 00:17:CA:F7:38:18 Connected: yes Request confirmation [Haie1m[agent] Confirm passkey 053012 (yes/no): yes [CHG] Device 00:17:CA:F7:38:18 Modalias: usb:v000Ap0000d0000 [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001105-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000110a-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000110c-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001112-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001116-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000111f-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000112f-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001132-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001200-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001800-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001801-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 ServicesResolved: yes [CHG] Device 00:17:CA:F7:38:18 Paired: yes Pairing successful [CHG] Device 00:17:CA:F7:38:18 ServicesResolved: no [CHG] Device 00:17:CA:F7:38:18 Connected: no [bluetooth]# info Missing device address argument [bluetooth]# info 00:17:CA:F7:38:18 Device 00:17:CA:F7:38:18 (public) Name: Haier HW-W910 Alias: Haier HW-W910 Class: 0x005a020c Icon: phone Paired: yes Trusted: no Blocked: no Connected: no LegacyPairing: yes UUID: OBEX Object Push (00001105-0000-1000-8000-00805f9b34fb) UUID: Audio Source (0000110a-0000-1000-8000-00805f9b34fb) UUID: A/V Remote Control Target (0000110c-0000-1000-8000-00805f9b34fb) UUID: Headset AG (00001112-0000-1000-8000-00805f9b34fb) UUID: NAP (00001116-0000-1000-8000-00805f9b34fb) UUID: Handsfree Audio Gateway (0000111f-0000-1000-8000-00805f9b34fb) UUID: Phonebook Access Server (0000112f-0000-1000-8000-00805f9b34fb) UUID: Message Access Server (00001132-0000-1000-8000-00805f9b34fb) UUID: PnP Information (00001200-0000-1000-8000-00805f9b34fb) UUID: Generic Access Profile (00001800-0000-1000-8000-00805f9b34fb) UUID: Generic Attribute Profile (00001801-0000-1000-8000-00805f9b34fb) Modalias: usb:v000Ap0000d0000 RSSI: -82 [bluetooth]# connect 00:17:CA:F7:38:18 Attempting to connect to 00:17:CA:F7:38:18 [CHG] Device 00:17:CA:F7:38:18 Connected: yes Connection successful [CHG] Device 00:17:CA:F7:38:18 ServicesResolved: yes [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001105-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001108-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000110a-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000110c-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001112-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001116-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000111f-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 0000112f-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001132-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001200-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001800-0000-1000-8000-00805f9b34fb [CHG] Device 00:17:CA:F7:38:18 UUIDs: 00001801-0000-1000-8000-00805f9b34fb Authorize service [Haie1m[agent] Authorize service 00001108-0000-1000-8000-00805f9b34fb (yes/no): yes [Haier HW-W910]# trust 00:17:CA:F7:38:18 [CHG] Device 00:17:CA:F7:38:18 Trusted: yes Changing 00:17:CA:F7:38:18 trust succeeded [Haier HW-W910]# info 00:17:CA:F7:38:18 Device 00:17:CA:F7:38:18 (public) Name: Haier HW-W910 Alias: Haier HW-W910 Class: 0x005a020c Icon: phone Paired: yes Trusted: yes Blocked: no Connected: yes LegacyPairing: yes UUID: OBEX Object Push (00001105-0000-1000-8000-00805f9b34fb) UUID: Headset (00001108-0000-1000-8000-00805f9b34fb) UUID: Audio Source (0000110a-0000-1000-8000-00805f9b34fb) UUID: A/V Remote Control Target (0000110c-0000-1000-8000-00805f9b34fb) UUID: Headset AG (00001112-0000-1000-8000-00805f9b34fb) UUID: NAP (00001116-0000-1000-8000-00805f9b34fb) UUID: Handsfree Audio Gateway (0000111f-0000-1000-8000-00805f9b34fb) UUID: Phonebook Access Server (0000112f-0000-1000-8000-00805f9b34fb) UUID: Message Access Server (00001132-0000-1000-8000-00805f9b34fb) UUID: PnP Information (00001200-0000-1000-8000-00805f9b34fb) UUID: Generic Access Profile (00001800-0000-1000-8000-00805f9b34fb) UUID: Generic Attribute Profile (00001801-0000-1000-8000-00805f9b34fb) Modalias: usb:v000Ap0000d0000 RSSI: -82 [Haier HW-W910]# untrust 00:17:CA:F7:38:18 [CHG] Device 00:17:CA:F7:38:18 Trusted: no Changing 00:17:CA:F7:38:18 untrust succeeded [Haier HW-W910]# disconnect 00:17:CA:F7:38:18 Attempting to disconnect from 00:17:CA:F7:38:18 [CHG] Device 00:17:CA:F7:38:18 ServicesResolved: no Successful disconnected [CHG] Device 00:17:CA:F7:38:18 Connected: no [bluetooth]# remove 00:17:CA:F7:38:18 [DEL] Device 00:17:CA:F7:38:18 Haier HW-W910 Device has been removed [NEW] Device 00:17:CA:F7:38:18 Haier HW-W910 [bluetooth]# scan off Discovery stopped [CHG] Controller CC:4B:73:23:D4:33 Discovering: no [CHG] Device 00:17:CA:F7:38:18 RSSI is nil [bluetooth]# quit Agent unregistered [DEL] Controller CC:4B:73:23:D4:33 nanopi-m4 [default] ubuntu@nanopi-m4:~$
If you want to run Kodi automatically without the need of logging in you can do this:
-
Boot automatically
sudo systemctl edit getty@tty1.serviceand copy & paste:
[Service] ExecStart= ExecStart=-/sbin/agetty --noissue --autologin ubuntu %I $TERM Type=idleSave and Exit
-
Run Kodi right after login:
echo "kodi" >> .profileThen:
sync && sudo rebootImportant
For every login, kodi will run. If you login via ssh you get kodi on main screen. Remember to exit kodi if you are going to access the board remotely
A litle follow-up on the status of Mainline kernel 5.0.0-rc2 on RK3399.
What works:
- HDMI
- Bluetooth
- USB 2
- DVFS
- ethernet
Some Logs here: https://gist.github.com/avafinger/a8474938b0dfb31e462ad332192b324d
Mainline kernel 5.0.0-rc3 built with gcc 8.2 Some logs: https://gist.github.com/avafinger/05048dd20cef3953559a0bddef8f5930
Boosted oop to 2.0 GHz and 1.5 GHz and board is still stable! Results here: https://gist.github.com/avafinger/a8474938b0dfb31e462ad332192b324d
Increase oop to 2.0 / 1.5 GHz 7z b
I have provided an OS Image tested on NanoPi M4:
- rk3399_ubuntu-minimal-mainline-kernel-5-rc2.7z
Download from: https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.12
- Kernel 5.0.0-rc5 (linux-image && kernel headers)
Instructions:
-
Download deb file:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.14) -
Install
You need at least 19 Mbytes free on /boot
sudo dpkg -i inux-image-mainline-5.0_1.0-6.deb
sudo shutdown -h now
- Kernel 5.0.0-rc6-rk3399 (linux-image && kernel headers)
Instructions:
-
Download deb file:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.16) -
Install
You need at least 19 Mbytes free on /boot
sudo dpkg -i linux-image-mainline-5.0_1.0-7.deb
sudo shutdown -h now
Reboot..
- Kernel 5.0.0-rc7 (linux-image && kernel headers)
Instructions:
-
Download deb file:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.17) -
Install
You need at least 19 Mbytes free on /boot
sudo dpkg -i linux-image-mainline-5.0_1.0-8.deb
sudo shutdown -h now
Reboot..
- Kernel 5.0.3 (linux-image && kernel headers)
Instructions:
-
Download deb file:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.20) -
Install
You need at least 20 Mbytes free on /boot
sudo dpkg - i linux-image-mainline-5.0_1.0-9.deb
sudo shutdown -h now
Reboot..
- Kernel 5.1-rc1 (linux-image && kernel headers)
Instructions:
-
Download deb file:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.21) -
Install
You need at least 20 Mbytes free on /boot
sudo dpkg - i linux-image-mainline-5.1_1.0-10.deb
sudo shutdown -h now
Reboot..
7z b
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE)
LE
CPU Freq: 1938 1989 1989 1989 1989 1989 1989 1989 1989
RAM size: 1989 MB, # CPU hardware threads: 6
RAM usage: 1323 MB, # Benchmark threads: 6
Compressing | Decompressing
Dict Speed Usage R/U Rating | Speed Usage R/U Rating
KiB/s % MIPS MIPS | KiB/s % MIPS MIPS
22: 3882 357 1058 3777 | 98473 528 1591 8398
23: 4318 403 1092 4400 | 101357 532 1647 8770
24: 5381 479 1207 5786 | 98415 527 1638 8638
25: 4924 462 1216 5623 | 97324 530 1633 8661
---------------------------------- | ------------------------------
Avr: 425 1143 4896 | 530 1627 8617
Tot: 477 1385 6757
lsmod
Module Size Used by
brcmfmac 225280 0
rockchipdrm 118784 1
brcmutil 16384 1 brcmfmac
cfg80211 327680 1 brcmfmac
analogix_dp 36864 1 rockchipdrm
dw_hdmi 32768 1 rockchipdrm
dw_mipi_dsi 20480 1 rockchipdrm
drm_kms_helper 180224 4 dw_mipi_dsi,rockchipdrm,dw_hdmi,analogix_dp
realtek 20480 1
hci_uart 49152 0
drm 425984 6 drm_kms_helper,dw_mipi_dsi,rockchipdrm,dw_hdmi,analogix_dp
btbcm 16384 1 hci_uart
bluetooth 335872 23 hci_uart,btbcm
dwmac_rk 28672 0
stmmac_platform 20480 1 dwmac_rk
crct10dif_ce 16384 1
stmmac 135168 2 stmmac_platform,dwmac_rk
phy_rockchip_pcie 16384 0
ecdh_generic 24576 2 bluetooth
rfkill 28672 4 bluetooth,cfg80211
drm_panel_orientation_quirks 20480 1 drm
rtc_rk808 16384 1
pcie_rockchip_host 20480 0
rockchip_saradc 16384 0
rockchip_thermal 24576 0
ip_tables 32768 0
x_tables 36864 1 ip_tables
ipv6 393216 26
Bootlog:
https://gist.github.com/avafinger/b87a07bf056c2d26b576f71e864ad30d
- Kernel 5.1-rc2 (linux-image && kernel headers)
Instructions:
-
Download deb file:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.22) -
Install
You need at least 20 Mbytes free on /boot
sudo dpkg - i linux-image-mainline-5.1_1.0-10.deb
sudo shutdown -h now
Reboot..
- Note: Install this linux-image on OS 5.y only and not on 4.4
-
Bootlog & modules
https://gist.github.com/avafinger/12c7ba931eec5972c7cfb19af0fa326a
-
Kernel 5.1-rc6 (linux-image && kernel headers)
Instructions:
-
Download deb file:
wget $(curl -s https://api.github.com/repos/avafinger/nanopi-m4-ubuntu-base-minimal/releases | grep -oP '"browser_download_url": "\K(.*)(?=")' | grep v1.23) -
Install
You need at least 20 Mbytes free on /boot
sudo dpkg - i linux-image-mainline-5.1_1.0-11.deb
sudo shutdown -h now
Reboot..
Mainline kernel 5.2 has been released, here is what you can expect:
- DVFS works
- BT works
- Wifi (in progress - almost)
- Gbps
Bootlog: https://gist.github.com/avafinger/97d7faea424e386219ea4193a787d3b5
DVFS
Mainline kernel 5.6.2 (status update) has some improvments:
- DVFS works
- BT works
- Wifi works
- Gbps
- hdmi
- hdmi-sound out works
i was surprised by some nice improvments on DVFS and Wifi and BT are working together. The missing pieces are the rt5651 codec and HW decoding.
7z b
ubuntu@nanopi-m4:~$ 7z b
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE)
LE
CPU Freq: 64000000 - - - - - - - -
RAM size: 1920 MB, # CPU hardware threads: 6
RAM usage: 1323 MB, # Benchmark threads: 6
Compressing | Decompressing
Dict Speed Usage R/U Rating | Speed Usage R/U Rating
KiB/s % MIPS MIPS | KiB/s % MIPS MIPS
22: 5049 450 1092 4912 | 98605 505 1665 8409
23: 5796 522 1131 5906 | 96652 506 1652 8363
24: 5369 497 1161 5773 | 94737 504 1649 8315
25: 5838 550 1212 6666 | 93054 507 1633 8281
---------------------------------- | ------------------------------
Avr: 505 1149 5814 | 506 1650 8342
Tot: 505 1399 7078
Bootlog: https://gist.github.com/avafinger/eb14cc0d7fde87223e3c8fa7766ac238
Requirements:
- 16 GB sd card minimum
- Pre-built Mainline OS Image (This is important!)
- Mainline Kernel from kernel.org to build
Instructions:
-
login into NanoPi M4
-
create directory
mkdir -p linux cd linux -
grab the latest kernel: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/refs/tags
wget https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/snapshot/linux-5.2.tar.gz tar -xvpzf linux-5.2.tar.gz cd linux-5.2 -
Build
make defconfig #make menuconfig (if you want to add or change kernel modules) make oldconfig make -j6 INSTALL_MOD_PATH=output Image make -j6 INSTALL_MOD_PATH=output dtbs make -j6 INSTALL_MOD_PATH=output modules make -j6 INSTALL_MOD_PATH=output modules_install -
Install
export KV=$(strings ./arch/arm64/boot/Image |grep "Linux version"|awk '{print $3}') sudo cp -fv ./arch/arm64/boot/Image /boot/Image_${KV} sync sudo cp -vfr ./output/* / sync sudo cp -vf arch/arm64/boot/dts/rockchip/rk3399-nanopc-t4.dtb /boot/rk3399-nanopc-t4.dtb_${KV} sudo cp -vf arch/arm64/boot/dts/rockchip/rk3399-nanopi-m4.dtb /boot/rk3399-nanopi-m4.dtb_${KV} sync -
Make it current kernel
cd /boot sudo ln -sf Image_${KV} Image sudo ln -sf rk3399-nanopc-t4.dtb_${KV} dtb sudo ln -sf rk3399-nanopi-m4.dtb_${KV} dtb cd ${KVD} sync -
Reboot
sudo shutdown -h now (remove power for 30 secs) **Boot** with your new kernel
Instructions to build Kodi 19.0 ALPHA1
- Upgrade to Kernel 4.4.177-rk3399 or use the latest Image i have provided (RAW Image)
- Install all dependencies
- Remove any Previous Installed Kodi.
KODI 19.0 ALPHA1
KODI 19.0 ALPHA1 - mali
KODI 19.0 ALPHA1 - Web Inteerface Config
KODI 19.0 ALPHA1 - system
Install dependencies if not already installed, add or change if desired:
sudo apt-get install autoconf automake autopoint gettext autotools-dev cmake curl default-jre gawk gcc g++ cpp gdc gperf libasound2-dev libass-dev libavahi-client-dev libavahi-common-dev libbluetooth-dev libbluray-dev libbz2-dev libcdio-dev libcec-dev libp8-platform-dev libcrossguid-dev libcurl4-openssl-dev libcwiid-dev libdbus-1-dev libegl1-mesa-dev libenca- dev libflac-dev libfontconfig1-dev libfmt-dev libfreetype6-dev libfribidi-dev libfstrcmp-dev libgcrypt20-dev libgif-dev libgles2-mesa-dev libglew-dev libglu1-mesa-dev libgnutls28-dev libgpg-error-dev libiso9660-dev libjpeg-dev liblcms2-dev liblirc-dev libltdl-dev liblzo2-dev libmicrohttpd-dev libmysqlclient-dev libnfs-dev libogg-dev libomxil-bellagio-dev libpcre3-dev libplist-dev libpng-dev libpulse-dev libsmbclient-dev libsqlite3-dev libssl-dev libtag1-dev libtiff5-dev libtinyxml-dev libtool libudev-dev libva-dev libvdpau-dev libvorbis-dev libxkbcommon-dev libxmu-dev libxrandr-dev libxslt1-dev libxt-dev netcat lsb-release nasm python-dev python-pil python-minimal rapidjson-dev swig unzip uuid-dev yasm zip zlib1g-dev
Build the Kodi on-board
mkdir -p kodi
cd kodi
mkdir -p kodi-build
git clone https://github.com/xbmc/xbmc kodi
cd kodi
sudo make -C tools/depends/target/crossguid PREFIX=/usr
sudo make -C tools/depends/target/flatbuffers PREFIX=/usr
sudo make -C tools/depends/target/libfmt PREFIX=/usr
cd ../kodi-build
cmake ../kodi -DCMAKE_INSTALL_PREFIX=/usr/local -DCORE_PLATFORM_NAME=gbm -DGBM_RENDER_SYSTEM=gles
cmake --build . -- VERBOSE=0 -j4
sudo make install
cd ../kodi
sudo make -j4 -C tools/depends/target/binary-addons PREFIX=/usr/local
Testing
kodi
Pre-built Kodi 19 RK3399
-
Latest rockchip update
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/1.24
Kernel 4.4.177 fix https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.25
Deploying Ubuntu 19.10 Eoan Ermine (development branch)
Welcome to Ubuntu Eoan Ermine (development branch) (GNU/Linux 5.3.0-rc5-rk3399 aarch64)
* Documentation: https://help.ubuntu.com
* Management: https://landscape.canonical.com
* Support: https://ubuntu.com/advantage
Last login: Wed Aug 21 23:13:19 2019
ubuntu@nanopi-m4:~$
-
Info
DISTRIB_ID=Ubuntu DISTRIB_RELEASE=19.10 DISTRIB_CODENAME=eoan DISTRIB_DESCRIPTION="Ubuntu Eoan Ermine (development branch)" -
memory usage kernel 4.4:
total used free shared buff/cache available Mem: 1926 54 1782 8 90 1794 Swap: 0 0 0 -
memory usage kernel 5.3 (ssh):
total used free shared buff/cache available Mem: 1985 78 1715 8 191 1826 Swap: 0 0 0 -
gcc dev tools
gcc (Ubuntu 9.2.1-2ubuntu1) 9.2.1 20190819 Copyright (C) 2019 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
Bootlog: https://gist.github.com/avafinger/84aa9fac1c810765ec84844cb0da94b6
-
Flash Image to SD CARD
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.27
*Compiled with gcc 9.2.1
Bootlog: https://gist.github.com/avafinger/5d2e7586b4b10cb45a8a97f9d33d093b
Bootlog: https://gist.github.com/avafinger/28d976dbe48bc92580efba3fffc37078
-
Linux-image
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.28
Bootlog: https://gist.github.com/avafinger/0d3d90ad478fb3457707b9652c9710ea
-
Linux-image
https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/v1.29 -
7z b
7z b burning test alex@svn:~$ ssh ubuntu@192.168.254.100 ubuntu@192.168.254.100's password: Welcome to Ubuntu 19.10 (GNU/Linux 5.4.0-rc4 aarch64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/advantage Last login: Tue Oct 22 21:06:53 2019 from 192.168.254.253 ubuntu@nanopi-m4:~$ 7z b 7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21 p7zip Version 16.02 (locale=C.UTF-8,Utf16=on,HugeFiles=on,64 bits,6 CPUs LE) LE CPU Freq: - - - - - - - - - RAM size: 1986 MB, # CPU hardware threads: 6 RAM usage: 1323 MB, # Benchmark threads: 6 Compressing | Decompressing Dict Speed Usage R/U Rating | Speed Usage R/U Rating KiB/s % MIPS MIPS | KiB/s % MIPS MIPS 22: 5165 471 1067 5025 | 103265 533 1652 8807 23: 4807 447 1096 4898 | 100202 531 1633 8670 24: 3885 373 1119 4178 | 99252 533 1633 8712 25: 5253 498 1203 5998 | 94648 518 1626 8423 ---------------------------------- | ------------------------------ Avr: 447 1122 5025 | 529 1636 8653 Tot: 488 1379 6839 ubuntu@nanopi-m4:~$
Mailine Bluetooth works out-of-the-box on 5.3.y and 5.4.y
Here is how to play music with a Bluetooth speaker like JBL CHARGE3
-
Install Bluetooth stack
sudo apt-get update sudo apt-get dist-upgrade sudo apt-get install dialog alsa-utils libasound2 alsa-base sudo apt-get install bluez bluez-tools libbluetooth-dev sudo apt-get install pulseaudio pulseaudio-utils pavucontrol pulseaudio-module-bluetooth -
Find the BT
ubuntu@nanopi-m4:~$ hciconfig -a hci0: Type: Primary Bus: UART BD Address: CC:4B:73:23:D4:33 ACL MTU: 1021:8 SCO MTU: 64:1 UP RUNNING PSCAN RX bytes:3640 acl:0 sco:0 events:418 errors:0 TX bytes:64284 acl:0 sco:0 commands:418 errors:0 Features: 0xbf 0xfe 0xcf 0xfe 0xdb 0xff 0x7b 0x87 Packet type: DM1 DM3 DM5 DH1 DH3 DH5 HV1 HV2 HV3 Link policy: RSWITCH SNIFF Link mode: SLAVE ACCEPT Name: 'nanopi-m4' Class: 0x0c0000 Service Classes: Rendering, Capturing Device Class: Miscellaneous, HCI Version: 4.1 (0x7) Revision: 0x210a LMP Version: 4.1 (0x7) Subversion: 0x230f Manufacturer: Broadcom Corporation (15) -
Configure ALSA
cat /etc/asound.conf pcm.!default { type plug slave { pcm "hw:1,0" } } ctl.!default { type hw card 1 } -
Check for Pulse (must be running)
ubuntu@nanopi-m4:~$ rfkill list all 0: hci0: Bluetooth Soft blocked: no Hard blocked: no ubuntu@nanopi-m4:~$ ps -e|grep pulse 603 ? 00:00:00 pulseaudioif Pulse is not running, install and run:
pulseaudio --start -
Find, pair and connect with CHARGE3
sudo bluetoothctl power on agent on scan on scan off trust 8E:06:78:D2:E1:3C pair 8E:06:78:D2:E1:3C connect 8E:06:78:D2:E1:3C exit -
Play music
sudo apt-get install sox libsox-fmt-all play music.mp3I played this: https://www.soundhelix.com/examples/mp3/SoundHelix-Song-1.mp3
play SoundHelix-Song-1.mp3 SoundHelix-Song-1.mp3: File Size: 8.95M Bit Rate: 192k Encoding: MPEG audio Info: 2009 Channels: 2 @ 16-bit Samplerate: 44100Hz Replaygain: off Artist: SoundHelix Duration: 00:06:12.73 In:9.39% 00:00:35.02 [00:05:37.71] Out:1.54M [!=====|=====!] Hd:0.1 Clip:0
-
Pre-requisites
sudo apt-get install build-essential git bison flex bc device-tree-compiler dh-make bzr-builddeb p7zip-full sudo apt-get install libssl-dev rsync wget -
Build
Get your kernel or use the linus kernel (stable kernel 5.3.1 on Ubuntu 19.10):
mkdir -p linux cd linux/ wget https://cdn.kernel.org/pub/linux/kernel/v5.x/linux-5.3.1.tar.xz tar -xf linux-5.3.1.tar.xz cd linux-5.3.1/Build:
export KVD=$PWD make distclean rm -rf ./output/* make mrproper make defconfig make menuconfig # enable,diable,add,remove driver(s) or configuration make oldconfig make -j6 INSTALL_MOD_PATH=output Image make -j6 INSTALL_MOD_PATH=output dtbs make -j6 INSTALL_MOD_PATH=output modules make -j6 INSTALL_MOD_PATH=output modules_install export KV=$(strings ./arch/arm64/boot/Image |grep "Linux version"|awk '{print $3}') make INSTALL_HDR_PATH=output/usr/src/linux-headers-${KV} headers_installInstall:
sudo cp -vfr ./output/usr/* /usr/ sudo cp -vfr ./output/lib/* /usr/lib sync sudo cp -vf arch/arm64/boot/dts/rockchip/rk3399-nanopc-t4.dtb /boot/rk3399-nanopc-t4.dtb_${KV} sudo cp -vf arch/arm64/boot/dts/rockchip/rk3399-nanopi-m4.dtb /boot/rk3399-nanopi-m4.dtb_${KV} sync cd /boot sudo ln -sf Image_${KV} Image sudo ln -sf rk3399-nanopc-t4.dtb_${KV} dtb sudo ln -sf rk3399-nanopi-m4.dtb_${KV} dtb cd $KVD syncReboot with:
sudo shutdown -h nowRemove power for 15 secs and power again!
PS: it takes about 45 min to complete, depends on your SD CARD and how you cool your board!!!
You can also monitor the health of your board with htop 2.2.2 from here:
https://github.com/avafinger/htop_2.2.2
Until recently i was able to use Wifi or Bluetooth but not both together. This has been fixed following some simple instructions.
I used the old way (the ugly way) to set the Wifi and Ethernet, editing the file /etc/network/interfaces instead of netplan, the recommended way which i found a bit hard to configure.
For some reason, the wifi works smooth with power save off in 2.4 GHz and 5 GHz, and now Bluetooth can work together. Setting the wireless-power off in /etc/network/interfaces does not work but using iw works:
sudo apt-get update
sudo apt-get install iw
sudo iw dev wlan0 set power_save off
Now Wifi and Bluetooth work smooth.
Also for a better performance you can update the firmware from here (which is more up-to-date):
https://people.linaro.org/~manivannan.sadhasivam/rock960_wifi/
You can add the power save command at boot time adding the command to rc.local file:
#!/bin/bash
iw dev wlan0 set power_save off
exit 0
You might need to add the rc.local service if you have not done it yet before you edit the rc.local file above;
sudo systemctl status rc-local
sudo systemctl enable rc-local
printf '%s\n' '#!/bin/bash' 'exit 0' | sudo tee -a /etc/rc.local
sudo chmod +x /etc/rc.local
sudo systemctl enable rc-local
Check for SSID(s):
sudo iw dev wlan0 scan | egrep "signal:|SSID:" | sed -e "s/\tsignal: //" -e "s/\tSSID: //" | awk '{ORS = (NR % 2 == 0)? "\n" : " "; print}' | sort
Enjoy the maximum performance of both Wifi and BT.
Experiments with MIPI camera in Kernel 4.19. In these experiments i will try to grab images from the cameras with the kernel 4.19.111
-
gstreamer
-
v4l2 app
OV4689 sensor is configured and detected.
ubuntu@nanopi-m4:~/camera$ v4l2-ctl -V -d /dev/video1 Format Video Capture Multiplanar: Width/Height : 1280/960 Pixel Format : 'NV12' (Y/CbCr 4:2:0) Field : None Number of planes : 1 Flags : Colorspace : Default Transfer Function : Default YCbCr/HSV Encoding: Default Quantization : Full Range Plane 0 : Bytes per Line : 1280 Size Image : 1843200 ubuntu@nanopi-m4:~/camera$ v4l2-ctl -d /dev/v4l-subdev0 --all Media Driver Info: Driver name : rkisp1 Model : rkisp1 Serial : Bus info : Media version : 4.19.111 Hardware revision: 0x00000000 (0) Driver version : 4.19.111 Interface Info: ID : 0x0300002d Type : V4L Sub-Device Entity Info: ID : 0x00000001 (1) Name : rkisp1-isp-subdev Function : Unknown V4L2 Sub-Device Pad 0x01000002 : 0: Sink, Must Connect Link 0x02000012: from remote pad 0x1000011 of entity 'rkisp1_dmapath': Data Link 0x02000023: from remote pad 0x100001e of entity 'rockchip-mipi-dphy-rx': Data Pad 0x01000003 : 1: Sink Link 0x02000025: from remote pad 0x1000019 of entity 'rkisp1-input-params': Data Pad 0x01000004 : 2: Source Link 0x02000027: to remote pad 0x100000d of entity 'rkisp1_selfpath': Data Link 0x02000029: to remote pad 0x1000009 of entity 'rkisp1_mainpath': Data Pad 0x01000005 : 3: Source Link 0x0200002b: to remote pad 0x1000015 of entity 'rkisp1-statistics': Data User Controls exposure 0x00980911 (int) : min=4 max=1550 step=1 default=1536 value=1536 Image Source Controls vertical_blanking 0x009e0901 (int) : min=34 max=31247 step=1 default=34 value=34 horizontal_blanking 0x009e0902 (int) : min=4294967192 max=4294967192 step=1 default=4294967192 value=-104 flags=read-only analogue_gain 0x009e0903 (int) : min=128 max=2040 step=1 default=128 value=128 Image Processing Controls link_frequency 0x009f0901 (intmenu): min=0 max=0 default=0 value=0 (500000000 0x1dcd6500) flags=read-only 0: 500000000 (0x1dcd6500) pixel_rate 0x009f0902 (int64) : min=0 max=400000000 step=1 default=400000000 value=400000000 flags=read-only test_pattern 0x009f0903 (menu) : min=0 max=4 default=0 value=0 (Disabled) 0: Disabled 1: Vertical Color Bar Type 1 2: Vertical Color Bar Type 2 3: Vertical Color Bar Type 3 4: Vertical Color Bar Type 4 ubuntu@nanopi-m4:~/camera$ v4l2-ctl -d /dev/v4l-subdev1 --all Media Driver Info: Driver name : rkisp1 Model : rkisp1 Serial : Bus info : Media version : 4.19.111 Hardware revision: 0x00000000 (0) Driver version : 4.19.111 Interface Info: ID : 0x0300002f Type : V4L Sub-Device Entity Info: ID : 0x0000001c (28) Name : rockchip-mipi-dphy-rx Function : Video Interface Bridge Pad 0x0100001d : 0: Sink, Must Connect Link 0x02000021: from remote pad 0x1000020 of entity 'ov4689 1-0036': Data Pad 0x0100001e : 1: Source, Must Connect Link 0x02000023: to remote pad 0x1000002 of entity 'rkisp1-isp-subdev': Data User Controls exposure 0x00980911 (int) : min=4 max=1550 step=1 default=1536 value=1536 Image Source Controls vertical_blanking 0x009e0901 (int) : min=34 max=31247 step=1 default=34 value=34 horizontal_blanking 0x009e0902 (int) : min=4294967192 max=4294967192 step=1 default=4294967192 value=-104 flags=read-only analogue_gain 0x009e0903 (int) : min=128 max=2040 step=1 default=128 value=128 Image Processing Controls link_frequency 0x009f0901 (intmenu): min=0 max=0 default=0 value=0 (500000000 0x1dcd6500) flags=read-only 0: 500000000 (0x1dcd6500) pixel_rate 0x009f0902 (int64) : min=0 max=400000000 step=1 default=400000000 value=400000000 flags=read-only test_pattern 0x009f0903 (menu) : min=0 max=4 default=0 value=0 (Disabled) 0: Disabled 1: Vertical Color Bar Type 1 2: Vertical Color Bar Type 2 3: Vertical Color Bar Type 3 4: Vertical Color Bar Type 4 ubuntu@nanopi-m4:~/camera$ v4l2-ctl -d /dev/v4l-subdev2 --all Media Driver Info: Driver name : rkisp1 Model : rkisp1 Serial : Bus info : Media version : 4.19.111 Hardware revision: 0x00000000 (0) Driver version : 4.19.111 Interface Info: ID : 0x03000031 Type : V4L Sub-Device Entity Info: ID : 0x0000001f (31) Name : ov4689 1-0036 Function : Camera Sensor Pad 0x01000020 : 0: Source Link 0x02000021: to remote pad 0x100001d of entity 'rockchip-mipi-dphy-rx': Data User Controls exposure 0x00980911 (int) : min=4 max=1550 step=1 default=1536 value=1536 Image Source Controls vertical_blanking 0x009e0901 (int) : min=34 max=31247 step=1 default=34 value=34 horizontal_blanking 0x009e0902 (int) : min=4294967192 max=4294967192 step=1 default=4294967192 value=-104 flags=read-only analogue_gain 0x009e0903 (int) : min=128 max=2040 step=1 default=128 value=128 Image Processing Controls link_frequency 0x009f0901 (intmenu): min=0 max=0 default=0 value=0 (500000000 0x1dcd6500) flags=read-only 0: 500000000 (0x1dcd6500) pixel_rate 0x009f0902 (int64) : min=0 max=400000000 step=1 default=400000000 value=400000000 flags=read-only test_pattern 0x009f0903 (menu) : min=0 max=4 default=0 value=0 (Disabled) 0: Disabled 1: Vertical Color Bar Type 1 2: Vertical Color Bar Type 2 3: Vertical Color Bar Type 3 4: Vertical Color Bar Type 4 ubuntu@nanopi-m4:~/camera$First check:
ubuntu@nanopi-m4:~$ v4l2-ctl -d /dev/video1 -vwidth=1920,height=1080,pixelformat=NV12 --stream-mmap --stream-skip=3 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 29.88 fpsKernel output:
[ 692.916523] rkisp1: waiting on params stream on event timeout [ 692.916574] rkisp1 ff910000.rkisp1: can not get first iq setting in stream on [ 692.917944] rockchip-mipi-dphy-rx ff770000.syscon:mipi-dphy-rx0: stream on:1 [ 700.472033] rockchip-mipi-dphy-rx ff770000.syscon:mipi-dphy-rx0: stream on:0Sensor is working. What's next? We need to grab real image from the sensor, but sensor does not show up as a char device, we need a way to link the sensor.
Here is the topology:
ubuntu@nanopi-m4:~/camera$ media-ctl -d /dev/media0 -p Media controller API version 4.19.111 Media device information ------------------------ driver rkisp1 model rkisp1 serial bus info hw revision 0x0 driver version 4.19.111 Device topology - entity 1: rkisp1-isp-subdev (4 pads, 6 links) type V4L2 subdev subtype Unknown flags 0 device node name /dev/v4l-subdev0 pad0: Sink [fmt:SBGGR10_1X10/2688x1520 field:none crop.bounds:(0,0)/2688x1520 crop:(0,0)/2688x1520] <- "rkisp1_dmapath":0 [] <- "rockchip-mipi-dphy-rx":1 [ENABLED] pad1: Sink <- "rkisp1-input-params":0 [ENABLED] pad2: Source [fmt:YUYV8_2X8/2688x1520 field:none crop.bounds:(0,0)/2688x1520 crop:(0,0)/2688x1520] -> "rkisp1_selfpath":0 [ENABLED] -> "rkisp1_mainpath":0 [ENABLED] pad3: Source -> "rkisp1-statistics":0 [ENABLED] - entity 6: rkisp1_mainpath (1 pad, 1 link) type Node subtype V4L flags 0 device node name /dev/video0 pad0: Sink <- "rkisp1-isp-subdev":2 [ENABLED] - entity 10: rkisp1_selfpath (1 pad, 1 link) type Node subtype V4L flags 0 device node name /dev/video1 pad0: Sink <- "rkisp1-isp-subdev":2 [ENABLED] - entity 14: rkisp1_dmapath (1 pad, 1 link) type Node subtype V4L flags 0 device node name /dev/video2 pad0: Source -> "rkisp1-isp-subdev":0 [] - entity 20: rkisp1-statistics (1 pad, 1 link) type Node subtype V4L flags 0 device node name /dev/video3 pad0: Sink <- "rkisp1-isp-subdev":3 [ENABLED] - entity 24: rkisp1-input-params (1 pad, 1 link) type Node subtype V4L flags 0 device node name /dev/video4 pad0: Source -> "rkisp1-isp-subdev":1 [ENABLED] - entity 28: rockchip-mipi-dphy-rx (2 pads, 2 links) type V4L2 subdev subtype Unknown flags 0 device node name /dev/v4l-subdev1 pad0: Sink [fmt:SBGGR10_1X10/2688x1520@10000/300000 field:none] <- "ov4689 1-0036":0 [ENABLED] pad1: Source [fmt:SBGGR10_1X10/2688x1520@10000/300000 field:none] -> "rkisp1-isp-subdev":0 [ENABLED] - entity 31: ov4689 1-0036 (1 pad, 1 link) type V4L2 subdev subtype Sensor flags 0 device node name /dev/v4l-subdev2 pad0: Source [fmt:SBGGR10_1X10/2688x1520@10000/300000 field:none] -> "rockchip-mipi-dphy-rx":0 [ENABLED] ubuntu@nanopi-m4:~/camera$ov13850 sensor is configured and detected.
ubuntu@nanopi-m4:~$ v4l2-ctl -d /dev/video6 -vwidth=1920,height=1080,pixelformat=NV12 --stream-mmap --stream-skip=3 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps <<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps <<^C ubuntu@nanopi-m4:~$ v4l2-ctl -V -d /dev/video6 Format Video Capture Multiplanar: Width/Height : 1920/1080 Pixel Format : 'NV12' (Y/CbCr 4:2:0) Field : None Number of planes : 1 Flags : Colorspace : Default Transfer Function : Default YCbCr/HSV Encoding: Default Quantization : Full Range Plane 0 : Bytes per Line : 1920 Size Image : 3110400 ubuntu@nanopi-m4:~$ dmesg|tail [ 10.379757] [dhd-wlan0] wl_ext_iapsta_event : [S] Link UP with 86:ea:ea:aa:87:8f [ 10.468710] [dhd-wlan0] wl_notify_connect_status : wl_bss_connect_done succeeded with 86:ea:ea:aa:87:8f [ 31.201529] vcc_lcd: disabling [ 69.606312] ttyFIQ ttyFIQ0: tty_port_close_start: tty->count = 1 port count = 2 [ 174.538452] ttyFIQ ttyFIQ0: tty_port_close_start: tty->count = 1 port count = 3 [ 174.760610] ttyFIQ ttyFIQ0: tty_port_close_start: tty->count = 1 port count = 2 [ 530.785357] rkisp1: waiting on params stream on event timeout [ 530.785408] rkisp1 ff920000.rkisp1: can not get first iq setting in stream on [ 530.786813] rockchip-mipi-dphy-rx ff968000.mipi-dphy-tx1rx1: stream on:1 [ 539.035127] rockchip-mipi-dphy-rx ff968000.mipi-dphy-tx1rx1: stream on:0 ubuntu@nanopi-m4:~$ media-ctl -d /dev/media1 -p Media controller API version 4.19.111 Media device information ------------------------ driver rkisp1 model rkisp1 serial bus info hw revision 0x0 driver version 4.19.111 Device topology - entity 1: rkisp1-isp-subdev (4 pads, 6 links) type V4L2 subdev subtype Unknown flags 0 device node name /dev/v4l-subdev3 pad0: Sink [fmt:SBGGR10_1X10/2112x1568 field:none crop.bounds:(0,0)/2112x1568 crop:(0,0)/2112x1568] <- "rkisp1_dmapath":0 [] <- "rockchip-mipi-dphy-rx":1 [ENABLED] pad1: Sink <- "rkisp1-input-params":0 [ENABLED] pad2: Source [fmt:YUYV8_2X8/2112x1568 field:none crop.bounds:(0,0)/2112x1568 crop:(0,0)/2112x1568] -> "rkisp1_selfpath":0 [ENABLED] -> "rkisp1_mainpath":0 [ENABLED] pad3: Source -> "rkisp1-statistics":0 [ENABLED] - entity 6: rkisp1_mainpath (1 pad, 1 link) type Node subtype V4L flags 0 device node name /dev/video5 pad0: Sink <- "rkisp1-isp-subdev":2 [ENABLED] - entity 10: rkisp1_selfpath (1 pad, 1 link) type Node subtype V4L flags 0 device node name /dev/video6 pad0: Sink <- "rkisp1-isp-subdev":2 [ENABLED] - entity 14: rkisp1_dmapath (1 pad, 1 link) type Node subtype V4L flags 0 device node name /dev/video7 pad0: Source -> "rkisp1-isp-subdev":0 [] - entity 20: rkisp1-statistics (1 pad, 1 link) type Node subtype V4L flags 0 device node name /dev/video8 pad0: Sink <- "rkisp1-isp-subdev":3 [ENABLED] - entity 24: rkisp1-input-params (1 pad, 1 link) type Node subtype V4L flags 0 device node name /dev/video9 pad0: Source -> "rkisp1-isp-subdev":1 [ENABLED] - entity 28: rockchip-mipi-dphy-rx (2 pads, 2 links) type V4L2 subdev subtype Unknown flags 0 device node name /dev/v4l-subdev4 pad0: Sink [fmt:SBGGR10_1X10/2112x1568@10000/300000 field:none] <- "ov13850 2-0010":0 [ENABLED] pad1: Source [fmt:SBGGR10_1X10/2112x1568@10000/300000 field:none] -> "rkisp1-isp-subdev":0 [ENABLED] - entity 31: ov13850 2-0010 (1 pad, 1 link) type V4L2 subdev subtype Sensor flags 0 device node name /dev/v4l-subdev5 pad0: Source [fmt:SBGGR10_1X10/2112x1568@10000/300000 field:none] -> "rockchip-mipi-dphy-rx":0 [ENABLED] ubuntu@nanopi-m4:~$ -
mjpg-streamer Build from source, take a photo with cam and run:
mjpg_streamer -i "./input_uvc.so -y -r 1920x1080 -d /dev/video1" -o "./output_http.so -w ./www"
There is a porting of the OV13850 driver to the mainline kernel, so I decided to take a look and see if we can pull the raw image from the sensor using mjpg-streamer on NanoPi M4. For one reason, i used Kernel v5.10.0-rc1 to test its work since my kernel v5.10.0, which has some of my hacks just failed to load the ISP.
Now we have our character device as i expected to have it in kernel 4.19:
ubuntu@nanopi-m4:~$ cat /sys/dev/char/81:131/device/name
ov13850
Doing some check to find out about the sensor and rkisp1:
ubuntu@nanopi-m4:~$ /usr/local/bin/media-ctl -d /dev/media0 -p|grep enti
- entity 1: rkisp1_isp (4 pads, 5 links)
- entity 6: rkisp1_resizer_mainpath (2 pads, 2 links)
- entity 9: rkisp1_resizer_selfpath (2 pads, 2 links)
- entity 12: rkisp1_mainpath (1 pad, 1 link)
- entity 16: rkisp1_selfpath (1 pad, 1 link)
- entity 20: rkisp1_stats (1 pad, 1 link)
Configuring the sensor:
/usr/local/bin/media-ctl --device "platform:rkisp1" --reset
# connect pad 0 (sink) of the ISP with pad 0 of the camera and enable the link
/usr/local/bin/media-ctl --device "platform:rkisp1" --links "'ov13850 1-0010':0 -> 'rkisp1_isp':0 [1]"
# create a link between the selfpath (preview) and the ISP output on pad 2 (source), but keep it deactivated
/usr/local/bin/media-ctl --device "platform:rkisp1" --links "'rkisp1_isp':2 -> 'rkisp1_resizer_selfpath':0 [0]"
# create a link between the mainpath and the ISP output on pad 2 (source) and enable the link
/usr/local/bin/media-ctl --device "platform:rkisp1" --links "'rkisp1_isp':2 -> 'rkisp1_resizer_mainpath':0 [1]"
# Set the video format on the camera (this is very dependent on your camera)
/usr/local/bin/media-ctl --device "platform:rkisp1" --set-v4l2 '"ov13850 1-0010":0 [fmt:SBGGR10_1X10/2112x1568]'
# Set the input video format for the ISP, this must match the video format of the camera, crop it down to 1920x1080
/usr/local/bin/media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_isp":0 [fmt:SBGGR10_1X10/2112x1568 crop: (0,0)/1920x1080]'
# Set the output video format of the ISP, the maximum size was propagated from the sink pad, and the format size is taken from the crop format
/usr/local/bin/media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_isp":2 [fmt:YUYV8_2X8/1920x1080 crop: (0,0)/1920x1080]'
# Set the input format for the mainpath resizer
/usr/local/bin/media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_resizer_mainpath":0 [fmt:YUYV8_2X8/1920x1080]'
# Set the output format for the mainpath resizer
/usr/local/bin/media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_resizer_mainpath":1 [fmt:YUYV8_2X8/1280x720]'
# Configure the format at the mainpath DMA-engine, which is the point that is accessed by user-space
/usr/local/bin/v4l2-ctl --media-bus-info "platform:rkisp1" --device "rkisp1_mainpath" --set-fmt-video "width=1280,height=720,pixelformat=422P"
Check if this is working:
ubuntu@nanopi-m4:~$ /usr/local/bin/v4l2-ctl -d /dev/video1 -vwidth=1280,height=720,pixelformat=YUYV --stream-mmap --stream-skip=3
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<^C
ubuntu@nanopi-m4:~$
ubuntu@nanopi-m4:~$ /usr/local/bin/v4l2-ctl -d /dev/v4l-subdev3 --all
User Controls
exposure 0x00980911 (int) : min=4 max=1660 step=1 default=1536 value=1536
Image Source Controls
vertical_blanking 0x009e0901 (int) : min=96 max=31199 step=1 default=96 value=96
horizontal_blanking 0x009e0902 (int) : min=2688 max=2688 step=1 default=2688 value=2688 flags=read-only
analogue_gain 0x009e0903 (int) : min=16 max=248 step=1 default=16 value=16
Image Processing Controls
link_frequency 0x009f0901 (intmenu): min=0 max=0 default=0 value=0 (300000000 0x11e1a300) flags=read-only
0: 300000000 (0x11e1a300)
pixel_rate 0x009f0902 (int64) : min=0 max=120000000 step=1 default=120000000 value=120000000 flags=read-only
test_pattern 0x009f0903 (menu) : min=0 max=4 default=0 value=0 (Disabled)
0: Disabled
1: Vertical Color Bar Type 1
2: Vertical Color Bar Type 2
3: Vertical Color Bar Type 3
4: Vertical Color Bar Type 4
ubuntu@nanopi-m4:~$ /usr/local/bin/v4l2-ctl -d /dev/v4l-subdev2 --all
Media Driver Info:
Driver name : rkisp1
Model : rkisp1
Serial :
Bus info : platform:rkisp1
Media version : 5.10.0
Hardware revision: 0x00000000 (0)
Driver version : 5.10.0
Interface Info:
ID : 0x03000030
Type : V4L Sub-Device
Entity Info:
ID : 0x00000009 (9)
Name : rkisp1_resizer_selfpath
Function : Video Scaler
Pad 0x0100000a : 0: Sink, Must Connect
Link 0x02000024: from remote pad 0x1000004 of entity 'rkisp1_isp': Data
Pad 0x0100000b : 1: Source, Must Connect
Link 0x02000026: to remote pad 0x1000013 of entity 'rkisp1_selfpath': Data, Enabled, Immutable
ubuntu@nanopi-m4:~$ /usr/local/bin/v4l2-ctl -d /dev/v4l-subdev1 --all
Media Driver Info:
Driver name : rkisp1
Model : rkisp1
Serial :
Bus info : platform:rkisp1
Media version : 5.10.0
Hardware revision: 0x00000000 (0)
Driver version : 5.10.0
Interface Info:
ID : 0x0300002e
Type : V4L Sub-Device
Entity Info:
ID : 0x00000006 (6)
Name : rkisp1_resizer_mainpath
Function : Video Scaler
Pad 0x01000007 : 0: Sink, Must Connect
Link 0x02000020: from remote pad 0x1000004 of entity 'rkisp1_isp': Data, Enabled
Pad 0x01000008 : 1: Source, Must Connect
Link 0x02000022: to remote pad 0x100000f of entity 'rkisp1_mainpath': Data, Enabled, Immutable
ubuntu@nanopi-m4:~$ /usr/local/bin/v4l2-ctl -d /dev/v4l-subdev0 --all
Media Driver Info:
Driver name : rkisp1
Model : rkisp1
Serial :
Bus info : platform:rkisp1
Media version : 5.10.0
Hardware revision: 0x00000000 (0)
Driver version : 5.10.0
Interface Info:
ID : 0x0300002c
Type : V4L Sub-Device
Entity Info:
ID : 0x00000001 (1)
Name : rkisp1_isp
Function : Video Pixel Formatter
Pad 0x01000002 : 0: Sink, Must Connect
Link 0x0200001e: from remote pad 0x100001d of entity 'ov13850 1-0010': Data, Enabled
Pad 0x01000003 : 1: Sink
Link 0x02000028: from remote pad 0x1000019 of entity 'rkisp1_params': Data, Enabled, Immutable
Pad 0x01000004 : 2: Source
Link 0x02000020: to remote pad 0x1000007 of entity 'rkisp1_resizer_mainpath': Data, Enabled
Link 0x02000024: to remote pad 0x100000a of entity 'rkisp1_resizer_selfpath': Data
Pad 0x01000005 : 3: Source
Link 0x0200002a: to remote pad 0x1000015 of entity 'rkisp1_stats': Data, Enabled, Immutable
ubuntu@nanopi-m4:~$
Testing the performance again:
ubuntu@nanopi-m4:~$ /usr/local/bin/v4l2-ctl --media-bus-info "platform:rkisp1" --device "rkisp1_mainpath" --stream-mmap --stream-count=150
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.05 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<
Media order keeps changing on every boot, here you can find the sensor name and the corresponding /dev/videoX:
ubuntu@nanopi-m4:~$ ls /dev/media*
/dev/media0 /dev/media1 /dev/media2 /dev/media3
Finding the sensor in use:
ubuntu@nanopi-m4:~$ media-ctl -p -d 1 |grep ENABLED |grep -v "rkisp"|grep -o "\".*\""|tr -d \"
ov4689 1-0036
where -d 1 is the media index, searching from media0,media1,...media3
Finding the video device for the sensor:
ubuntu@nanopi-m4:~$ media-ctl -e "rkisp1_mainpath" -d 1
/dev/video2
Build mjpg-streamer from source and run:
mjpg_streamer -i "./input_uvc.so -y -r 1280x720 -d /dev/video1" -o "./output_http.so -w ./www"
MJPG Streamer Version: git rev: 58e952383cbe973641a3ce6c6a738bafc1605337
i: Using V4L2 device.: /dev/video1
i: Desired Resolution: 1280 x 720
i: Frames Per Second.: -1
i: Format............: YUYV
i: JPEG Quality......: 80
i: TV-Norm...........: DEFAULT
Using mplane plugin for capture
UVCIOC_CTRL_ADD - Error at Pan (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Tilt (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Pan Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Pan/tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Focus (absolute): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Pan (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Tilt (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Pan Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Pan/tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Focus (absolute): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at LED1 Mode: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at LED1 Frequency: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Disable video processing: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Raw bits per pixel: Inappropriate ioctl for device (25)
o: www-folder-path......: ./www/
o: HTTP TCP port........: 8080
o: HTTP Listen Address..: (null)
o: username:password....: disabled
o: commands.............: enabled
As we can see by the errors, we still need a way to use ISP while grabbing the frames, they are dark and greenish:
mjpg-streamer pulling raw images - 1280x720 ~29 FPS (80% quality)
Monitoring mjpg-streamer in action
Mainline 5.11.0-rc2
With the help of Sebastian (the author), it was possible to make use of ISP. Grabbing images still greenish but far better quality than pulling raw images directly from the sensor. Unfortunately Mjpg-streamer dropped from 29 FPS to 15 FPS and CPU usage seems a bit higher.
mjpg-streamer 1280x720 ~15 FPS (80% quality)
Monitoring traffic and CPU usage
Streaming 1920x1080 with Mainline
Experimenting with OV13850 in low light condition with window size 1920x1080 10 FPS.
/usr/local/bin/media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_resizer_mainpath":1 [fmt:YUYV8_2X8/1920x1080]'
/usr/local/bin/v4l2-ctl --media-bus-info "platform:rkisp1" --device "rkisp1_mainpath" --set-fmt-video "width=1920,height=1080,pixelformat=YUYV"
Mjpg-streamer command line:
mjpg_streamer -i "./input_uvc.so -y -r 1920x1080 -d /dev/video1" -o "./output_http.so -w ./www"
Mjpg-streamer 1920x1080 OV13850
Mjpg-streamer 1920x1080 OV4689 (IR cut - Indirect light)
Streaming video with Mjpg-streamer 2688x1520 gives 5 FPS over Gbit ethernet.
mjpg_streamer -i "./input_uvc.so -y -r 2688x1520 -d /dev/video2" -o "./output_http.so -w ./www"
MJPG Streamer Version: git rev: 58e952383cbe973641a3ce6c6a738bafc1605337
i: Using V4L2 device.: /dev/video2
i: Desired Resolution: 2688 x 1520
i: Frames Per Second.: -1
i: Format............: YUYV
i: JPEG Quality......: 80
i: TV-Norm...........: DEFAULT
Using mplane plugin for capture
UVCIOC_CTRL_ADD - Error at Pan (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Tilt (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Pan Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Pan/tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_ADD - Error at Focus (absolute): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Pan (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Tilt (relative): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Pan Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Pan/tilt Reset: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Focus (absolute): Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at LED1 Mode: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at LED1 Frequency: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Disable video processing: Inappropriate ioctl for device (25)
UVCIOC_CTRL_MAP - Error at Raw bits per pixel: Inappropriate ioctl for device (25)
o: www-folder-path......: ./www/
o: HTTP TCP port........: 8080
o: HTTP Listen Address..: (null)
o: username:password....: disabled
Initial support for dual-camera has been done in Kernel 4.19.111 and the Kernel is made available here: https://github.com/avafinger/kernel-rockchip-dual-camera
You can attach two cameras (OV13850 or OV4689) to the NanoPi M4 and stream video.
Initial support for dual-camera has been introduced in Kernel 5.11.0 with pre-built camera application
The setup must follow one of this:
- Single OV13850 installed in CSI-1
- Single OV4689 installed in CSI-1
- Dual camera OV13850 installed in CSI-1 and CSI-2
- Dual Camera OV4689 installed in CSI-1 and CSI-2
Limitations:
The camera sensor tested with ov4689 is the camera w/o IR cut filter
Pulling video from the cameras
-
Camera 1 (CSI-1)
cam --camera=1 --capture=100 --file=cam1-frames-100_1920x1080.nv21 -s height=1080,width=1920,pixelformat=NV21 -
Camera 2 (CSI-2)
cam --camera=2 --capture=100 --file=cam2-frames-100_1920x1080.nv21 -s height=1080,width=1920,pixelformat=NV21 -
Converting NV21 to MP4 using ffmpeg in you PC
ffmpeg -f rawvideo -vcodec rawvideo -s 1920x1080 -r 30 -pix_fmt nv21 -i cam1-frames-100_1920x1080.nv21 -c:v libx264 -preset ultrafast -qp 0 -y -hide_banner test-cam1.mp4 ffmpeg -f rawvideo -vcodec rawvideo -s 1920x1080 -r 30 -pix_fmt nv21 -i cam2-frames-100_1920x1080.nv21 -c:v libx264 -preset ultrafast -qp 0 -y -hide_banner test-cam2.mp4
8GB SD CARD Image https://github.com/avafinger/nanopi-m4-ubuntu-base-minimal/releases/tag/1.42
Mainline Porting
You can get further info about the porting:
Driver:
https://sebastianfricke.me/porting-the-ov13850-camera/
Obs: Porting OV4689 is very similar to the OV13850.
rkisp1 (Helen Koike):
https://www.collabora.com/news-and-blog/news-and-events/kernel-5.10-rockchip-h264-bifrost-more.html
Here we can compare some photos taken with FE Kernel 4.4.179, Kernel 4.19.111 and mainline 5.11.0-rc2 (OV13850). I have the impression that in BSP, the image is taken at a higher resolution and then resized to fit 1920x1080 (16:9). It looks a little distorted. You can draw your conclusions.
1 - Photo in 1920x1080 size
This is the image taken with cam application from FE 4.4.179.
2 - Screenshot mjpg-streamer with FE 4.4.179
This is a screenshot of mjpg-streamer while streaming video in 1920x1080 taken from FE 4.4.179.
3 - Screenshot YU12 1920x1080 with KFE Kernel 4.19.111
This is a screenshot of YU12 1920x1080 grabed image with Kernel 4.19.11, better focus but no Gain / Exposure controls.
4 - Screenshot mjpg-streamer with Mainline 5.11.0-rc2
This is a screenshot of mjpg-streamer while streaming video in 1920x1080 taken from the mainline kernel 5.11.0-rc2.
OV4689 w/o IR cut filter with mainline kernel 5.11.0-rc6
-
Config sensor to be used by v4l2 pplications
media-ctl --device "platform:rkisp1" --reset # connect pad 0 (sink) of the ISP with pad 0 of the camera and enable the link media-ctl --device "platform:rkisp1" --links "'ov4689 1-0036':0 -> 'rkisp1_isp':0 [1]" # create a link between the selfpath (preview) and the ISP output on pad 2 (source), but keep it deactivated media-ctl --device "platform:rkisp1" --links "'rkisp1_isp':2 -> 'rkisp1_resizer_selfpath':0 [0]" # create a link between the mainpath and the ISP output on pad 2 (source) and enable the link media-ctl --device "platform:rkisp1" --links "'rkisp1_isp':2 -> 'rkisp1_resizer_mainpath':0 [1]" # Set the video format on the camera (this is very dependent on your camera) media-ctl --device "platform:rkisp1" --set-v4l2 '"ov4689 1-0036":0 [fmt:SBGGR10_1X10/2688x1520]' # Set the input video format for the ISP, this must match the video format of the camera, crop it down to 1920x1080 media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_isp":0 [fmt:SBGGR10_1X10/2688x1520 crop: (0,0)/1920x1080]' # Set the output video format of the ISP, the maximum size was propagated from the sink pad, and the format size is taken from the crop format media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_isp":2 [fmt:YUYV8_2X8/1920x1080 crop: (0,0)/1920x1080]' # Set the input format for the mainpath resizer media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_resizer_mainpath":0 [fmt:YUYV8_2X8/1920x1080]' # Set the output format for the mainpath resizer media-ctl --device "platform:rkisp1" --set-v4l2 '"rkisp1_resizer_mainpath":1 [fmt:YUYV8_2X8/1920x1080]' # Configure the format at the mainpath DMA-engine, which is the point that is accessed by user-space v4l2-ctl --media-bus-info "platform:rkisp1" --device "rkisp1_mainpath" --set-fmt-video "width=1920,height=1080,pixelformat=YU12"
This will configure the sensor OV4689 but grabbed images will appear green and dark, so we need a trick to bypass this limitation, run the cam application to grab a few images and adjust exposure automatically for our v4l2 application and then repeat the previous config.
cam --camera=1 --capture=15 --file=/dev/null -s height=1520,width=2688,pixelformat=NV21
Now we can run mjpg streamer and stream video to our web clients. Build the latest mjpg streamer from source, install and run like:
mjpg_streamer -i "input_uvc.so -y -r 1920x1080 -d /dev/video1" -o "output_http.so -w /usr/local/share/mjpg-streamer/www"
- FriendlyElec (for the sample)
- Amanda Finger (Expertise on Kodi and help building)
- Armbian (knowledge base)