I can't download android pie source fully

On Ubuntu 14.04, I use the following commands for downloading android 9 source code of vim1.

~/bin/repo init -u https://github.com/khadas/android_manifest.git -b khadas-vims-pie

~/bin/repo sync -j4

But, I usually got an error that the command line is stuck in the following stat even after severl hours:

root@xland.net:/home/hoy/khadas/workspace# ~/bin/repo sync -j4                           
Fetching: 20% (144/695) 0:46 | 4 jobs | 0:35 platform/external/chromium-webview @ external/chromium-webview

What’s wrong with the source server?

Thanks!

Hello @hoyzhang

@goenjoy @xiong.zhang will help you then.

@hoyzhang
Hello, we found that there was a problem with the remote of the previous external/chromium-webview library. I changed upstream again. You can clear the warehouse you synchronized and then use it again.

repo init -u https://github.com/khadas/android_manifest.git -b khadas-vims-pie
repo sync -j10

After synchronization, remove com.android.webview under the frameworks/base path before compilation

xiong@server:/users/xiong/work/amlogic/vim3/vim3_32bit/frameworks/base$ git show 
commit f45b4f1e8c1f1c619f88627ad940b4926468f477 (HEAD -> khadas-vim3-p-32bit)
Author: Xiong Zhang <xiong.zhang@wesion.com>
Date:   2023-09-26 10:22:45 +0800

    WebView: modify com.android.webview to com.google.android.webview
    
    Signed-off-by: Xiong Zhang <xiong.zhang@wesion.com>

diff --git a/core/res/res/xml/config_webview_packages.xml b/core/res/res/xml/config_webview_packages.xml
index 27d1aab8fb07..9c4d65aed6a4 100644
--- a/core/res/res/xml/config_webview_packages.xml
+++ b/core/res/res/xml/config_webview_packages.xml
@@ -16,8 +16,6 @@
 
 <webviewproviders>
     <!-- The default WebView implementation -->
-    <webviewprovider description="Android WebView" packageName="com.android.webview" availableByDefault="true">
-    </webviewprovider>
     <webviewprovider description="Android WebView" packageName="com.google.android.webview" availableByDefault="true">
     </webviewprovider>
 </webviewproviders>

@xiong.zhang
I’ve resynchronized anagin. But it is still like before.

hoy14@xland:~/android/khadas/workspace$ ls
hoy14@xland:~/android/khadas/workspace$ repo sync -j4
Fetching: 26% (184/695) 4:16 | 4 jobs | 4:03 platform/external/chromium-webview @ external/chromium-webview

And after a while

Fetching: 34% (240/695) 11:08 | 4 jobs | 10:57 platform/external/chromium-webview @ external/chromium-webview接收对象中: 100% (9719814/9719814), 1.84 GiB |接收对象中: 100% (9719814/9719814), 1.84 GiB | 39.04 MiB/s, done.
处理 delta 中: 100% (8218847/8218847), done.57 platform/external/chromium-webview @ external/chromium-webview处理 delta 中:  99% (8216969/8218847)   
Fetching: 36% (252/695) 18:26 | 4 jobs | 18:14 platform/external/chromium-webview @ external/chromium-webview
Fetching: 36% (252/695) 19:15 | 4 jobs | 19:03 platform/external/chromium-webview @ external/chromium-webview

////////////////////////////////////////////////////////////////////////////
And there are othere packages stucking too…

android_frameworks_base @ frameworks/base
platform/prebuilts/clang/host/linux-x86 @ prebuilts/clang/host/linux-x86
platform/prebuilts/sdk @ prebuilts/sdk
platform/prebuilts/tools @ prebuilts/tools

@numbqq
Thanks very much…

And how can I trace and print the fetching URLs?
Thanks.

Hello @hoyzhang, development team is on vacation at the moment, your queries will be responded to next week.

Regards.

I tried a single pull locally and there was no problem. You can try a single pull like me. The slow pull is probably related to the network.

I repo the libraries you mentioned separately. Do you get an error if you can’t pull them? If not, can you execute them again?

xiong@server:/users/xiong/work/amlogic/github_test/test$ repo sync -j10 frameworks/base

... A new version of repo (2.37) is available.
... New version is available at: /users/xiong/work/amlogic/github_test/test/.repo/repo/repo
... The launcher is run from: /usr/bin/repo
!!! The launcher is not writable.  Please talk to your sysadmin or distro
!!! to get an update installed.

Fetching: 100% (1/1), done in 2h45m56.716s
Checking out files: 100% (30078/30078), done.
Checking out: 100% (1/1), done in 10.375s
warning: Partial syncs are not supported. For the best experience, sync the entire tree.
repo sync has finished successfully.
xiong@server:/users/xiong/work/amlogic/github_test/test$ repo sync -j10 prebuilts/clang/host/linux-x86

... A new version of repo (2.37) is available.
... New version is available at: /users/xiong/work/amlogic/github_test/test/.repo/repo/repo
... The launcher is run from: /usr/bin/repo
!!! The launcher is not writable.  Please talk to your sysadmin or distro
!!! to get an update installed.

Receiving objects: 100% (90854/90854), 28.91 GiB | 29.74 MiB/s, done.ang/host/linux-x86 @ prebuilts/clang/host/linux-x86Receiving objects:  99% (90785/90854), 28.89 GiB | 29.67 MiB/s   
Resolving deltas: 100% (39389/39389), done.2:14 platform/prebuilts/clang/host/linux-x86 @ prebuilts/clang/host/linux-x86Resolving deltas: 100% (39389/39389)   
Fetching: 100% (1/1), done in 10h52m21.717s
Checking out files: 100% (16166/16166), done.
Checking out: 100% (1/1), done in 27.522s
warning: Partial syncs are not supported. For the best experience, sync the entire tree.
repo sync has finished successfully.
xiong@server:/users/xiong/work/amlogic/github_test/test$ repo sync -j10 prebuilts/sdk

... A new version of repo (2.37) is available.
... New version is available at: /users/xiong/work/amlogic/github_test/test/.repo/repo/repo
... The launcher is run from: /usr/bin/repo
!!! The launcher is not writable.  Please talk to your sysadmin or distro
!!! to get an update installed.

Fetching:  0% (0/1) 1:49:15 | 1 job | 1:49:15 platform/prebuilts/sdk @ prebuilts/sdk
Receiving objects: 100% (171464/171464), 11.22 GiB | 42.33 MiB/s, done.prebuilts/sdkReceiving objects: 100% (171464/171464), 11.21 GiB | 36.89 MiB/s   
Resolving deltas: 100% (51690/51690), done.02 platform/prebuilts/sdk @ prebuilts/sdkResolving deltas: 100% (51690/51690)   
Fetching: 100% (1/1), done in 4h9m6.126s
Checking out files: 100% (4084/4084), done.
Checking out: 100% (1/1), done in 7.448s
warning: Partial syncs are not supported. For the best experience, sync the entire tree.
repo sync has finished successfully.
xiong@server:/users/xiong/work/amlogic/github_test/test$ repo sync -j10 prebuilts/tools

... A new version of repo (2.37) is available.
... New version is available at: /users/xiong/work/amlogic/github_test/test/.repo/repo/repo
... The launcher is run from: /usr/bin/repo
!!! The launcher is not writable.  Please talk to your sysadmin or distro
!!! to get an update installed.

Receiving objects: 100% (181976/181976), 49.21 GiB | 49.66 MiB/s, done.s @ prebuilts/toolsReceiving objects: 100% (181976/181976), 49.21 GiB | 56.14 MiB/s   
Resolving deltas: 100% (71073/71073), done.6:05 platform/prebuilts/tools @ prebuilts/toolsResolving deltas: 100% (71073/71073)   
Fetching: 100% (2/2), done in 15h46m16.187s
Checking out files: 100% (10157/10157), done.
Checking out: 100% (1/1), done in 16.744s
warning: Partial syncs are not supported. For the best experience, sync the entire tree.
repo sync has finished successfully.
xiong@server:/users/xiong/work/amlogic/github_test/test$

Does it will take me 2 hours for fetching down?

////////////////////////////////////////////////////////////////////////////////////////
I’ve used a http/https proxy && VPN for sync before. Maybe there something wrong with them.
Now I use 2 mirror websites. hub.njuu.cf for github.com and mirrors.tuna.tsinghua.edu.cn/git/AOSP for android.googlesource.com by editing the default.xml file.

I’ll try and post the result here.
Thanks!

hoy18@xland.net:~/android/k2$ repo sync -j4 external/chromium-webview
Fetching: 100% (1/1), done in 18.755s
Checking out: 100% (1/1), done in 0.695s
repo sync has finished successfully.

Now, excuting repo sync -j4 frameworks/base
Waiting for a result…

hoy18@xland.net:~/android/k2$ repo sync -j4 frameworks/base 
Fetching: 100% (1/1), done in 25m37.486s
正在检出文件: 100% (30078/30078), 完成.
Checking out: 100% (1/1), done in 6.090s
warning: Partial syncs are not supported. For the best experience, sync the entire tree.
repo sync has finished successfully.

The whole tree has finished sync.
Now I am going to make a boot image.

source build/envsetup.sh
lunch kvim-userdebug
make bootimage

There are some errors:

hoy18@xland.net:~/android/khadas$ make bootimage
hardware/amlogic/wifi/configs/wifi.mk:43: warning: WIFI_MOUDLE is multiwifi
hardware/amlogic/wifi/configs/wifi.mk:47: warning: WIFI_BUILD_IN is false
hardware/amlogic/bluetooth/configs/bluetooth.mk:20: warning: BLUETOOTH_MODULE is BCMBT
hardware/amlogic/bluetooth/configs/bluetooth.mk:24: warning: BLUETOOTH_INF is not set
Traceback (most recent call last):
  File "device/khadas/kvim/auto_generator.py", line 47, in <module>
    main(sys.argv)
  File "device/khadas/kvim/auto_generator.py", line 32, in main
    makefile = file(makefile_path, 'w')
NameError: name 'file' is not defined
============================================
PLATFORM_VERSION_CODENAME=REL
PLATFORM_VERSION=9
TARGET_PRODUCT=kvim
TARGET_BUILD_VARIANT=userdebug
TARGET_BUILD_TYPE=release
TARGET_ARCH=arm
TARGET_ARCH_VARIANT=armv7-a-neon
TARGET_CPU_VARIANT=cortex-a9
HOST_ARCH=x86_64
HOST_2ND_ARCH=x86
HOST_OS=linux
HOST_OS_EXTRA=Linux-5.4.0-150-generic-x86_64-Ubuntu-18.04.6-LTS
HOST_CROSS_OS=windows
HOST_CROSS_ARCH=x86
HOST_CROSS_2ND_ARCH=x86_64
HOST_BUILD_TYPE=release
BUILD_ID=PPR1.180610.011
OUT_DIR=out
============================================
[1/1] out/soong/.minibootstrap/minibp out/soong/.bootstrap/build.ninja
[55/56] glob prebuilts/ndk/cpufeatures.bp
[77/77] out/soong/.bootstrap/bin/soong_build out/soong/build.ninja
FAILED: out/soong/build.ninja 
out/soong/.bootstrap/bin/soong_build -t -l out/.module_paths/Android.bp.list -b out/soong -n out -d out/soong/build.ninja.d -o out/soong/build.ninja Android.bp
error: external/chromium-webview/Android.bp:18:1: unrecognized module type "package"
error: external/chromium-webview/Android.bp:24:1: unrecognized module type "license"
error: external/chromium-webview/Android.bp:33:1: unrecognized module type "android_app_import"
ninja: build stopped: subcommand failed.
22:50:10 soong bootstrap failed with: exit status 1

#### failed to build some targets (9 seconds) ####

Have you modified this?

I’ve commented the 2 lines.

And then make bootimage again.
Same errors.

I only want to get a boot image file.
Just delete the file external/chromium-webview/Android.bp.
At last, I did it.

1 Like

Because we changed to the new external/chromium-webview library, there are new bp files. I didn’t find this.