Ekuthuthukisweni kobuchwepheshe be-augmented reality (AR), ukuqonda kokujula kombono kuthinta ngokuqondile umthelela wokuhlanganisa wezinto ezibonakalayo ezinezigcawu zangempela. I-TOF (Imojuli yekhamera yeSikhathi Sendiza, enekhono layo lokuthola idatha yendawo enezinhlangothi ezintathu ngesikhathi sangempela, isibe ingxenye eyinhloko yamadivayisi e-AR. Nokho, indlela yokuthuthukisa ukujula kwayo kokunemba kwezindawo eziyinkimbinkimbi kuseyiyona nto egxile embonini. Lesi sihloko sizoxoxa ngohlelo lokuthuthukisa umbono ojulile we-TOF
imojuli yekhamera ezinhlelweni zokusebenza ze-AR kusuka kubukhulu obuthathu: ukuthuthukiswa kobuchwepheshe, idizayini, kanye nokuhlanganiswa kwezinzwa eziningi.
1.Ukuthuthukiswa kwe-algorithm: ukusuka ekucindezelweni komsindo kuya ekuhlanganiseni okujulile
Izinzwa ze-TOF zosiko zijwayele ukuphazamiseka ekukhanyeni kwe-ambient, kudatha ejulile enomsindo. Isixazululo esenziwe ngezifiso i-Ouster ye-Meizu 17 Pro sisebenzisa ama-algorithms okuhlunga asebenza kahle kakhulu, okuthi, ngobuchwepheshe bokucindezela umsindo oguquguqukayo, asuse umsindo ophezulu we-low-frequency ikakhulukazi, athuthukise kakhulu ukucaca kwemephu ejulile. Ngaphezu kwalokho, kuhlanganiswe nenjini ejulile ethuthukiswe i-Qualcomm DSP, ukusetshenziswa kwamandla esistimu kwehliswa ngo-15%, kuyilapho kugcinwa izinga lozimele elizinzile lika-30FPS, okuqinisekisa ukushelela kwezinhlelo zokusebenza ze-AR.
Ukunxephezela inkinga yokunganele Ukuxazululwa, uhlaka lwe-DELTAR olwakhiwe ithimba leNyuvesi yase-Zhejiang luzuza ukuhlanganiswa kwesithombe se-ToF ne-RGB engasindi ngokufunda okujulile. Lolu hlelo lusebenzisa imininingwane yokuthungwa kwe-RGB ukuze ingezelele ulwazi olujulile lwe-ToF. Ocwaningweni lwe-ECCV 2022, iphutha layo lesilinganiso sokujula lehliswe ngo-23% uma liqhathaniswa nezindlela ezivamile futhi ukusebenza kahle kwayo kwekhompyutha kukhuphuke ngo-40%, okuyenza ifanelekele amadivayisi avinjwe izinsiza njengamatheminali eselula.
2.I-Hardware design: i-modularization kanye nokuhlanganiswa kwamandla
Ukusungulwa kwezinga lezingxenyekazi zekhompuyutha kuyisisekelo sokuthuthukisa ukunemba. Imojuli ye-Ouster's Femto-W isebenzisa ubuchwepheshe be-iToF ukuze ifinyelele ukunemba kwemilimitha phakathi kwebanga lamamitha angu-0.2-2.5, ihlanganisa inkundla yamandla ekhompuyutha ejulile, futhi ayidingi ukusekela kwamandla ekhompuyutha angaphandle. Idizayini yayo ebanzi kakhulu (inkundla yokubuka engu-120°) ingathwebula ulwazi lwendawo olubanzi, futhi ukukhishwa kwefomethi ye-Y16 yedatha ye-infrared nokujula inikeza idatha yokwethembeka okuphezulu yokumodela indawo.
Ngezidingo zokukhiqiza ngobuningi, imojula ibheka ukusebenza kahle kokulinganisa emgqeni wokukhiqiza ngesikhathi sokukhetha ihadiwe, ithuthukisa isivuno ngobuchwepheshe bokulinganisa okukodwa, kanye nemisebenzi eyinkimbinkimbi efana nokuqashelwa kobuso be-3D, i-SLAM, njll.
3.I-Multi-Sensor Fusion: Ukusungula Uhlelo Lokubona Olunezinhlangothi Ezintathu
Izinzwa ze-Mono ToF zisenemikhawulo ekukhanyeni okuyinkimbinkimbi noma izimo ezinokwakheka okuphansi. Ngokuhlanganisa idatha enezimo eziningi njenge-RGB ne-IMU, kungakhiwa isistimu yokubona ukujula okuphelele. Isibonelo, umsebenzi werula we-AR we-Meizu 18 Pro uhlanganisa idatha yokujula kwe-ToF nolwazi lwesimo se-IMU ukuze kuzuzwe ukunemba kokulinganisa ibanga lesentimitha. Uhlaka lwe-DELTAR, i-algorithm yokuqondanisa isici, ukubhaliswa kweleveli ye-pixel yemephu yokujula ye-ToF nesithombe se-RGB, kuqeda amaphutha e-parallax futhi kuthuthukise ukunemba kokuma kwendawo kwezinto ezibonakalayo.
Ngokungeziwe kuzigcawu eziguqukayo, ukuhlanganiswa kwezinzwa eziningi kungaxazulula ngempumelelo inkinga yokufiphala kokunyakaza. Ngokuqoqa ngokuvumelanisa idatha ye-ToF ne-RGB, kanye nokuhlanganisa i-algorithm yokuthuthukisa ukulandelana kwesikhathi, isistimu ngesikhathi sangempela ilungisa ukuchezuka okujulile okubangelwa ukunyakaza, iqinisekisa ukuzinza kokusebenzelana kwe-AR.
4.Ukuzijwayeza kwesicelo kanye namathrendi esikhathi esizayo
Njengamanje, amamojula amalensi e-ToF azuze ukuphumelela kwezinhlelo zokusebenza kumakhalekhukhwini we-AR. Umsebenzi wokufiphalisa wesikhathi sangempela wevidiyo we-Meizu 17 Pro, ngenjini yokujula ye-ToF, ubona ukuhlukaniswa okunembayo kwengemuva nesihloko, futhi ukuguqulwa kokufiphala kungokwemvelo; isixazululo esenziwe ngokwezifiso se-Orbbec ye-18 Pro sisekela imisebenzi emisha njengokubona kwe-AR, enweba umngcele wohlelo lokusebenza lwe-AR endaweni enokukhanya okuphansi. Ngokuzayo, ngokuthuthukiswa kwama-algorithms angasindi kanye nezingxenyekazi zekhompuyutha zamandla aphansi, amamojula e-ToF azoshintsha osayizi abancane nezindleko eziphansi, akhuthaze ukuthandwa kobuchwepheshe be-AR ekhaya elihlakaniphile, ukuhlolwa kwezimboni neminye imikhakha.
Ukuthuthukiswa kokunemba kombono wokujula kwemojula yelensi ye-ToF ukuze kuncike ekuthuthukisweni okudidiyelwe kokuthuthukiswa kwe-algorithm, ukusungulwa kwehadiwe kanye nokuhlanganisa izindlela eziningi. Ngokuthuthuka okuqhubekayo kwezingqinamba zobuchwepheshe, i-ToF izoba amandla okushayela asetshenziswayo ukuze afinyelele "ukuhlanganiswa okungenazihibe kokubonakalayo nokwangempela", okulethela abasebenzisi umuzwa ogxile kakhulu nonembe kakhudlwana.