Ukulungisa i-ISP Yemojula Yekhamera: Ukulinganisa Ukubukhali, Umsindo, Nombala

Kwadalwa ngo 09.10
Yonke imojuli yekhamera ihamba nezingxenyekazi zenzwa ezifanayo ezingahluziwe, nokho izinga lokugcina lesithombe lingahluka kakhulu. Umehluko ulele cishe ngokuphelele ekulungiseni kwe-ISP—inqubo ethule, ephindaphindwayo yokulinganisa isicubunguli sesignali yesithombe ukuze kukhishwe umphumela ongcono kakhulu ovela kunhlanganisela yenzwa nelensi ethile. Emiqenjini yobunjiniyela eyakha imikhiqizo yombono ofakiwe, ukuthola le nsimbi ilingana kuhlukanisa ikhamera emaphakathi kuleyo ezizwa njengephezulu ngempela.
Inselelo ukuthi ukubukhali, ukunciphisa umsindo, nokunemba kombala akukho ngokwahlukana. Qhubekisela phambili ipharamitha eyodwa kakhulu, kanti enye yehla. Khuphula ukubukhali kufike emkhawulweni kanti ukhulisa umsindo futhi udale iziyingi zomphetho ezimbi. Sebenzisa ukunciphisa umsindo okunamandla kanti ususa imininingwane emihle futhi ukhiqize ukubukeka okufana nepulasitiki, okufana nengcina. Khuphula ukugcwala kombala ukwenza izithombe ziqhame kanti ulahlekelwa imibala yemvelo yesikhumba futhi wethule ukunqanyulwa kombala. Ukulungisa i-ISP akukhona mayelana nokwandisa noma iyiphi imethrikhi eyodwa; kumayelana nokuklama ukushintshana ngamabomu okuhambisana nesimo sokusetshenziswa esihlosiwe.
Lesi sihloko sihlaziya izindlela ezingokoqobo zokulungisa i-ISP, sichaze ukuthi kungani ukulinganisela kwezinhlangothi ezintathu kunzima ngokwemvelo, futhi sinikeze izinhlaka ezingasetshenziswa amaqembu okulungisa asebenza ku-amakhamera e-USB, amasistimu okubona ashumekile, kanye namamojuli ezimboni akhethekile.

I-ISP Pipeline: Lapho Ikhwalithi Yesithombe Yenziwa Khona Ngempela

Ngaphambi kokungena emininingwaneni yokulungisa, kuyasiza ukuqonda ukulandelana kwemisebenzi ngaphakathi kwesicubunguli sesignali yesithombe esijwayelekile. Ukulandelana kubalulekile ngoba isinyathelo ngasinye sokucubungula sithinta esilandelayo, futhi izinqumo zokulungisa ekuqaleni kwe-pipeline zidlulela kuzo zonke izigaba ezingezansi.
Idatha eluhlaza yenzwa iqala ngokungena kwibhulokhi yokulungisa izinga elimnyama, lapho kususwa khona ukuhlehla kwamanje okumnyama kwenzwa. Okulandelayo ukulungiswa kokukhanya kwelensi, okunxephezela ukwehla kokukhanya kwemvelo ngasemakhoneni esithombe okubangelwa amehlo elensi. Ukulungiswa kwamaphikseli angalungile kulandela, kukhomba futhi kushintshe amaphikseli angalungile okungenzeka abonakale njengamachashaza agqamile noma amnyama.
Kusuka lapho, i-pipeline ingena ku-demosaicing—inqubo eguqula i-Bayer-patterned raw grid ibe yisithombe se-RGB esigcwele umbala. Lesi ngesinye sezigaba ezibaluleke kakhulu kukho kokubili ukubukhali nombala, njengoba i-algorithm ye-demosaic engalungile yethula ama-zipper artifacts emaphethelweni futhi idlulisele umbala emingceleni ye-luminance.
Ngemva kwe-demosaicing, ama-core tuning blocks ayathatha: ukunciphisa umsindo, ukubukhali, ukusetshenziswa kwe-color correction matrix, i-white balance, i-gamma correction, nokuthuthukisa umphetho. Amanye ama-blocks angase afake ukulungisa i-chromatic aberration, ukucindezela kwe-dynamic range, kanye ne-tone mapping yezigcawu ze-high-dynamic-range.
Okwenza ukulungisa kube nzima ukuthi lezi zingxenye azizimele. Ukunciphisa umsindo okusetshenziswa ngaphambi kokucija kuzonciphisa ukucija okubonakalayo. Ukucija okusetshenziswa ngaphambi kokunciphisa umsindo kuzokhulisa umsindo. Amatrix wokulungisa umbala asebenzisana nokulinganisela okumhlophe ngezindlela ezingabonakali. Abalungisi abanekhono abalungisi ipharamitha ngayinye ngokwayo; baqonda uchungechunge lwezimbangela futhi baphinda basebenze kuzingxenye eziningi ngesikhathi esisodwa.

Ukulungisa Ukubukhali: Okungaphezu Nje Kokukhuphula Isinzuzo Somphetho

Ukubukhali yikhwalithi ebonakala ngokushesha kunazo zonke, futhi futhi isetshenziswa kabi kaningi. Amaqembu amaningi omkhiqizo athanda ukusebenzisa amanani aphezulu okulungisa ukubukhali ngoba izithombe zibonakala zihlaba umxhwele kakhulu kumademo asebenzisana. Ekusetshenzisweni kwangempela, nokho, izithombe ezilungiswe ngokweqile zibonakala zingokwemvelo futhi ziyakhathaza ukuzibuka.

Yini Empela Edala Ukubukhali Okubonakalayo

Ukucija okubonwayo kuvela ezinqubweni ezintathu ezihlukene ezisebenza ndawonye: ukucaca kwelensi, ukusampula kwenzwa, kanye nokuthuthukisa umkhawulo we-ISP. Ilensi nenzwa zibeka umkhawulo ophezulu womzimba wokuthwebula imininingwane; i-ISP ayikwazi ukudala ulwazi olungakaze luqoshwe. Lokho engakwenza ukukhulisa ukugqama kwendawo emikhawulweni ukuze izinguquko zibonakale zicija kuhlelo lokubona lomuntu.
Imaski engacacile evamile isebenza ngokudala ikhophi efiphele yesithombe, iyikhiphe kwesokuqala, bese yengeza umehluko emuva ngamandla alawulwayo. Lokhu kudala i-halo ekhanyayo ecashile ohlangothini olulodwa lomkhawulo kanye ne-halo emnyama kolunye. Ubuchopho butolika lezi zinto njengokwenyuka kokucija. Uma umphumela ucashile, ababukeli abakwazi ukubona umkhondo; uma weqile, ama-halo abonakala njengemigqa emhlophe ewugqinsi ezungeze izinto.

Amapharamitha Okulungisa Abalulekile

Ukulungisa ukucija okuphumelelayo kudinga ukulungisa okungenani amapharamitha amane ngokuhlanganyela:
• Ukuzuza/Inani: Kulawula ukuthi ingakanani ingxenye yesignali yomphetho engezwa emuva. Amanani aphezulu akhiqiza ukucija okuqinile kodwa ama-artifact abonakalayo amaningi.
• Ibanga: Linquma usayizi we-blur kernel esetshenziselwa ukudala imaski. Amaradiya amancane akhomba imininingwane emihle; amaradiya amakhulu athinta imiphetho ebanzi.
• I-Threshold: Ibeka umehluko omncane wokuphikisana odingekayo ngaphambi kokuba ukubukhali kusetshenziswe. Ukukhulisa i-threshold kuvikela izindawo ezisicaba ekubukhisweni futhi kunciphisa ukukhulisa umsindo.
• I-Coring: Icindezela ukubukhali ezindaweni ezinokuphikisana okuphansi ikakhulukazi ukugwema ukuthuthukisa izinhlamvu zomsindo.
Ama-tuner amaningi amasha emsebenzini agxila kuphela kunobho lokuthola inzuzo futhi angakunaki irediyasi, umkhawulo, kanye ne-coring. Umphumela yizithombe ezibukeka zinzima futhi zinomshoshaphansi ngisho nasemazingeni okulola aphakathi nendawo. Indlela engcono iwukuqala ngenzuzo elinganiselayo, ukwenza ngcono irediyasi yesisombululo sendabuko sensa, nokusebenzisa umkhawulo kanye ne-coring ukuvikela izindawo ezibushelelezi njengezulu nesikhumba.

Ukulola Okuhlukaniswe Ngemvamisa

Izakhiwo zesimanje ze-ISP zisekela ukulola kwezigaba eziningi noma okuhlukaniswe ngemvamisa, lapho amazinga ahlukene amandla asetshenziswa emvamisweni yemininingwane emincane, ephakathi nendawo, kanye namakhulu. Leli yisu elinamandla ngoba livumela ama-tuner ukuthi athuthukise imiphetho yemvamisa ephakathi nendawo—lapho iningi lemikhawulo yezinto lihlala khona—ngaphandle kokukhulisa umsindo wemvamisa ephezulu ohlupha ezimweni zokukhanya okuphansi.
Ngokwesibonelo, kumamojula ekhamera ye-USB ahloselwe izingqungquthela zevidiyo zekhompyutha, iphrofayela yokulungisa evamile isebenzisa ukucija okulingene kumafrikhwensi aphakathi nendawo, ukucija okuncane kakhulu kumafrikhwensi aphezulu, futhi cishe akukho kokucija kakhulu kuzinhlamvu ezincane kakhulu. Lokhu kwenza ubuso bubukeke ngokwemvelo kuyilapho kulondolozwa imibhalo nemiphetho yezinto.

Ukunciphisa Umsindo: Ukulondoloza Imininingwane Kuyilapho Kucindezelwa Ukugqwala

Umsindo uyisitha esingapheli sekhwalithi yesithombe, futhi uba kubi kakhulu ngokuphindwe kaningi njengoba amazinga okukhanya ehla. Usayizi wenzwa, ububanzi bephikseli, kanye nokuzuza kwe-analogi konke kunomthelela ekutheni umsindo ungakanani ovela kufreyimu eluhlaza, kodwa ukunciphisa umsindo kwe-ISP kunquma ukuthi lowo msindo uhlala ubonakala kangakanani kumphumela wokugcina.

Ukuqonda Izinhlobo Zomsindo

Akulona lonke umsindo ofanayo, futhi ukulungisa okusebenzayo kudinga ukubhekana nhlobo ngayinye ngethuluzi elifanele.
Umsindo wesikhathi uyahlukahluka ngokungahleliwe kusukela kufreyimu kuya kufreyimu futhi uhlanganisa umsindo wokudutshulwa kwe-photon kanye nomsindo wokufunda. Umsindo wokudutshulwa ulandela izibalo ze-Poisson futhi ungokwemvelo ekukhanyeni uqobo; awukwazi ukuqedwa, kuphela ukuphathwa. Umsindo wokufunda uvela kuma-electronics wenzwa futhi ubonakala kakhulu emathunzini ajulile kanye nasezuzweni eziphezulu ze-ISO.
Umsindo wendawo uhlanganisa umsindo wephethini engaguquki kanye nomsindo wekholomu ovela ezindaweni ezifanayo kuwo wonke amafreyimu. Lokhu ngokuvamile kuphathwa ngokulinganisa kwefektri kanye nokulungiswa kwezinga elimnyama esikhundleni sebhlokhi eliyinhloko yokunciphisa umsindo.
Umsindo we-chroma ubonakala njengamachashaza anemibala, ikakhulukazi ezindaweni ezimnyama. Uhlelo lokubona lomuntu lusabela kakhulu emininingwaneni yokukhanya kunemininingwane yombala, ngakho-ke umsindo we-chroma ungabusheka ngamandla ngaphandle kokulahlekelwa okuncane kokubona. Yingakho amaphrofayili amaningi okulungisa amahle esebenzisa ukunciphisa umsindo okunamandla kumashaneli e-Cb ne-Cr kunakushaneli ye-Y.

Ukushintshana Kwemininingwane Nokubusheka

Inkinga eyisisekelo yokunciphisa umsindo ukuthi ama-algorithms awakwazi ukuhlukanisa ngokuphelele phakathi kwemininingwane emihle kanye nokusanhlamvu komsindo. Kokubili kubonakala njengokuhluka kwamaza aphezulu esithombeni. Ukunciphisa umsindo okunamandla kususa ukusanhlamvu kodwa futhi kususa ukuthungwa, amaphethini endwangu, izinwele, kanye nombhalo omncane. Umphumela yilokho okwaziwa ngokuthi umphumela "wombala wamanzi" noma "wesikhumba sepulasitiki" ovamile kumakhamera asemazingeni aphansi kanye namamojuli e-USB ashibhile.
Ama-ISP ayinkimbinkimbi asebenzisa ukuhlunga okubheka emaphethelweni noma okubili okusebenzisa amandla ahlukene okunciphisa umsindo kuye ngokuthi iphikseli ihlezi emaphethelweni noma endaweni eyisicaba. Emaphethelweni, ukunciphisa umsindo kuyancishiswa ukuze kugcinwe ukubukhali; ezindaweni eziyisicaba njengezindonga nesibhakabhaka, kuyandiswa ukuze kubukeke kuhlanzekile.
Ngisho nangokuhlunga okubhekelela emaphethelweni, kunezingqinamba. Ekukhanyeni okuphansi kakhulu lapho ubukhulu bomsindo busondela ezingeni lemininingwane yangempela, akukho kulungisa okungenza ukuhlukanisa lezi zinto zombili ngokuphelele. Ngaleso sikhathi, ithimba lokulungisa kufanele lenze isinqumo sangamabomu: ukwamukela umsindo obonakalayo kodwa kugcinwe imininingwane, noma kusheleliswe kakhulu bese kwamukelwa isithombe esithambile. Ayikho impendulo elungile yonke indawo; isinqumo esifanele sincike ngokuphelele emakethe okuhloswe ngayo umkhiqizo kanye nokusetshenziswa kwawo.

Ukuncishiswa Komsindo Ngezikhathi Eziningi

Ezinhlelweni ezingaguquki zendawo ezifana namakhamera okuqapha kanye nokuskana kwamadokhumenti, ukuncishiswa komsindo kwesikhathi esiningi ngamafreyimu amaningi kunikeza indlela yokugwema ukushintshana kwefreyimu eyodwa. Ngokuhlela nokulinganisa amafreyimu amaningi alandelanayo, ingxenye yomsindo ongenasizathu iyanyamalala kuyilapho imininingwane yangempela yendawo isala. Lokhu kungakhiqiza ukuthuthukiswa komsindo okusebenzayo okuzingiwe eziningi ngaphandle kokulahlekelwa ukubukhali.
I-Multi-frame NR inezinselelo zayo zokulungisa, nokho. Ukunyakaza phakathi kwamafreyimu kubangela ama-ghosting artifacts uma i-algorithm yokulungisa ingaqinile ngokwanele. Abalungisi kufanele balungise imikhawulo yokutholwa kokunyakaza, izilinganiso zokuhlanganisa, nokuziphatha kokubuyela emuva ukuze kulinganiswe ukusebenza komsindo ngokumelene nama-artifacts okunyakaza. Ezigcawini ezinokunyakaza okulingene, indlela eyingxubevange isebenzisa i-temporal NR egcwele ezindaweni ezinganyakazi futhi ibuyele ku-spatial NR ezintweni ezinyakazayo.

Ukulungisa Umbala: Ukunemba, Okuthandwayo, Nokungaguquguquki

Umbala uyingxenye yekhwalithi yesithombe ethandwa kakhulu futhi futhi ingenye yezinto ezinzima kakhulu ukuyenza kahle. Wonke umuntu ubona umbala omubi uma ewubona, kodwa ukuchaza umbala "omuhle" kuyinto enzima ngendlela emangalisayo. Izimakethe ezahlukene, izinhlelo zokusebenza, kanye nezibalo zabasebenzisi zinezintando ezahlukene zombala.

I-Matrix Yokulungisa Umbala

Umnyombo wokuhlela imibala i-3×3 color correction matrix, noma i-CCM. Ukusabela kwemvelo kwe-spectral kwesenzwa akuhambisani ne-sRGB ejwayelekile noma i-Rec. 709 color space; i-CCM iguqula amanani e-RGB esenzwa ibe yi-color space ejwayelekile ngokusebenzisa ukuguqulwa okulandelanayo kumashaneli amathathu.
Ukuhlelwa kwe-CCM ngokuvamile kwenziwa ngokuthwebula ishadi lombala elilinganiselwe ngaphansi kwezikhanyisi ezaziwayo nokuxazulula amanani e-matrix anciphisa iphutha lombala, ngokuvamile elikalwa ngamayunithi e-ΔE (delta E). I-ΔE ephansi isho ukukhiqizwa kombala okunembile.
Kodwa ukunemba kwezinombolo okuphelele akuhlali kukhiqiza izithombe ezithokozisayo kakhulu ngokubonakalayo. Amathimba amaningi okuhlela ngamabomu aphambuka ku-ΔE encane ukuze enze imibala ethile yememori—imibala yesikhumba, amaqabunga, uluhlaza sasibhakabhaka—ibonakale ithokozisa kakhulu. Imibala yesikhumba, ikakhulukazi, ibucayi kakhulu; ababukeli bazobona ukushintsha okuncane kumbala wesikhumba ngokushesha okukhulu kunokuba bazobona ukushintsha okukhulu kumbala wento engahleliwe.

Ukulinganisa Okumhlophe Nobunkimbinkimbi Bako Obufihlekile

Ukulinganisa okumhlophe kubonakala kulula ebusweni: lungisa izinzuzo ze-RGB ukuze izinto ezingathathi hlangothi zibonakale zingathathi hlangothi ngaphansi kwanoma yimuphi umthombo wokukhanya. Empeleni, ukulinganisa okumhlophe okuzenzakalelayo kungenye yezinhlelo ze-ISP ezinzima kakhulu ukulungisa kahle.
Inselele eyinhloko ukuthi ikhamera ayikwazi ukwazi ukuthi yini empeleni emhlophe esigcawini. Kufanele icabange umbala wokukhanya kusuka ezicini zezibalo zesithombe. Ama-algorithms alula e-gray-world acabanga ukuthi umbala ojwayelekile womhlaba umpunga; ama-algorithms athuthuke kakhulu asebenzisa ukutholwa kwamachashaza akhanyayo, ukulinganisa izinga lokushisa kombala, kanye nezibalo ze-Bayesian ukwenza ukuqagela okungcono.
Ukulungisa i-AWB kuhlanganisa ukulungisa ukuzwela kumazinga okushisa ombala ahlukene, ukusetha isivinini sokuhlangana ukuze ibhalansi ingagxumi phakathi kozimele, kanye nokusungula amaphoyinti okuchema emithonjeni yokukhanya evamile. Imikhiqizo eminingi ihluleka hhayi ngoba inzwa yayo imbi kodwa ngoba i-AWB yayo iyaduka ngaphansi kokukhanya okuxubile, ikhiqize umbala oluhlaza okotshani noma onsomi odonsa amehlo ngokushesha.

Ukugcwala Kombala Uma Kuqhathaniswa Nokwemvelo

Ukulungisa ukugcwala kombala kuhamba emkhawulweni phakathi kokugqamile nokwenziwe. Ukukhuphula ukugcwala kombala kwenza izithombe zomkhiqizo zigqame futhi kunikeze izigcawu zangaphandle ukubukeka okuluhlaza nokukhanga. Uma ukuqhubekisela phambili kakhulu, nokho, imibala iyanqanyulwa, imininingwane iyakhukhuleka ezindaweni ezibomvu neziphuzi, futhi isikhumba sithatha ukubukeka okungokwemvelo kokushiswa yilanga.
Iphrofayela yokulungisa ebuyekeziwe isebenzisa amazinga okugcwala ahlukene ngesifunda sombala kunokusebenzisa isilayida eyodwa yomhlaba wonke yokugcwala. Amathoni esikhumba angagcinwa ehlehlisiwe kancane futhi eshintshwa ebheke ku-eksisi ephuzi-magenta abantu abayithola ikhanga kakhulu, kuyilapho okuluhlaza okwesibhakabhaka nokuluhlaza kungakhushiswa ukuze kuthandeke indawo. Okubomvu ngokuvamile kuphathwa ngokucophelela ngoba ukunqanyulwa kwesiteshi esibomvu kubonakala kakhulu futhi kuyacasula.

Ukulinganisela Kwezindlela Ezintathu: Kungani Kungekho Silungiselelo Eliphelele

Manje sekufanele kucace ukuthi kungani ukulungisa i-ISP kuyisenzo sokulinganisela. Isisekelo ngasinye kwezintathu—ukubukhali, umsindo, nombala—sisebenzisana nezinye, futhi ukwenza kahle isici esisodwa kuhlala kunemiphumela kwezinye ezimbili.
Cabanga ngesimo esivame kakhulu: indawo yangaphakathi enokukhanya okuphansi. Ukuze uthole isithombe esikhanyayo, wenyusa i-analog gain. I-gain ephezulu ngokushesha yenyusa umsindo. Ukuze unxephezele lokho, wenyusa ukunciphisa umsindo. Ukunciphisa umsindo okunamandla kuthambisa imininingwane emincane futhi kunciphisa ukubukhali okubonakalayo. Ukuze unxephezele lokho, wenyusa ukubukhali. Kodwa ukubukhali kukhulisa noma yimuphi umsindo osele futhi kungangenisa izinto ezingcolile emaphethelweni. Futhi kukho konke lokhu, i-gain ephezulu ishintsha isiphektrum somsindo, okushintsha indlela i-color correction matrix esebenza ngayo, okungase kungenise ukugqama kombala ezindaweni ezinomthunzi.
Isinyathelo ngasinye siyimpendulo esinyathelweni esedlule. Akukho knob ongayiphendula eyenza konke kube ngcono ngesikhathi esisodwa.

Uhlaka Lukanxantathu Wokulungisa

Amathimba anolwazi lokulungisa acabanga ngendlela kanxantathu onezici zokubukhali, ukuhlanzeka komsindo, nombala wemvelo emakhoneni. Noma yisiphi isinqumo sokulungisa sihambisa isithombe emkhawulweni owodwa noma ngaphezulu walo nxantathu. Umgomo awukona ukufinyelela kuwo womathathu amakhona ngesikhathi esisodwa—lokho akunakwenzeka ngokwezibalo—kodwa ukufika endaweni kanxantathu esebenzela kahle kakhulu umsebenzi womkhiqizo.
Ngokwesibonelo, kukhamera yokuskena imibhalo, ukubukhali nokufundeka kombhalo kubaluleke kakhulu. Umsindo awubalulekile kangako ngoba imibhalo ivamise ukuskenwa ekukhanyeni okuhle. Ukunemba kombala kusezingeni lesithathu; umbhalo umnyama nomhlophe, futhi ukushintsha kombala okuncane kwamukelekile. Ukulungisa kugxila ngokuqinile ekhoneni lokubukhali, kanti ukunciphisa umsindo nokuphathwa kombala kusethwe emazingeni alondolozayo, angaphazamisi.
Kwikhamera yewebhu eqondiswe ngokuma, izinto ezibalulekile ziyaguquka. Umbala wesikhumba wemvelo kanye nokuthungwa kwesikhumba okushelelayo yizona zici ezibaluleke kakhulu. Ukuthambileka okulingene kwamukelekile—ababukeli empeleni bathanda isikhumba esithambile kancane kunama-pore abukhali ngokwezempilo. Ukunciphisa umsindo kulungiswa ngamandla eziteshini ze-chroma futhi ngokulingene kuma-luma. Ukucija kusetshenziswa kancane futhi kuphela kumafrikhwensi aphakathi nendawo ukuze imiphetho yobuso ichazwe kodwa ukuthungwa kwesikhumba kungabukezwa ngokweqile.
Kwikhamera yezokuphepha yangaphandle, izinto ezibalulekile ziyashintsha futhi. Ukusebenza komsindo ebusuku kubaluleke kakhulu, ngakho-ke ukunciphisa umsindo kusethwa phezulu futhi ukunciphisa umsindo kwesikhashana kuvulwa. Ukunemba kombala akubalulekile kangako kunokuhlonza okungaguquki; imibala encishisiwe kancane, ezinzile incanyelwa kunemibala enembile kodwa eshintshayo ngaphansi kokukhanya kwemigwaqo okuhlukahlukayo. Ukucija kulungiselwa ukugcina imiphetho yezinto kanye nezici ezibonakalayo kude, ngisho noma ukuthungwa okucolekile kulahleka.
Awekho kulezi zikhangiso 'angcono' kunezinye. Ngayinye ilungele umsebenzi wayo ohlosiwe. Iphutha elikhulu elenziwa amaqembu omkhiqizo ukucela ukubukhali okuphezulu, umsindo ongenalutho, nombala ophelele ngasikhathi sinye, ngaphandle kokuqaphela ukushintshana okungokwemvelo.

Indlela Yokulungisa: Kusuka Ekulinganiseni Kuya Ekulungiseni Kahle

Indlela yokulungisa ehlelekile ikhiqiza imiphumela engaguquki, ephindaphindekayo futhi igwema ugibe oluvamile lokulungisa okungapheli okusekelwe emibonweni engachemi.

Isigaba 1: Ukulinganisa Okuyisisekelo

Inqubo iqala ngokulinganisa okunengqondo ngaphansi kokukhanya okulawulwayo. Amashadi okuhlola ajwayelekile—i-X-Rite ColorChecker yombala, amashadi e-ISO 12233 wokucaca, amashadi amaqabunga afile womsindo nokuthungwa—athwetshulwa emazingeni amaningi okukhanya namazinga okushisa kombala.
Idatha eluhlaza iqoqwa, futhi amanani okuqala abalwa ezingeni elimnyama, ukukhanya kwelensi, amaphuzu ayisisekelo okulinganisa okumhlophe, kanye ne-matrix eyisisekelo yokulungisa umbala. Lokhu kwakha isisekelo esingathathi hlangothi nesinembile esilungiselelwe izinkomba zezinombolo kunokuba sithandeke ngokubonakalayo.

Isigaba 2: Ukulungisa Okusebenzayo

Njengoba isisekelo sikhona, abalungisi bahamba nge-pipeline ngokulandelana kokucubungula, balungisa ibhlokhi ngayinye futhi bakale umphumela ezinkombeni zokuhlola. Amazinga okunciphisa umsindo asetwa esinyathelweni ngasinye sokuzuza. Amapharamitha okulola alungiswa kubhendi ngayinye yemvamisa. Ukuguqulwa kombala kulungiselwa imibala yenkumbulo ethandwayo.
Kulesi sigaba, abalungisi bathembela kakhulu ezilinganisweni eziqondile: amanani e-MTF50 okulola, izilinganiso ze-SNR zomsindo, kanye nezilinganiso ze-ΔE zokunemba kombala. Lezi zinombolo zinikeza iphuzu elilodwa lesithenjwa futhi zivimbela ukulungisa ukuthi kungadluleli endaweni yokucabanga komuntu siqu kuphela.

Isigaba 3: Ukucwengwa Ngokomcabango

Izilinganiso ezinenjongo zitshela ingxenye yendaba kuphela. Uhlelo lokubona lomuntu alwahluleli izithombe ngamajika e-MTF nezibalo ze-ΔE. Umzamo wokugcina wokulungisa uhlala uhlanganisa ukuhlola izigcawu zangempela—ubuso, izindawo zasendlini, izindawo zangaphandle, izimo ezinzima zokungafani kokukhanya—kanye nokwenza izinguquko ezingachemile.
Yilapha lapho abalungisi abanolwazi bathola khona inani labo. Bayazi ukuthi yikuphi ukushintshana kwezinombolo okukhiqiza imiphumela engcono ngokombono. Bayazi, isibonelo, ukuthi ukwanda okuncane komsindo obonakalayo kufanelekile uma kugcina ukuthungwa kobuso obekuzosulwa. Bayazi ukuthi yikuphi ukushintsha kombala ababukeli abakuthola kungamukeleki nokuthi yikuphi okungaqashelwa noma okuthandwa kakhulu.
Ukulungisa ngokombono kufanele kuhlale kwenziwa kudivayisi yombukiso eqondiwe yangempela nasezimeni zokubuka ezijwayelekile. Isithombe esilungiswe kusilawuli se-studio esezingeni eliphezulu singabonakala sihluke ngokuphelele kusikrini sekhompyutha esijwayelekile noma kusakaza ividiyo ecindezelwe.

Ukucatshangelwa Okukhethekile Kwezinto Zekhamera Ezifakwe Ngaphakathi Ne-USB

Iningi lemibhalo yokulungisa i-ISP livela emhlabeni wama-smartphone, kodwa amamojula okubona afakwe ngaphakathi namakhamera e-USB abhekana nezinkinga zawo ezishintsha ukubalwa kokulungisa.

Imikhawulo Yamandla Okucubungula

Ama-ISP afakwe ngaphakathi namachiphi okuxhuma e-USB ngokuvamile anezinsiza zokucubungula ezilinganiselwe uma kuqhathaniswa ne-silicon yefoni esezingeni eliphezulu. Ama-algorithms athuthukile afana ne-multi-frame NR, ukususa umsindo nge-AI, nokucijisa okuhlukaniswe ngemvamisa kungenzeka angatholakali nhlobo, noma angasebenza kuphela ngesisombululo esincishisiwe noma izinga lamafreyimu.
Ukulungisa ingxenyekazi enemingcele yezinsiza kusho ukusebenza ngaphakathi kwamakhono e-ISP yangempela esikhundleni sokufisa ama-algorithms angcono. Izihlungi ezilula zokunciphisa umsindo kufanele zilinganiswe ngokucophelela okukhulu ngoba azinakho ukuqaphela imiphetho okunamapayipi asezingeni eliphezulu. Ukucijisa kwesigaba esisodwa kufanele kusethwe ngokucophelela ngoba ayikho indlela yesibili yokucima ama-artifact.

Ama-Optics Angaguquki kanye Nokugxila Okungaguquki

Amamojula amaningi ekhamera yezimboni kanye ne-USB asebenzisa amalensi agxilile anezimbobo ezingaguquki. Ngokungafani namakhamera e-smartphone, awukho umgodi oguqukayo noma ukugxila okuzenzakalelayo okuzivumelanisa nezimo ezahlukene. Iphrofayela yokuhlelwa kufanele isebenze kulo lonke uhla lokusebenza kwelensi, kusukela ebangeni elincane lezinto kuya kokungapheli.
Lokhu ngokuvamile kusho ukwamukela ukubukhali okuphezulu okuncane kancane ukuze kutholakale ukusebenza okulinganayo kulo lonke uhlaka nakuwo wonke amabanga. Ilensi ebukeka kahle kakhulu emetheni elilodwa kodwa ehluleka emetheni amathathu ngokuvamile imbi kakhulu kumkhiqizo ogxilile kunalena ehlinzeka ngokusebenza okuqinile nokungaguquki kuyo yonke indawo.

Ukucaciswa Kwesimo Sokusetshenziswa

Amamojula ekhamera ashumekiwe ngokuvamile aklanyelwe umsebenzi owodwa othile: ukuskena ikhodi yebhakhodi, ukubonwa kobuso, ukukala izinga lokushisa komzimba, ukuhlolwa kwezimboni. Ngakunye kwalokhu kunezinto ezihluke ngokuphelele ezibalulekile mayelana nekhwalithi yesithombe.
Esibonelweni sesikena sebhakhodi, ukugqama nokucaciswa kwemingcele yikho konke. Ukunemba kombala akubalulekile. Umsindo ubalulekile kuphela uma uvimbela ukuhunyushwa kwekhodi. I-ISP kufanele ilungiselelwe ukugqama okuphezulu kwemingcele nokucaca kokubili, ngisho noma izithombe eziphumayo zibukeka zizimbi kakhulu ekuthwebuleni izithombe okuvamile.
Kumojula yokubona ubuso nge-biometric, ukukhiqizwa kombala wesikhumba okungathathi hlangothi nokusabela kokukhanya okungaguquguquki kubaluleke kakhulu kunokucaca kwezinga lephikseli. I-algorithm idinga izici zobuso ezingaguquguquki ngaphansi kwezimo zokukhanya ezahlukene; ukuhlelwa kombala kobuciko kulimaza kuphela ukunemba kokubona.

Iqhaza le-AI Ekulungiseni kwe-ISP Yesimanje

Ukucutshungulwa kwe-AI kanye nenethiwekhi yezinzwa kusaqala ukuguqula ukulungiswa kwe-ISP, kodwa hhayi ngendlela abantu abaningi abacabanga ngayo. Ushintsho olunomthelela omkhulu akulona izithombe "eziphelele" ezikhiqizwa yi-AI kodwa ukulungiswa okusizwa yi-AI okunciphisa umsebenzi wokwenziwa ngesandla odingekayo ukuze kuqalwe inzwa entsha.
Ukulungiswa kwe-ISP kwendabuko kudinga amaviki omsebenzi wokuphinda-phinda owenziwa unjiniyela onolwazi kwinhlanganisela ngayinye entsha yenzwa nelensi. Amathuluzi okulungisa asizwa yi-AI angakwazi ukukhiqiza ngokuzenzakalela amanani ayisisekelo e-CCM, amaphrofayili okunciphisa umsindo, nezilungiselelo zokucijisa ngokuhlaziya idatha yeshadi lokuhlola. Lokhu kunciphisa kakhulu isikhathi sokufinyelela isisekelo esihle, kushiya abalungisi abangabantu bekhululekile ukugxila ekucwengweni okubonakalayo, okuncike ekusetshenzisweni okuthile okusadinga ukwahlulela komuntu.
Ohlangothini lokucubungula, ukuncishiswa komsindo we-neural kanye ne-AI demosaicing sekuqala ukuvela kuma-ISP asezingeni eliphezulu. Lawa mamodeli angahlukanisa imininingwane kumsindo ngempumelelo enkulu kunezindlela zendabuko ezisekelwe kuzihlungi, okushintsha imingcele kanxantathu wokugqama-umsindo-umbala ngokuphumela ngaphandle. Avumela izithombe ezihlanzekile emazingeni okukhanya aphansi ngokulahlekelwa imininingwane okuncane.
Ukucubungula nge-AI akusona isidlo samahhala, nokho. Kudinga amandla okucubungula amakhulu, kwethula ukubambezeleka, futhi kungakhiqiza isethi yayo yezinto ezingezona ezingokwemvelo lapho iqeqeshwa kudatha engafanele. Eziningi zomkhiqizo wamakhamera e-embedded kanye ne-USB namuhla, ukulungisa kwe-ISP kwendabuko kuseyisinqumo esisebenzayo.

Izinqubo Ezinhle Zokulungisa Ezisebenzayo

Ngemva kokusebenza emishini yamakhamera amaningi kuzinhlelo zomsebenzisi, zezimboni, kanye nezezimoto, izinqubo ezinhle ezimbalwa ezivumelanayo ziyavela.
Okokuqala, hlala ulungisa kusuka kokungahluziwe, hhayi kusuka kokukhiphayo okucutshunguliwe. Uma unokufinyelela kuphela esithombeni sokugcina se-YUV, uqagela ukuthi yini ibhlokhi ngayinye ye-ISP eyenzayo. Ukulungisa okufanele kudinga amandla okuthwebula okungahluziwe kanye nekhono lokushintsha amapharamitha esigabeni ngasinye sepayipi ngasinye.
Okwesibili, lungisa emazingeni okukhanya amaningi, hhayi ekukhanyeni kwasehhovisi okukhanyayo kuphela. Ukulungisa okusebenza ku-1000 lux kuvame ukuwa ku-50 lux. Iphrofayela yokulungisa ephelele ihlanganisa izilungiselelo ezihlukene zesinyathelo ngasinye sokuzuza noma okungenani izigaba zokukhanya okuphezulu, okumaphakathi, nokubaphansi. I-ISP kufanele ihlanganise ngokushelelayo phakathi kwamaphrofayela njengoba amazinga okukhanya eshintsha.
Okwesithathu, hlola ngobuso bangempela, hhayi ngamashadi kuphela. Amashadi okuhlola akala ukunemba okubonakalayo, kodwa ababukeli abangabantu bahlulela ikhwalithi yesithombe ikakhulukazi ngendlela ubuso obubukeka ngayo. Uma umkhiqizo wakho uzosetshenziselwa izingcingo zevidiyo, ukulawula ukungena, nanoma yiluphi uhlelo olubhekene nabantu, chitha okungenani isigamu sesikhathi sakho sokulungisa okubonakalayo uhlola abantu bangempela ngaphansi kokukhanya kwangempela.
Okwesine, bhala phansi zonke izinguquko kanye nesizathu sazo. Ukulungisa i-ISP kungasheshe kwehlele ekulungiseni okungapheli lapho kungekho muntu okhumbulayo ukuthi kungani inani elithile labekwa ngendlela elibekwe ngayo. Gcina incwadi yokulungisa enamanani wemingcele, izimo zokuhlola, kanye nesizathu sangemuva kwalokho kulungiswa ngakunye. Lokhu kwenza kube lula kakhulu ukubuyisela emuva lapho ushintsho ludala imiphumela engalindelekile.
Ekugcineni, gwema isilingo sokukopisha amanani okulungisa kusuka kunye ne-sensor noma imojuli. Ngisho namasensori amabili anezicaciso ezifanayo azoba nokuphendula okuhlukile kwesiphektramu, izici zomsindo, kanye nokuhlelwa kwamaphikseli. Iphrofayela esebenza kahle kusensori eyodwa ingase ikhiqize imiphumela emibi kakhulu kwenye. Hlala uqala ngokulinganisa okufanele bese uqhubeka usuka lapho.

Imicabango Yokuvala

Ukulungisa i-ISP kuyingxenye yesayensi, kuyingxenye ubuciko. Umsebenzi wokulinganisa okuhloswe ngokucophelela ulandela izimiso ezimisiwe ze-optical ne-color science, futhi amathuluzi nezindlela ziqondwa kahle. Kodwa ukulinganisa kokugcina—ukuthatha isinqumo sokuthi kuzobekwa kuphi ncamashi kunxantathu we-sharpness-noise-color kumkhiqizo othile—kudinga ukwahlulela, isipiliyoni, nokuqonda okujulile komsebenzisi wokugcina kanye nesimo sokusetshenziswa.
Amamojula ekhamera angcono kakhulu awona lawo anezinombolo eziphezulu kakhulu kuhlu lwezicaciso. Yilawo lapho ithimba lokulungisa lenze ukushintshana okucatshangelwe kahle, okunolwazi okuhambisana nalokho umsebenzisi akudinga ngempela. Imojula ye-2MP elungiswe kahle ingadlula kalula imojula ye-8MP engalungiswanga kahle ekusetshenzisweni kwangempela, ngoba ikhwalithi yesithombe ekugcineni imayelana nesithombe esiphumayo, hhayi ihadiwe yokufaka.
Emaqenjini onjiniyela ahlola amamojula ekhamera noma eqala imiklamo emisha, khumbulani ukubuza ngokuhlelwa kwe-ISP ngokucophelela njengoba nibuza ngemininingwane yenzwa nelensi. Izingxenyekazi ziyingxenye yendaba kuphela. Ukuhlelwa yikho okwenza isithombe sibe ngcono.
ukulungisa imojuli yekhamera
Uxhumane
Sicela uxhumane nathi uhambele

Mayelana nathi

Usizo

+8618520876676

+8613603070842

Izindaba

leo@aiusbcam.com

vicky@aiusbcam.com

WhatsApp
WeChat