CN101894369B - Real-time method for computing focal length of camera from image sequence - Google Patents
Real-time method for computing focal length of camera from image sequence Download PDFInfo
- Publication number
- CN101894369B CN101894369B CN2010102223472A CN201010222347A CN101894369B CN 101894369 B CN101894369 B CN 101894369B CN 2010102223472 A CN2010102223472 A CN 2010102223472A CN 201010222347 A CN201010222347 A CN 201010222347A CN 101894369 B CN101894369 B CN 101894369B
- Authority
- CN
- China
- Prior art keywords
- focal length
- match
- solution
- point
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention provides a real-time method for computing the focal length of a camera from an image sequence, comprising the following steps of: selecting two adjacent images from the image sequence; matching characteristic points of the two images to obtain matching point pairs; solving any seven groups of matching points of the matching point pairs to obtain multiple possible solutions of the focal length; evaluating the accuracy of each possible solution, and using an evaluating value as the weight of each possible solution; computing the weighted sum of the possible solutions according to the weights for evaluation to obtain the probability density function of the focal length; sampling on a probability density function camber of the focal length for multiple times to obtain multiple sampling points; and fitting the sampling points by applying a Gaussian function, and using the peak value of the Gaussian function as a final focal length value. The real-time method for computing the focal length of the camera can be used for overcoming the defects of the self-calibration of the camera in practical application, thereby fast and accurately evaluating the focal length parameters of the camera.
Description
Technical field
The present invention relates to computer vision field, relate in particular to the implementation method of restoration scenario three-dimensional model from image sequence.
Background technology
At computer vision field, people are of long duration to the research of from image sequence, how to obtain camera motion and scene three-dimensional model.Initial application is embodied in the machine vision aspect; The researchist judges the spatial relationship of scene through the geological information that from image sequence, extracts; And further guidance machine people's motion; This type research needs to use special and expensive collecting device usually, and application scenarios is also had bigger limitation.Along with the development of hardware device with popularize, the researchist hopes from the sequence image that common collecting device obtains, to calculate the three-dimensional model of scene, and the gordian technique that wherein relates to is exactly Camera calibration work.
The Camera calibration technology is the important step in the computer vision research, uses in fields such as three-dimensional reconstruction, navigation widely.See that from the history of development the camera calibration technology can be divided into: traditional calibration technique, active calibration technique and self-calibration technology.The tradition calibration technique is used the demarcation thing of accurately making; Ask for camera parameters according to setting up mapping between the three-dimensional coordinate of demarcating the thing unique point and the two dimensional image projection; The tradition calibration technique can access result more accurately, but operation inconvenience, can only be in some application of special occasions; Initiatively calibration technique is accomplished camera calibration through the special geometric scheme of projection in scene through the contact between geometric properties and the image.The advantage of this method has been to avoid to demarcate the use of thing, and can recover camera parameters accurately through accurate projection, and shortcoming is to have added projecting cell, has increased the complex equipments degree, does not have versatility.Obtain the camera self-calibration technology of broad research in recent years, utilize the constraint of video camera confidential reference items to calculate corresponding focus of camera value, this technology does not need the information of scene and camera motion, can be in various image sequences flexible Application.
The camera self-calibration Study on Technology starts from early 1990s; At first by Faugeras; Luong and Maybank propose from the notion of demarcating; And introduce the Kruppa equation in the research of self-calibrating method in early days, utilize absolute conic and polar curve conversion to set up the system of equations between the image, last directly solving equation group obtains the intrinsic parameter of video camera.But there is polysemy in separating that the method that is based on the Kruppa equation obtains, and directly finds the solution relatively difficulty of equation of higher degree group.Bill Triggs proposed based on the quadric self-calibrating method of absolute antithesis in 97 years.This method comprises the parameter of camera intrinsic parameter and plane at infinity simultaneously, utilizes camera intrinsic parameter constraint Simultaneous Equations to find the solution.This method is compared the Kruppa equation and is had stronger constraint, and can find the solution through linear and non-linear method, on operability and accuracy, all has raising, shortcoming to be to require in the solution procedure positive semi-definite constraint often to be difficult to satisfy.
Summary of the invention
The present invention is intended to one of solve the problems of the technologies described above at least.
For this reason, one object of the present invention is to propose a kind of real-time method that from image sequence, calculates focal length of camera, this method has solved the deficiency of camera self-calibration in practical application, has realized fast and accurately the estimation to the focal length of camera parameter.
For achieving the above object, the present invention proposes a kind of real-time method that from image sequence, calculates focal length of camera, may further comprise the steps: from image sequence, choose adjacent two images;
It is right to obtain match point that described two images are carried out Feature Points Matching, wherein, said two images carried out Feature Points Matching to obtain match point to further comprising:
As characteristic, choose algorithm picks certain characteristics point with the colouring information of image with the utilization unique point; And
In said two images, find some groups of match points right according to said unique point, wherein, it is right in matching process, to form one group of match point to two the most close unique points of color characteristic;
Any seven groups of match points of said match point centering to finding the solution to obtain a plurality of feasible solutions of focal length, wherein, are saidly further comprised a plurality of feasible solutions of finding the solution to obtain focal length any seven groups of match points of said match point centering:
Select seven groups of match points right at random from all match point centerings of said two images, wherein two of each match point centering unique points are respectively p
I1=(x
I1, y
I1.1), p
I2=(x
I2, y
I2, 1), i=1 wherein, 2...7;
With p
I1=(x
I1, y
I1.1), p
I2=(x
I2, y
I2, 1) and substitution p
I2 T* F*p
I1=0 finds the solution and obtains matrix F;
With matrix F substitution det (F)=0 and 2FQF
TQF-trace (FQF
TQ) F=0 obtains a polynary equation of higher degree group, wherein, the determinant of det (F) expression F, the mark of trace (.) representing matrix, Q matrix are diagonal matrix diag ([111/ (f
1* f
2)]), f
1, f
2Be the corresponding focal length of video camera; And
Find the solution said polynary equation of higher degree group to obtain several feasible solutions of focal length;
The accuracy of said each feasible solution of assessment and the weight of assessed value as said each feasible solution, wherein, the accuracy of said each feasible solution of assessment and further comprise the weight of assessed value as each feasible solution:
To in the corresponding said feasible solution of substitution, be verified as the right residue match point of said image to judge the said correctness that possibly connect said residue match point is carried out related constraint; And
Count the coupling that satisfies constraint in the ratio of all match point centerings weight as said feasible solution;
According to said weight said each feasible solution is calculated weighted sum obtains focal length with assessment probability density function;
On the probability density function camber of said focal length, repeatedly sample to obtain a plurality of sampled points; And
Utilization Gaussian function match said sampled point, and with said Gaussian function peak value as final focal length value.
In one embodiment of the invention, two unique points of said each group match point centering are the same some projection result on two images respectively in the scene.
In one embodiment of the invention, after obtaining several feasible solutions of focal length, also comprise: select other seven groups of match points right at random from the residue match point centering of said two images; Substitution is correlated with the mathematics equation solution to said other seven groups of match points to obtain a polynary equation of higher degree group; Find the solution said polynary equation of higher degree group to obtain several feasible solutions of focal length once more.
In one embodiment of the invention, up to not having abundant residue match point or find the solution to stop to carry out and exporting all feasible solutions after reaching pre-determined number.
In one embodiment of the invention, the said weight of said foundation further comprises with the probability density function that assessment obtains focal length said each feasible solution calculating weighted sum: the stochastic variable that said focal length is designated as a two dimension; Said each feasible solution corresponds to a kernel function on the probability space; On probability space, said each kernel function is carried out weighted sum, to obtain the probability density function of focal length, wherein, the weight of said each kernel function is the weight of corresponding said feasible solution.
In one embodiment of the invention, the value of said each sampled point is the probability of occurrence of corresponding feasible solution.
In one embodiment of the invention; The said sampled point of utilization Gaussian function match; And serve as that the said sampling point set of utilization is combined in and simulates Gauss's curved surface in the said probability space as final focal length value with said Gaussian function peak value; The value of the two-dimensional random variable that wherein, said Gauss's curved surface peak value is corresponding is the focal length value of corresponding two image camera.
Another aspect of the present invention has proposed a kind of device that from image sequence, calculates focal length of camera, comprising:
Image is chosen module, is used for choosing adjacent two images from image sequence;
The images match module, it is right to obtain match point to be used for that described two images are carried out Feature Points Matching, wherein, said two images is carried out Feature Points Matching to obtain match point to further comprising:
As characteristic, choose algorithm picks certain characteristics point with the colouring information of image with the utilization unique point; And
In said two images, find some groups of match points right according to said unique point, wherein, it is right in matching process, to form one group of match point to two the most close unique points of color characteristic;
The focal length computing module is used for any seven groups of match points of said match point centering finding the solution to obtain a plurality of feasible solutions of focal length, wherein, said any seven groups of match points of said match point centering is further comprised a plurality of feasible solutions of finding the solution to obtain focal length:
Select seven groups of match points right at random from all match point centerings of said two images, wherein two of each match point centering unique points are respectively p
I1=(x
I1, y
I1.1), p
I2=(x
I2, y
I2, 1), i=1 wherein, 2...7;
With p
I1=(x
I1, y
I1.1), p
I2=(x
I2, y
I2, 1) and substitution p
I2 T* F*p
I1=0 finds the solution and obtains matrix F;
With matrix F substitution det (F)=0 and 2FQF
TQF-trace (FQF
TQ) F=0 obtains a polynary equation of higher degree group, wherein, the determinant of det (F) expression F, the mark of trace (.) representing matrix, Q matrix are diagonal matrix diag ([111/ (f
1* f
2)]), f
1, f
2Be the corresponding focal length of video camera; And
Find the solution said polynary equation of higher degree group to obtain several feasible solutions of focal length;
The weight evaluation module is used to assess the accuracy of said each feasible solution and the weight of assessed value as said each feasible solution, wherein, and the accuracy of said each feasible solution of assessment and further comprise the weight of assessed value as each feasible solution:
To in the corresponding said feasible solution of substitution, be verified as the right residue match point of said image to judge the said correctness that possibly connect said residue match point is carried out related constraint; And
Count the coupling that satisfies constraint in the ratio of all match point centerings weight as said feasible solution;
The probability density function constructing module is used for according to said weight said each feasible solution being calculated weighted sum and obtains the probability density function of focal length with assessment, and on the probability density function camber of said focal length, repeatedly samples to obtain a plurality of sampled points; With
The Gaussian function constructing module is used to use the said sampled point of Gaussian function match, and with said Gaussian function peak value as final focal length value.
The real-time method that from image sequence, calculates focal length of camera through the present invention proposes not only solved the deficiency of camera self-calibration in practical application, and realized fast and accurately the estimation to the focal length of camera parameter.
Aspect that the present invention adds and advantage part in the following description provide, and part will become obviously from the following description, or recognize through practice of the present invention.
Description of drawings
Above-mentioned and/or additional aspect of the present invention and advantage are from obviously with easily understanding becoming the description of embodiment below in conjunction with accompanying drawing, wherein:
Fig. 1 is the process flow diagram that from image sequence, calculates the focal length of camera real-time method of the embodiment of the invention;
Fig. 2 is that unique point and the match point of image sequence of the embodiment of the invention is to synoptic diagram;
Fig. 3 is the synoptic diagram that the focal length probability density function is estimated in the nonparametric technique of the embodiment of the invention;
Fig. 4 is the synoptic diagram to the probability density function resampling of the embodiment of the invention;
Fig. 5 carries out the Gauss curve fitting synoptic diagram for the embodiment of the invention to resample points; With
Fig. 6 is the structure drawing of device that from image sequence, calculates focal length of camera of the embodiment of the invention.
Embodiment
Describe embodiments of the invention below in detail, the example of said embodiment is shown in the drawings, and wherein identical from start to finish or similar label is represented identical or similar elements or the element with identical or similar functions.Be exemplary through the embodiment that is described with reference to the drawings below, only be used to explain the present invention, and can not be interpreted as limitation of the present invention.
The present invention be directed to the deficiency in the existing camera self-calibration technology, and a kind of real-time method that from image sequence, calculates focal length of camera that proposes can estimate the focal length of camera parameter value fast and accurately through this method.
In order clearer understanding to be arranged to the real-time method that from image sequence, calculates focal length of camera that the embodiment of the invention proposes; Below make concise and to the point description with regard to this method: this method is at first selected and matched feature points adjacent two images; And picked at random wherein seven groups of match points then all possible separating carried out accuracy assessment, and assessed value is used for non-parametric estmation as weight finding the solution a plurality of feasible solutions that obtain focal length; So that obtain the probability density function of focal length; On probability density function, resample at last, and utilize new sampled point to carry out Gauss curve fitting, further the peak value of Gaussian function after the match finally separating as focal length of camera.Be the focal length of camera parameter value that the embodiment of the invention proposes.
Particularly, as shown in Figure 1, the process flow diagram that from image sequence, calculates the real-time method of focal length of camera for the embodiment of the invention may further comprise the steps:
Step S101 chooses adjacent two images from image sequence.More particularly, the image in the said image sequence is numbered, for example: can be designated as I
1, I
2, I
3... can certainly be designated as any type of mark that other can separate image area., numbering at first chooses I after accomplishing
1, I
2The method that two images use the present invention to propose is carried out finding the solution of focal length of camera, chooses I after finishing finding the solution
3, I
4Find the solution, by that analogy, the focal length that all images is corresponding in sequence has all utilized the method that is proposed by invention to find the solution completion.(following with I
1, I
2Be example).
Step S102, it is right to obtain match point that described two images are carried out Feature Points Matching.
2.1; As characteristic, utilize image characteristic point extraction algorithm SIFT algorithm from two images, to extract certain characteristics point (like the angle point of image, flex point etc.) respectively with the colouring information of image, and to each its pixel coordinate in image of unique point record; Be designated as (x; Y) and one 128 the dimension eigenvector, eigenvector is the local color characteristic under a plurality of metric spaces.
2.2, for I
1In each unique point, be designated as p1, at I
2In all unique points, be designated as { p
i.At { p
iIn find unique point p2, make that the eigenvector of p2 and the distance of eigenvector on theorem in Euclid space of p1 are nearest in all unique points.Therefore, (p1, it is right p2) to form a match point, in one embodiment of the invention this match point to being designated as m.
In conjunction with Fig. 2; For the unique point of the image sequence of the embodiment of the invention and match point to synoptic diagram; Can be clear that from Fig. 2 match point is right; Can also find out that from figure the same point when being shooting in the scene is the result of projection on two images respectively for two unique points of each group match point centering.
Step S103, to any seven groups of match points of said match point centering to finding the solution to obtain a plurality of feasible solutions of focal length.
3.1, select seven groups of match points right at random from all match point centerings of two images, be designated as m
1, m
2... .m
7
3.2, for each the group match point in 3.1 to m
iIn unique point, be designated as p
I1, p
I2, all corresponding satisfied following equation:
p
i2 T*F*p
i1＝0 ...(1)
P wherein
I1=(x
I1, y
I1, 1), p
I2=(x
I2, y
I2, 1), F is the unknown matrix of a 3*3.And with seven groups of match points in the substitution following formula, can obtain the system of linear equations of forming by seven equations.
3.3, the system of linear equations in 3.2 is further found the solution the general solution F that obtains F
1, F
2, satisfy F=x*F
1+ F
2, wherein x is unknown coefficient;
Next, the expression formula with above-mentioned F is updated in the following equation (matrix form is represented):
det(F)＝0 ...(2)
2FQF
TQF-trace(FQF
TQ)F＝0 ...(3)
Wherein det (F) representes the F determinant of a matrix, and the mark of trace (.) representing matrix, Q matrix are diagonal matrix diag ([111/ (f
1* f
2)]), f
1, f
2Be the corresponding focal length of video camera;
Obtain the system of equations formed by ten polynary equations of higher degree by (2) (3) formula, find the solution this system of equations, obtain a plurality of separating, be designated as { S
i.Wherein each separates the focal distance f that has comprised two images
1, f
2, they all are correct separating on the mathematical meaning, because all satisfy above-mentioned polynary equation of higher degree group, but right because the match point of mistake in matching process, possibly occur, so can not guarantee that in real image each is separated all is correct separating on the physical significance.
3.4,3.1,3.2,3.3 circulations are carried out some times, so that obtain more feasible solutions of focal length.
Step S104, the assessment said each feasible solution accuracy and the weight of assessed value as said each feasible solution.
4.1, to each feasible solution S
i, can obtain a matrix, be designated as F, with other all match points to being updated in the formula (1) in 3.2 with this F matrix, the match point that satisfies equality to calling S
iSupport point.For a feasible solution, support point is many more, shows that then the correctness of this feasible solution is high more.
4.2,, be designated as w supporting to count at the ratio of all match point centerings weighted value as this feasible solution
i
Step S105 calculates weighted sum obtains focal length with assessment probability density function according to said weight to said each feasible solution.
5.1, at first focus of camera is designated as the stochastic variable (f of a two dimension
1, f
2).
5.2; Separate among the step S104 each, a corresponding kernel function on the probability space has been used gaussian kernel function in one embodiment of the invention; As shown in Figure 3, estimate the synoptic diagram of focal length probability density function for the nonparametric technique of the embodiment of the invention.From Fig. 3 can be able to see functional digraph and the functional digraph of gaussian kernel function of probability density function of focal length of the embodiment of the invention.(for demonstration directly perceived, the synoptic diagram of the one-dimensional case of having drawn, two-dimensional case is identical, just transfers curved surface to from curve).
5.3, on probability space, each kernel function in 5.2 is carried out weighted sum, obtain the probability density function of focal length, be designated as p (f
1, f
2).The weight of each kernel function is the weight w of the feasible solution in corresponding 4.2
i
Step S106 repeatedly samples on the probability density function camber of said focal length to obtain a plurality of sampled points.Particularly,, sample to obtain a sampled point (sample point), can access corresponding all sampled points (sample point) of all feasible solutions like this in the position of each feasible solution for the probability density function camber that weighted sum obtains.The value of each sampled point (sample point) is to probability of occurrence that should feasible solution.More particularly, as shown in Figure 4, be the synoptic diagram that probability density function is repeatedly sampled of the embodiment of the invention (for demonstration directly perceived, the synoptic diagram of the one-dimensional case of having drawn, two-dimensional case is identical, just transfers curved surface to from curve).In Fig. 4, can obviously see a plurality of sampled points (sample point).The probability density function camber that obtains for weighted sum is designated as p (f
1, f
2), at each feasible solution (f
I1, f
I2) the position sample, obtain corresponding sampled point (sample point), each sampled point (sample point), i.e. (f
I1, f
I2, p
i) p
iThe corresponding probability of occurrence of this feasible solution.
Step S107, the utilization said sampled point of Gaussian function match (sample point), and with said Gaussian function peak value as final focal length value.In order the present invention there to be clearer understanding,, resample points is carried out Gauss curve fitting synoptic diagram (for demonstration directly perceived, the synoptic diagram of the one-dimensional case of having drawn, two-dimensional case is identical, just transfers curved surface to from curve) for the embodiment of the invention in conjunction with Fig. 5.Be not difficult to find out, from this Fig. 5, can obviously see the Gaussian function image of the embodiment of the invention, from sampled point image and the final focal length value of estimating.Particularly:
7.1, new sample point the set { (f among the utilization step S106
I1, f
I2, p
i) in probability space, simulate Gauss's curved surface.
7.2 the value of the two-dimensional random variable that the curved surface of Gauss described in 7.1 peak value is corresponding is respectively the corresponding focal length value f of two images
1, f
2
The invention allows for a kind of device that from image sequence, calculates focal length of camera, as shown in Figure 6, be the structure drawing of device that from image sequence, calculates focal length of camera of the embodiment of the invention.The device 100 that should be from image sequence calculates focal length of camera comprises that image chooses module 110, images match module 120, focal length computing module 130, weight evaluation module 140, probability density function constructing module 150 and Gaussian function constructing module 160.Wherein, image is chosen module 110, is used for choosing adjacent two images from image sequence; Images match module 120, it is right to obtain match point to be used for that described two images are carried out Feature Points Matching; Focal length computing module 130 is used for any seven groups of match points of said match point centering finding the solution to obtain a plurality of feasible solutions of focal length; Weight evaluation module 140 is used to assess the accuracy of said each feasible solution and the weight of assessed value as said each feasible solution; Probability density function constructing module 150 is used for according to said weight said each feasible solution being calculated weighted sum and obtains the probability density function of focal length with assessment, and on the probability density function camber of said focal length, repeatedly samples to obtain a plurality of sampled points; With Gaussian function constructing module 160, be used to use the said sampled point of Gaussian function match, and with said Gaussian function peak value as final focal length value.
But skilled in the art will recognize that; Said probability density function constructing module 150 can be refined as the more concrete a plurality of functional modules of function; As: be used for said each feasible solution is calculated the functional module of weighted sum obtains focal length with assessment probability density function and being used on the probability density function camber of said focal length, sampling to obtain the functional module of sampled point according to said weight.These also should belong within protection scope of the present invention.
The real-time method that from image sequence, calculates focal length of camera through the present invention proposes not only solved the deficiency of camera self-calibration in practical application, and realized fast and accurately the estimation to the focal length of camera parameter.
Although illustrated and described embodiments of the invention; For those of ordinary skill in the art; Be appreciated that under the situation that does not break away from principle of the present invention and spirit and can carry out multiple variation, modification, replacement and modification that scope of the present invention is accompanying claims and be equal to and limit to these embodiment.
Claims (10)
1. a real-time method that from image sequence, calculates focal length of camera is characterized in that, may further comprise the steps:
From image sequence, choose adjacent two images;
It is right to obtain match point that described two images are carried out Feature Points Matching, wherein, said two images carried out Feature Points Matching to obtain match point to further comprising:
As characteristic, choose algorithm picks certain characteristics point with the colouring information of image with the utilization unique point; And
In said two images, find some groups of match points right according to said unique point, wherein, it is right in matching process, to form one group of match point to two the most close unique points of color characteristic;
Any seven groups of match points of said match point centering to finding the solution to obtain a plurality of feasible solutions of focal length, wherein, are saidly further comprised a plurality of feasible solutions of finding the solution to obtain focal length any seven groups of match points of said match point centering:
Select seven groups of match points right at random from all match point centerings of said two images, wherein two of each match point centering unique points are respectively p
I1=(x
I1, y
I1, 1), p
I2=(x
I2, y
I2, 1), i=1 wherein, 2...7;
With p
I1=(x
I1, y
1i, 1), p
I2=(x
I2, y
I2, 1) and substitution p
I2 T* F*p
I1=0 finds the solution and obtains matrix F;
With matrix F substitution det (F)=0 and 2FQF
TQF-trace (FQF
TQ) F=0 obtains a polynary equation of higher degree group, wherein, the determinant of det (F) expression F, the mark of trace (.) representing matrix, Q matrix are diagonal matrix diag ([111/ (f
1* f
2)]), f
1, f
2Be the corresponding focal length of video camera; And
Find the solution said polynary equation of higher degree group to obtain several feasible solutions of focal length;
The accuracy of said each feasible solution of assessment and the weight of assessed value as said each feasible solution, wherein, the accuracy of said each feasible solution of assessment and further comprise the weight of assessed value as each feasible solution:
To in the corresponding said feasible solution of substitution, be verified as the correctness of judging said feasible solution to the right residue match point of said image said residue match point is carried out related constraint; And
Count the coupling that satisfies constraint in the ratio of all match point centerings weight as said feasible solution;
According to said weight said each feasible solution is calculated weighted sum obtains focal length with assessment probability density function;
On the probability density function camber of said focal length, repeatedly sample to obtain a plurality of sampled points; And
Utilization Gaussian function match said sampled point, and with said Gaussian function peak value as final focal length value.
2. the real-time method that from image sequence, calculates focal length of camera as claimed in claim 1 is characterized in that, two unique points of said each group match point centering are the same some projection result on two images respectively in the scene.
3. the real-time method that from image sequence, calculates focal length of camera as claimed in claim 1 is characterized in that, after obtaining several feasible solutions of focal length, also comprises:
Select other seven groups of match points right at random from the residue match point centering of said two images;
Substitution is correlated with the mathematics equation solution to said other seven groups of match points to obtain a polynary equation of higher degree group;
Find the solution said polynary equation of higher degree group to obtain several feasible solutions of focal length once more.
4. the real-time method that from image sequence, calculates focal length of camera as claimed in claim 3 is characterized in that, up to not having abundant residue match point or find the solution to stop to carry out and exporting all feasible solutions after reaching pre-determined number.
5. the real-time method that from image sequence, calculates focal length of camera as claimed in claim 1 is characterized in that, the said weight of said foundation is calculated weighted sum to said each feasible solution and further comprised with the probability density function that assessment obtains focal length:
Said focal length is designated as the stochastic variable of a two dimension;
Said each feasible solution corresponds to a kernel function on the probability space;
On probability space, said each kernel function is carried out weighted sum, to obtain the probability density function of focal length, wherein, the weight of said each kernel function is the weight of corresponding said feasible solution.
6. the real-time method that from image sequence, calculates focal length of camera as claimed in claim 5 is characterized in that the value of said each sampled point is the probability of occurrence of corresponding feasible solution.
7. the real-time method that from image sequence, calculates focal length of camera as claimed in claim 6; It is characterized in that; The said sampled point of utilization Gaussian function match; And serve as that the said sampling point set of utilization is combined in and simulates Gauss's curved surface in the said probability space with said Gaussian function peak value as final focal length value, wherein, the value of the two-dimensional random variable that said Gauss's curved surface peak value is corresponding is the focal length value of corresponding two image camera.
8. a device that from image sequence, calculates focal length of camera is characterized in that, comprising:
Image is chosen module, is used for choosing adjacent two images from image sequence;
The images match module, it is right to obtain match point to be used for that described two images are carried out Feature Points Matching, wherein, said two images is carried out Feature Points Matching to obtain match point to further comprising:
As characteristic, choose algorithm picks certain characteristics point with the colouring information of image with the utilization unique point; And
In said two images, find some groups of match points right according to said unique point, wherein, it is right in matching process, to form one group of match point to two the most close unique points of color characteristic;
The focal length computing module is used for any seven groups of match points of said match point centering finding the solution to obtain a plurality of feasible solutions of focal length, wherein, said any seven groups of match points of said match point centering is further comprised a plurality of feasible solutions of finding the solution to obtain focal length:
Select seven groups of match points right at random from all match point centerings of said two images, wherein two of each match point centering unique points are respectively p
I1=(x
I1, y
I1, 1), p
I2=(x
I2, y
I2, 1), i=1 wherein, 2...7;
With p
I1=(x
I1, y
I1, 1), p
I2=(x
I2, y
I2, 1) and substitution p
I2 T* F*p
I1=0 finds the solution and obtains matrix F;
With matrix F substitution det (F)=0 and 2FQF
TQF-trace (FQF
TQ) F=0 obtains a polynary equation of higher degree group, wherein, the determinant of det (F) expression F, the mark of trace (.) representing matrix, Q matrix are diagonal matrix diag ([111/ (f
1* f
2)]), f
1, f
2Be the corresponding focal length of video camera; And
Find the solution said polynary equation of higher degree group to obtain several feasible solutions of focal length;
The weight evaluation module is used to assess the accuracy of said each feasible solution and the weight of assessed value as said each feasible solution, wherein, and the accuracy of said each feasible solution of assessment and further comprise the weight of assessed value as each feasible solution:
To in the corresponding said feasible solution of substitution, be verified as the correctness of judging said feasible solution to the right residue match point of said image said residue match point is carried out related constraint; And
Count the coupling that satisfies constraint in the ratio of all match point centerings weight as said feasible solution;
The probability density function constructing module is used for according to said weight said each feasible solution being calculated weighted sum and obtains the probability density function of focal length with assessment, and on the probability density function camber of said focal length, repeatedly samples to obtain a plurality of sampled points; With
The Gaussian function constructing module is used to use the said sampled point of Gaussian function match, and with said Gaussian function peak value as final focal length value.
9. the device that from image sequence, calculates focal length of camera as claimed in claim 8 is characterized in that, two unique points of said each group match point centering are the same some projection result on two images respectively in the scene.
10. the device that from image sequence, calculates focal length of camera as claimed in claim 8 is characterized in that, up to not having abundant residue match point or find the solution to stop to carry out and exporting all feasible solutions after reaching pre-determined number.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102223472A CN101894369B (en) | 2010-06-30 | 2010-06-30 | Real-time method for computing focal length of camera from image sequence |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102223472A CN101894369B (en) | 2010-06-30 | 2010-06-30 | Real-time method for computing focal length of camera from image sequence |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101894369A CN101894369A (en) | 2010-11-24 |
| CN101894369B true CN101894369B (en) | 2012-05-30 |
Family
ID=43103552
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010102223472A Active CN101894369B (en) | 2010-06-30 | 2010-06-30 | Real-time method for computing focal length of camera from image sequence |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101894369B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8934017B2 (en) | 2011-06-01 | 2015-01-13 | Honeywell International Inc. | System and method for automatic camera placement |
| US20140192159A1 (en) * | 2011-06-14 | 2014-07-10 | Metrologic Instruments, Inc. | Camera registration and video integration in 3d geometry model |
| CN103002206B (en) * | 2011-09-14 | 2017-03-01 | 新奥特（北京）视频技术有限公司 | Process the method and system of zoom sampling pulse |
| CN103824278B (en) * | 2013-12-10 | 2016-09-21 | 清华大学 | The scaling method of CCTV camera and system |
| CN109407150A (en) * | 2018-12-06 | 2019-03-01 | 中国石油大学(北京) | Based on the petrophysical shale reservoir compressibility means of interpretation of statistics and system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5657402A (en) * | 1991-11-01 | 1997-08-12 | Massachusetts Institute Of Technology | Method of creating a high resolution still image using a plurality of images and apparatus for practice of the method |
| US7447337B2 (en) * | 2004-10-25 | 2008-11-04 | Hewlett-Packard Development Company, L.P. | Video content understanding through real time video motion analysis |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010061352A2 (en) * | 2008-11-26 | 2010-06-03 | Hiok Nam Tay | Auto-focus image system |
-
2010
- 2010-06-30 CN CN2010102223472A patent/CN101894369B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5657402A (en) * | 1991-11-01 | 1997-08-12 | Massachusetts Institute Of Technology | Method of creating a high resolution still image using a plurality of images and apparatus for practice of the method |
| US7447337B2 (en) * | 2004-10-25 | 2008-11-04 | Hewlett-Packard Development Company, L.P. | Video content understanding through real time video motion analysis |
Non-Patent Citations (2)
| Title |
|---|
| 杨晓敏等.图像特征点提取及匹配技术.《光学精密工程》.2009,第17卷(第9期),第2276-2282页. * |
| 王会峰等.基于序列图象特征配准的摄像机旋转补偿算法.《光学精密工程》.2008,第16卷(第7期),第1330-1334页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101894369A (en) | 2010-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112894832B (en) | Three-dimensional modeling method, three-dimensional modeling device, electronic equipment and storage medium | |
| CN108510530B (en) | Three-dimensional point cloud matching method and system | |
| CN111784778B (en) | Binocular camera external parameter calibration method and system based on linear solving and nonlinear optimization | |
| CN101894369B (en) | Real-time method for computing focal length of camera from image sequence | |
| CN105793892B (en) | A kind of image processing method, device and picture pick-up device | |
| CN103714571A (en) | Single camera three-dimensional reconstruction method based on photogrammetry | |
| CN103900583A (en) | Device and method used for real-time positioning and map building | |
| CN110390697A (en) | A kind of millimetre-wave radar based on LM algorithm and camera combined calibrating method | |
| CN103903263B (en) | A kind of 360 degrees omnidirection distance-finding method based on Ladybug panorama camera image | |
| CN105354841B (en) | A kind of rapid remote sensing image matching method and system | |
| CN104376572A (en) | Mobile terminal camera calibrating method | |
| CN106991705B (en) | Position parameter estimation method based on P3P algorithm | |
| CN112465877B (en) | Kalman filtering visual tracking stabilization method based on motion state estimation | |
| CN109272555B (en) | External parameter obtaining and calibrating method for RGB-D camera | |
| CN112686877A (en) | Binocular camera-based three-dimensional house damage model construction and measurement method and system | |
| CN104243815A (en) | Focusing method and electronic equipment | |
| CN109636852A (en) | A kind of monocular SLAM initial method | |
| CN107133986A (en) | A kind of camera calibration method based on two-dimensional calibrations thing | |
| CN105787464A (en) | A viewpoint calibration method of a large number of pictures in a three-dimensional scene | |
| CN113192063B (en) | Bridge line-shaped monitoring system and bridge line-shaped monitoring method | |
| CN104504691A (en) | Camera position and posture measuring method on basis of low-rank textures | |
| CN106152946B (en) | A kind of method and terminal measuring object length | |
| CN114092564B (en) | External parameter calibration method, system, terminal and medium for non-overlapping vision multi-camera system | |
| CN112308926B (en) | Camera external reference calibration method without public view field | |
| CN113012238B (en) | Method for quick calibration and data fusion of multi-depth camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |