
==== Front
Proc Biol Sci
Proc Biol Sci
RSPB
royprsb
Proceedings of the Royal Society B: Biological Sciences
0962-8452
1471-2954
The Royal Society

rspb20240347
10.1098/rspb.2024.0347
1001100113314Neuroscience and Cognition
Research Articles
Deriving the cone fundamentals: a subspace intersection method
Deriving the cone fundamentals: a subspace intersection method
https://orcid.org/0000-0002-2974-1836
Wandell Brian A. 1 Conceptualization Data curation Formal analysis Methodology Resources Software Supervision Validation Visualization Writing – original draft Writing – review and editing wandell@stanford.edu

Goossens Thomas 1 Conceptualization Methodology Software Visualization Writing – review and editing contact@thomasgoossens.be

https://orcid.org/0000-0001-9827-543X
Brainard David H. 2 Conceptualization Data curation Formal analysis Validation Visualization Writing – original draft Writing – review and editing brainard@psych.upenn.edu

1 Psychology Department, Stanford University , Stanford, CA 94305, USA
2 Psychology Department, University of Pennsylvania , Philadelphia, PA 19104, USA
2024
04 9 2024 September 4, 2024
04 9 2024 September 4, 2024
291 2030 2024034712 2 2024 February 12, 2024
26 6 2024 June 26, 2024
11 7 2024 July 11, 2024
© 2024 The Author(s).
2024
https://creativecommons.org/licenses/by/4.0/ Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/, which permits unrestricted use, provided the original author and source are credited.

Two ideas, proposed by Thomas Young and James Clerk Maxwell, form the foundations of colour science: (i) three types of retinal receptors encode light under daytime conditions, and (ii) colour matching experiments establish the critical spectral properties of this encoding. Experimental quantification of these ideas is used in international colour standards. However, for many years, the field did not reach consensus on the spectral properties of the biological substrate of colour matching: the spectral sensitivity of the cone fundamentals. By combining auxiliary data (thresholds, inert pigment analyses), complex calculations, and colour matching from genetically analysed dichromats, the human cone fundamentals have now been standardized. Here, we describe a new computational method to estimate the cone fundamentals using only colour matching from the three types of dichromatic observers. We show that it is not necessary to include data from trichromatic observers in the analysis or to know the primary lights used in the matching experiments. Remarkably, it is even possible to estimate the fundamentals by combining data from experiments using different, unknown primaries. We then suggest how the new method may be applied to colour management in modern image systems.

colour
; retina
; perception
==== Body
pmc1. Introduction

It appears therefore that the result of any mixture of colours, however complicated, may be defined by its relation to a certain small number of well-known colours. Having selected our standard colours, and determined the relations of a given colour to these, we have defined that colour completely as to its appearance. Any colour which has the same relation to the standard colours, will be identical in appearance, though its optical constitution, as revealed by the prism, may be very different. (James Clerk Maxwell) [1]

More than two centuries ago, artisans of colour prints in both Europe and Asia knew that a wide range of colour appearance could be achieved by the mixture of three primary colours [2]. Thomas Young explained the necessity and sufficiency of mixing three primaries by the idea that the retina contains three types of light-sensitive cells [3]. Biology, not physics, was his explanation of trichromacy.

More than 150 years ago, James Clerk Maxwell developed methods to quantify the biological encoding of colour [4–8]. Critical to the present paper, Maxwell implemented an apparatus to measure what we now call the colour matching functions. Subjects adjusted the intensity of triplets of spectral lights to match a constant daylight. The experiment is linear [9], and this enabled Maxwell to derive the spectral colour matching functions through clever experimental choices and simple algebraic manipulation (figure 1). He tabulated measurements from two typical subjects (trichromats), his wife and himself. 1 As the opening quotation shows, Maxwell recognized that the mixture of three spectral lights is sufficient to match a broadband light. His measurements guided the first implementation of colour photography by Sutton and Maxwell [12].

Figure 1. The colour matching data reported by Maxwell [1]. The solid curves are the CIE (1931) tristimulus colour matching functions. The dashed curves are the current CIE cone fundamentals [10,11] linearly transformed to match the CIE 1931 functions. The points are colour matching functions measured by Maxwell in two observers (J, squares; K, circles), also linearly transformed to match the CIE 1931 functions. The general agreement between Maxwell’s data and the CIE curves was pointed out by Judd, who provided a conversion of Maxwell’s wavelength units (Paris inches) to nanometres [6]. Here, we include a small (10 nm shift) correction to Judd’s estimate of the Maxwell’s wavelengths, as well as show the comparison with the current CIE cone fundamentals. The data and calculations to produce this figure are in the software repository (see fig01Maxwell/maxwellCMF2CIE.m). There is also a discussion of the 10 nm shift (fig01Maxwell/s_maxwellCMF2CIEshift).

The colour matching data reported by Maxwell [1]. The solid curves are the CIE (1931) tristimulus colour matching functions.

At the time Maxwell made his measurements, Young’s hypothesis was not universally accepted. Helmholtz initially believed trichromacy to be in error, before reversing his view [13–15]. The distinguished physicist Brewster explained colour as a physical property of light [16]. Maxwell swept both of these concerns aside by experimental demonstration. He performed colour matches with three primaries, to address Helmholtz. He also observed that interposing a colour filter between the eye and a pair of lights that look the same could break the match; this would not happen if Brewster was correct and the lights were physically identical.

But what are the spectral sensitivities of the biological substrate suggested by Young? Such sensitivities are now referred to as the cone fundamentals. The experimental colour matching functions depend on the spectral lights used as primaries and thus are not themselves the cone fundamentals. However, from the linearity of the colour matching experiment, we know that the cone fundamentals are a linear transformation away from any measured set of colour matching functions [17]. Thus, estimating the cone fundamentals can be framed as determining the appropriate linear transformation.

It was Helmholtz’ student, König, who realized that if the cone fundamentals of dichromats are a subset of those of trichromats, it should be possible to use the colour confusions of dichromats to infer the cone fundamentals. Individuals who are missing one type of cone but have two conventional cone types are called reduction dichromats. König & Dieterici developed a method for measuring the colour confusions of dichromats to estimate the cone fundamentals [18]. The data and theory have been formalized and explored by many others [19–24].

A project to marshal modern methods to establish the cone fundamentals culminated in the adoption of an excellent and secure standard [25]. This work built on prior analyses [23,26,27], and it incorporated auxiliary data including threshold measurements from dichromats, genetic profiling to assure the reduction hypothesis, and estimates of the inert pigments (lens, macula) of the eye in individual subjects. The methods, and their relationship to the careful work of many earlier investigators, are explained in Stockman’s authoritative review [11]. The cone fundamentals as well as other fundamental colorimetric data are readily available in tabulated form [28].

The result we report here is a new computational method for estimating the cone fundamentals directly from dichromatic colour matching experiments, requiring only two primaries. We explain the method and how it differs from the approach introduced by König. We also provide an implementation in the software repository accompanying this article; at its core, the method requires only a few lines of code in a modern computational environment.

Because the idea underlying the new method is simple, it provides a useful way to introduce colour science to students. Because it is based on standard linear algebraic methods, it may find application in modern colour image systems as well as in the adjacent fields of robotics and computer vision.

In the following, we explain the new method and its implementation. We then illustrate its application using data collected in the 1930s and 1950s by F. H. G. Pitt, W. D. Wright and their colleagues. It is particularly satisfying that the careful empirical work of these scientists is still relevant and reproducible. We outline how these methods may be applicable to image systems, robotics, and computer vision applications.

2. Cone fundamental estimation

Typical subjects have three types of cones, commonly referred to as long-wavelength (L), middle-wavelength (M) and short-wavelength (S) cones. Reduction dichromats are missing one type of cone, protanopes (no L), deuteranopes (no M), tritanopes (no S). The cone fundamentals for each subject are cornea-referred; the fundamentals combine the spectral properties of the cornea, lens and macular pigment. These elements differ between people and the lens absorption increases with age [29–31]. Current standards for cone fundamentals account for these factors, and indeed attention to such variation is key to maximizing the accuracy of the standards. Here we focus on explaining the principles rather than applying them with the level of precision that would be required to create a standard. We present an illustrative analysis of dichromatic matches based on population average data.

Colour matching experiments can be described using linear algebra because the experiments satisfy the principle of additivity that defines a linear system [32]. Specifically, consider the functions that describe the spectral energy in two test lights, e1(λ) and e2(λ) . In trichromats, the colour matching experiment maps any test light spectral energy distributions to the intensities of three primaries. Additivity means that the match to the sum of the lights is the sum of the matches to each light alone:

(2.1) F(e1(λ)+e2(λ))=F(e1(λ))+F(e2(λ)),

where F maps the spectral power distribution to three primary intensities. In colour science, such additivity is one of the principles referred to as Grassmann’s Laws [9,33]. Because the experiment is additive, there are three functions, ci(λ) , such that the inner product, ⟨ci,e1⟩ , is the intensity of the ith primary in the match [32]. The ci(λ) are called the colour matching functions.

The functions ei and ci , can be discretized and represented as N-dimensional vectors, where N is equal to the number of wavelength samples in the input spectrum, say from 380 to 780 nm in 5 nm increments. The colour matching functions, ci(λ) , can be combined into the columns of a matrix 𝐂∈ℝN×3 . By linearity, we can calculate the intensities of the primaries that match a test light, 𝐂t𝐞i . This formulation achieves Maxwell’s goal: we use the colour matching functions to calculate the intensities of three primary lights that would match any test light. If two lights, presented in the same context, are matched by the same primaries, 𝐂t𝐞1=𝐂t𝐞2 , the lights will appear the same. The linearity principle and the linear algebraic formulation are fundamental to many fields of science and engineering [34].

(a) The colour matching functions

Measurements made using different primary lights yield different colour matching functions. Any pair of colour matching functions will be related to one another by a 3×3 linear transformation [17]. Because the cone fundamentals can serve as a set of colour matching functions, all valid colour matching functions must be within a 3×3 linear transformation of the cone fundamentals.

Suppose we represent the cone fundamentals as l(λ),m(λ),s(λ) , discretized in vector form as l,m,s∈RN×1 . Dichromats need only two primary lights to match any light. The colour matching functions of a dichromat will be within a 2×2 linear transformation ( 𝐀p,𝐀d and 𝐀t ) of their two cone fundamentals. In matrix form, we have

(2.2) Cp=[c1p c2p]=[m s]Ap,Cd=[c1d c2d]=[l  s]Ad,Ct=[c1t c2t]=[l  m]At.

The dichromatic colour matching matrices are 𝐂p,𝐂d,𝐂t∈ℝN×2 .

(b) Cone fundamental estimation by subspace intersection

The three cone fundamentals can be estimated from the colour matching functions of the three types of dichromats. The cone fundamental that is in common between each pair of dichromats can be found by calculating the null space of the N×4 matrix created by combining the dichromatic colour matching functions.

For example, consider the colour matching functions of a protanope and tritanope. These two individuals share the M-cone fundamental, 𝐦 . Consequently, there is a linear combination of each of their colour matching functions that equals the M-cone fundamental. When the coefficients of these linear combinations are represented as the vectors 𝐱p∈ℝ2 and 𝐱t∈ℝ2 , we can formalize the above statement as:

(2.3) 𝐦=𝐂p𝐱p,𝐦=𝐂t𝐱t.

Subtracting the two equations we have

(2.4) 𝟎=𝐂p𝐱p−𝐂t𝐱t=[𝐂p−𝐂t][𝐱p𝐱t].

The space of all solutions to equation (2.4) is the null space of the matrix [Cp−Ct] : the set of vectors that the matrix maps to zero. The null space can be calculated using the linear algebra packages in all major programming languages. In this case, the null space is one-dimensional, and it can be expressed as the vector times a scalar, α[xpxt] . The cone fundamental, which is common to the two dichromats, can be estimated using the null space vector:

(2.5) null([Cp−Ct])=α[xpxt],such that,m^p=αCpxp,≈m^t=αCtxt.

Equation (2.5) represents the result as an approximation because measurement noise and the possibility of individual differences in the inert pigments, photopigment absorbance spectra and photopigment densities mean there will not be a true null space, α[𝐱p𝐱t] . A consequence is that the two estimates, 𝒎^𝒑 and 𝒎^𝒕 , will differ from one another. Moreover, any solution will depend on the numerical algorithm we use to approximate the null space. Here, we estimated the null space using the singular value decomposition (SVD), which returns the nontrivial vector with the smallest mean squared error subject to ‖αxp‖2+‖αxt‖2=1 .

It is also possible to estimate the null space as an explicit numerical optimization, i.e. find the minimum of ‖Cpxp−Ctxt‖ subject to a constraint that prevents the degenerate solution 𝐱p=𝐱t=0 . This approach would allow the incorporation of other constraints, for example, that the estimated cone fundamental be non-negative. We plot the estimate based on xp in figure 4. We implement other methods in the GitHub software repository 2 and plot the different estimates.

(c) Geometric interpretation

The calculation in §2b makes no assumption about the primary lights used to measure the colour matching functions. In fact, the primaries used for the different dichromats can differ across the dichromats and need not be known. To understand how this can be, a geometric interpretation may be helpful.

Each colour matching function can be represented as a high-dimensional vector, with dimensionality equal to the number of sample wavelengths. The two colour matching functions from each dichromat span a plane through the origin in this wavelength space. The two planes for any pair of dichromats both contain a line that represents their common cone fundamental. This line, which also passes through the origin, is found at the intersection of the two planes. It is this intersection that is calculated in equation (2.5).

We can visualize this calculation for a low-dimensional example. Suppose the colour matching functions are sampled at only three wavelengths, so that the vector representing each dichromatic colour matching function is three-dimensional. Since colour matching functions for a given observer are within a linear transform of each other, the two vectors define a plane comprising all possible colour matching functions (figure 2). The planes for the protanope and tritanope both contain the vector representing the M-cone fundamental, so that the two planes intersect in the M-cone vector. No matter which primary lights were used to measure the colour matching functions, the planes spanned by the colour matching functions are the same. Hence, the intersection is independent of the primary lights.

Figure 2. When sampled at only three wavelengths, the colour matching functions are three-dimensional, and the pair of functions for each dichromat define a plane. The planes for a tritanope and a protanope are illustrated schematically. The plane for each dichromat contains the vectors defining the two cone fundamentals for that dichromat: the L- and M-cone fundamentals for the tritanope; the M- and S-cone fundamentals for the protanope. Note that the plane spanned by the colour matching functions for each dichromat is independent of the primary lights used to measure them; this is because each colour matching function is a linear transformation of the dichromat’s cone fundamentals and thus must lie in the plane spanned by those fundamentals. The intersection of the planes for the two dichromats must contain the cone fundamental they share, here the M-cone fundamental. Since the intersection of two planes is a line, this line defines the cone fundamental up to a scalar.

When sampled at only three wavelengths, the colour matching functions are three-dimensional, and the pair of functions for each dichromat define a plane

The analysis we describe for deriving cone fundamentals using data from reduction dichromats differs from the approach based on König’s important work [20,35]. That approach, which is also included as a tutorial program in our software repository (see ‘tutorials/konig’), begins in the three-dimensional space defined by the trichromatic colour matching functions, not the wavelength representation. Confusion lines in the trichromatic space are found for each type of dichromat. Differences between stimuli on a confusion line are invisible to the dichromat, defining a stimulus that isolates the dichromat’s missing cone class. 3 With knowledge of these trichromatic stimuli, it is possible to recover the linear transformation between the trichromatic colour matching functions and the cone fundamentals [36]. The König method requires dichromatic confusion measurements in a trichromatic colour space. By analysing the colour matches directly in wavelength space, the subspace intersection method does not rely on confusion lines; nor does it require making measurements with the same primary lights for different subjects.

3. Results

The subspace-intersection method requires measurements of the colour matching functions from all three types of dichromats. Analyses of dichromatic colour matching functions were initiated in the latter part of the nineteenth century by König & Dieterici [18]. Colour matching functions of dichromats were later reported in a series of papers from Wright and Pitt [37–39]. The accompanying software repository includes these data, comparisons between them and the modern standards, and some caveats about the data (see figure 3).

Figure 3. The Wright dichromatic colour matching functions (solid) compared with a linear transformation of the CIE cone fundamentals (dotted). The protan and deutan functions were converted to digital form from figures in Wright’s book [37]. The tritanopic data were provided as tables [38]; notice that the wavelength range for the tritanopes is narrower. The original deutan data have an implausible short-wavelength colour matching function (grey dotted curves). The estimates in figure 4 were made by substituting the protan blue primary for the deutan (corrected). For both of these dichromats the short-wavelength primary should be dominated by the common S-cone. This figure is rendered by the script fig03WDWDichromats/wdwStockman.m.

The Wright dichromatic colour matching functions (solid) compared with a linear transformation of the CIE cone fundamentals (dotted).

Figure 4. Cone fundamentals are derived from the Wright and Pitt dichromatic colour matching functions. The top row compares the better of the two estimated fundamentals (dark, 𝐱p solution) with the CIE cone fundamentals (grey dotted) [11]. The estimates are calculated from the modified Wright data (figure 3). The bottom row shows the log10 difference between the curves for CIE values greater than 0.05 (peak = 1). The calculation and graphs are produced in the software repository script fig04ConeEstimates/fig04ConeEstimates.mlx. A second estimate is similar; it is plotted in the repository script.

Cone fundamentals derived from the Wright and Pitt dichromatic colour matching functions. The top row compares the better of the two

Applying the methods from §2b to the dichromatic data of Pitt and Wright [37–39] yields estimates of the cone fundamentals (figure 4). There are some limitations to the data, which were measured at different times and labs in experiments spanning more than a decade. (i) None of the subjects was genetically tested to show they are pure reduction dichromats, so it is likely that the mean values include measurements from dichromats who are not of the pure reduction type. (ii) Like others [19], we believe there is an error in the curve drawn for the blue primary of the deutan subjects; we substituted the blue primary of the protan subjects because it should be very close to the same for both dichromats. With these limitations, the estimates based on three pairs of average dichromatic colour matching functions and the current CIE cone fundamentals agree over most of the range to within about 0.1log10 units. The main differences are in the M-cone fundamental below 500 nm, and the estimated L-cone fundamental at wavelengths below 475 nm.

4. Discussion

This article describes data and theory developed over two centuries, making it impossible to offer a complete review of the relevant literature. We limit the discussion to a few points: (i) the reproducibility of the historical literature; (ii) the value of knowing the cone fundamentals; (iii) colour appearance and colour matching; and (iv) virtual channels in image systems, robotics and computer vision applications. We plan to explore the image systems applications more fully in a separate paper.

(a) Reproducibility

Colour matching measurements are in the great tradition of psychophysics; stimuli have precise physical units and experiments use simple and highly reliable psychological judgments. The tabulated data in the historical papers made it possible for us—and Judd before us—to compare Maxwell’s measurements acquired more than a century ago with the CIE standard colour matching functions used by thousands of modern image systems engineers to design products viewed by billions of people. We also quantify the difference between the estimates with the modern cone fundamentals.

A small amount of the data needed for this article was either not tabulated, represented with units or conventions that are no longer used, or presented in ways that required us to recover the measurement from a graphed quantity. These limitations introduced uncertainty in our estimates. It is both obvious and worth emphasizing that tabulated measurements in internationally accepted units provide a firmer basis for reproducibility. The psychophysical methods and tabulation of the data provide an excellent basis for reproducible research.

(b) Biological substrate

The excellent quantitative agreement between behavioural colour matching data and cone photocurrent action spectra [40] establishes a connection between perception and a neural substrate; it is one of the clearest connections in all of neuroscience. It is worth remembering that the CIE colour matching standards were used in many applications before the neural substrate was established. The identification of the substrate is intellectually satisfying and adds value; but knowledge of the substrate was not critical to many successful applications. Had Hering been correct, and the cone photopigments encoded light using an opponent mechanism [41], Maxwell’s colour matching functions would still have been useful for colour photography.

An important value of the CIE cone fundamentals is that they provide a mechanistic description. Investigators analysing the cone fundamentals needed to consider several components of the biological substrate: the lens, macular pigment, and photopigments. The contributions of these separate mechanisms are useful to understand and model population variance [32. fig 9; 30] and to predict the consequences one might expect from certain diseases. The colour matching functions are a very useful phenomenological model; cone fundamentals are a mechanistic model that is intellectually satisfying and potentially of clinical significance.

(c) Colour appearance and colour matching: a historical note

In the century following Maxwell’s work, several prominent authors criticized the Young–Maxwell–Helmholtz programme for failing to address colour appearance. 4 It is, indeed, striking that there is almost nothing of colour appearance in Maxwell’s colour matching experiment; his subjects matched only a white light. In our view, however, the power of the Young–Maxwell–Helmholtz research programme arises from recognizing that quantifying matches does not require quantifying appearance. An important reason for this is that in general a pair of matched lights seen in a different context, or with a new spatial pattern, or flickered, continue to match. However, the appearance—of both—will change. Colour matching can be widely applied, and related to the cone fundamentals, even without a complete theory of colour appearance.

(d) Virtual colour channels

The subspace intersection idea (§2b) may have value in modern image systems applications. One potential application is a new way to relate the responses of two cameras with different colour channels, or one camera and the human visual encoding, or between two different life forms (person and pet; predator and prey).

The key idea is to create a virtual colour channel by the intersection of the subspaces defined by the colour channels in the two systems. We describe the virtual channel idea here because it differs from the conventional approach to matching data between two different systems.

(i) Low-dimensional example

We visualize the virtual colour channel concept in figure 5, again showing the reduced case of three wavelengths to make the graphical representation straightforward. In this case, we illustrate two cameras, each with two colour channels. The spectral quantum efficiency of each channel is specified by a 3-vector; the two vectors for cameras A and B, and the planes they span, are shown in figure 5.

Figure 5. The virtual channel. In a world comprising three wavelengths, we can specify a colour channel as a 3-vector. The red lines represent two colour channels in camera A; the dark plane shows the range of channels that can be computed as a weighted sum of these two channels. The blue lines show two channels in camera B. No linear transformation of the camera A channels closely approximates the camera B channels. The light plane shows the range of channels that can be computed for camera B. The intersection of the two planes (dashed line) is a virtual channel that is in common between cameras A and B. The image contrast from the two cameras can be compared quantitatively on this virtual channel. See the software repository script fig05VirtualChannels.mlx.

We visualize the virtual colour channel concept), again showing the reduced case of three wavelengths to make the graphical representation straightforward.

Current practice relates data from two cameras by finding a linear transform that maps camera A channels into close approximations of camera B channels [43–45]. The range of possible channels that can be created from camera A falls within the dark-shaded plane in figure 5. The range of linear combinations of the camera B channels is shown by the light-shaded plane. The two camera B channels are far from the plane of possible camera A channels. Hence, the best approximation to the camera B channels will be poor.

The intersection of the two planes is a virtual channel available to both cameras, but present in neither. No linear combination of channels in either camera matches a channel in the other, but the virtual channel is available to both. It can be used to meaningfully compare image contrast for any light.

(ii) Higher-dimensional example

In the example above, we illustrated the case of two cameras with two channels for didactic purposes. As we consider the more realistic case of higher-dimensional spectra, and different numbers of cameras and channels, there are other possibilities. Consider the case of two cameras, each with three spectral channels. We represent the channel spectral quantum efficiencies of the two cameras in the columns of two matrices C=[r,g,b] and 𝐂~=[𝐫~,𝐠~,𝐛~] . We use the intersection method to identify virtual colour channels that are available to both cameras (§2b).

To find the virtual channels we solve for two three-dimensional column vectors, 𝐯 and 𝐯~ , such that 𝐂𝐯=𝐂~𝐯~ . As before, we create a matrix that joins the six colour channels in its columns, J=[C,C~] and analyse the null space of this matrix. There are four possibilities corresponding to the plausible ranks of the matrix 𝐉 : the camera colour matrices, 𝐂 and 𝐂~

— rank 3: The camera channels occupy the same three-dimensional space

— rank 4: The virtual channels span a plane

— rank 5: A single virtual channel

— rank 6: No commonality.

Nearly universally, modern image systems rely on the rank 3 approximation [43–45]: there is a 3×3 matrix transformation that maps a vector measured by 𝐂 into an estimate of the measurement that would have been obtained from 𝐂~ . The virtual channel analysis provides a complementary approach, providing a method when 𝐉 has rank 4 or 5. Figure 5 illustrates that a virtual channel may exist even though the 3×3 approximation is poor.

The brief development here is for a common case: two cameras, each with three channels. There is a general formulation for D number of cameras, each with ND channels, and there are multiple ways in which the virtual channel concept might be applied to complement the traditional analyses. We will treat this approach more fully in a future paper.

5. Conclusions

Colour science has established a set of principles and standardized certain measurements that define how spectral electromagnetic radiation is encoded by the cone receptors in the human eye. This work was built on quantitative measurements using secure behavioural methods (matching). The principles established by Young in 1802 and the measurements reported by Maxwell in 1860 remain relevant today. Their work serves as the basis for all modern colour technologies, including displays, cameras and printing.

Over the centuries, the mathematics underpinning these measurements has evolved. Young’s idea of a biological substrate was expressed and tested by Maxwell using a set of linear equations. His work took place at the time that Grassmann was developing a general mathematics of linear algebra and higher-dimensional vector spaces [46], and these techniques have become a powerful tool in science and engineering. These tools now permeate the field of colour science, particularly in the last few decades. This article introduces new ideas based on this linear algebraic formulation.

First, we describe a novel method to solve the classical problem of identifying the cone fundamentals from the data of reduction dichromats. Our interest in this method arises because it uses only colour matching functions from dichromats, requiring no auxiliary data, and can be applied simply without knowledge of or explicit correction for different sets of primaries used to collect data from different types of dichromats. The method calculates the intersection of the subspaces defined by the colour matching functions of pairs of dichromats. We show that fundamentals derived using average colour matching data from three types of dichromats are in good agreement with the most precise modern estimates of the cone fundamentals.

The estimates of cone fundamentals we provide here—based on these historical data—do not improve on the modern standard. Our interest is to describe the subspace intersection method; we analyse the historical data only to show the feasibility of the approach. By using the linear algebra framing, rather than the specialized language of colour science, we can generalize the method to a new image systems application. Specifically, the conventional approach for relating the images between two different colour cameras, or between a camera and human visual system, is to find a linear transformation between the sensor encoding [43–45]. The subspace intersection method generalizes this approach, explaining how to search for two linear transformations—one applied to each camera—that define a virtual channel where data from the two cameras can be compared quantitatively.

In summary, the subspace intersection method simplifies the calculation of cone fundamentals based on confusion lines. All of the data can be obtained using instrumentation with only two primary lights, and there is no need to measure with three primaries. In addition, the method leads to the idea of a virtual channel, which may find applications in imaging systems, robotics and computer vision.

Acknowledgements

We thank Anthony Morland, Joyce Farrell, Hannah Smithson, Fang Fang and Nicolas Cottaris for useful discussions and advice about the manuscript.

Ethics

This work did not require ethical approval from a human subject or animal welfare committee.

Data accessibility

The historical data we used for this paper are available in three locations. First, they are available in the original publications. Second, they are available in the GitHub repository [47]. Third, they are available in the Stanford Libraries Digital Repository [48].

Declaration of AI use

We have not used AI-assisted technologies in creating this article.

Authors’ contributions

B.A.W.: conceptualization, data curation, formal analysis, methodology, resources, software, supervision, validation, visualization, writing—original draft, writing—review and editing; T.G.: conceptualization, methodology, software, visualization, writing—review and editing; D.H.B.: conceptualization, data curation, formal analysis, validation, visualization, writing—original draft, writing—review and editing.

All authors gave final approval for publication and agreed to be held accountable for the work performed herein.

Conflict of interest declaration

We declare we have no competing interests.

Funding

No funding has been received for this article.

1 The software repository that accompanies this paper (https://github.com/isetbio/isetfundamentals/wiki) includes data and code that we used to convert the tables in Maxwell’s 1860 paper into the format of modern colorimetry and that produces figure 1. At a time when reliability and replication of results is of great concern to all scientists, we are pleased to confirm Judd and report that Maxwell’s data, measured 160 years ago on two typical trichromats, are consistent with the modern standards.

2 The software repository, including the data, is at https://github.com/isetbio/isetfundamentals/wiki. The datafiles are also available through the Stanford Digital Repository at https://purl.stanford.edu/jz111ct9401.

3 Often, the confusion lines are plotted in chromaticity, and the intersection of confusion lines originating at different chromaticities is referred to as the co-punctal point. Co-punctal points may also be used to define stimuli that isolate the missing class of cones for a dichromat. Consult tutorials/konig program for details.

4 “... modern tendency in sensory physiology, which has found its most acute expression in the Physiological Optics of Helmholtz, is not leading us to the truth, and whoever wishes to open up new avenues of research in this area, must first free himself from the theories which now prevail” (E. Hering, quoted in [42]).
==== Refs
References

1. Maxwell JC . 1860 On the theory of compound colours, and the relations of the colours of the spectrum. Phil. Trans. R. Soc. Lond. 150 , 57–84. (10.1098/rstl.1860.0005)
2. Mollon JD . 2003 The origins of modern color science. In The science of color (eds SK Shevell , SK Shevell ), pp. 1–39. Amsterdam, The Netherlands: Elsevier. (10.1016/B978-044451251-2/50002-7)
3. Young T . 1802 On the theory of light and colours. Phil. Trans. R. Soc. Lond. 92 , 20–71. (10.1098/rstl.1802.0004)
4. Maxwell Jc . 1857 Experiments on colour, as perceived by the eye, with remarks on colour-blindness. Trans. R. Soc. Edinb. Earth Sci. 21 , 275–298. (10.1017/S0080456800032117)
5. Maxwell JC . 1857 The diagram of colors. Trans. R. Soc. Edinb. 21 , 275–298. (10.1017/S0080456800032117)
6. Judd DB . 1961 Maxwell and mordem colorimetry. J. Photogr. Sci. 9 , 341–352. (10.1080/00223638.1961.11736821)
7. Judd DB . 1966 Fundamental studies of color vision from 1860 to 1960. Proc. Natl Acad. Sci. USA 55 , 1313–1330. (10.1073/pnas.55.6.1313)5297724
8. Maxwell JC , Zaidi Q . 1993 On the theory of compound colours, and the relations of the colours of the spectrum. Color Res. Appl. 18 , 270–287. (10.1002/col.5080180411)
9. Grassmann . 1854 On the theory of compound colours. Lond. Edinb. Dub. Phil. Mag. J. Sci. 7 , 254–264. (10.1080/14786445408647464)
10. Stockman A , Sharpe L . 2000 The spectral sensitivities of the middle- and long-wavelength-sensitive cones derived from measurements in observers of known genotype. Vision Res. 40 , 1711–1737. (10.1016/s0042-6989(00)00021-3)10814758
11. Stockman A . 2019 Cone fundamentals and CIE standards. Curr. Opin. Behav. Sci. 30 , 87–93. (10.1016/j.cobeha.2019.06.005)
12. Normann J . 2023 James Clerk Maxwell produces the first color photograph. See https://www.historyofinformation.com/detail.php?id=3666.
13. Helmholtz H . 1852 On the theory of compound colours. Lond. Edinb. Dub. Phil. Mag. J. Sci. 4 , 519–534. (10.1080/14786445208647175)
14. Turner RS . 1996 The origins of colorimetry: what did helmholtz and maxwell learn from grassmann? In Hermann Günther graßmann (1809–1877): visionary mathematician, scientist and neohumanist scholar, pp. 71–86. Dordrecht, The Netherlands: Springer. See https://link.springer.com/chapter/10.1007/978-94-015-8753-2_8.
15. Heesen R . 2015 PhilSci Arch. See http://philsci-archive.pitt.edu/11279.
16. Brewster D . 1834 On a new analysis of solar light, indicating three primary colours, forming coincident spectra of equal length. Trans. R. Soc. Edinb. Earth Sci. 12 , 123–136. (10.1017/S0080456800030532)
17. Wandell BA . 1995 Foundations of vision. Sunderland, MA: Sinauer.
18. König A , Dieterici C . 1886 Die grundempfindungen und ihre intensitäts-vertheilung im spectrum [fundamental sensations and their intensity distribution in the spectrum]. Sitzungsb. Akad. Wiss. Berl. 1886 , 805–829.
19. Bouma PJ . 1942 Mathematical relationship between the colour vision systems of trichromats and dichromats. Physica 9 , 773–784. (10.1016/S0031-8914(42)80054-3)
20. Judd DB . 1945 Standard response functions for protanopic and deuteranopic vision. J. Opt. Soc. Am. 35 , 199–221. (10.1364/JOSA.35.000199)
21. Nuberg ND , Yustova EN . 1955 Investigation of color vision of dichromats. Stud. State Opt. Inst. Moscow 25 , 33.
22. Judd DB . 1964 Relation between normal trichromatic vision and dichromatic vision representing a reduced form of normal vision. Acta Chromatica 1 , 524–527.
23. Vos JJ , Walraven PL . 1971 On the derivation of the foveal receptor primaries. Vision Res. 11 , 799–818. (10.1016/0042-6989(71)90003-4)5094974
24. Smith VC , Pokorny J . 1972 Spectral sensitivity of color-blind observers and the cone photopigments. Vision Res. 12 , 2059–2071. (10.1016/0042-6989(72)90058-2)4539070
25. CIE . 2007 Fundamental chromaticity diagram with physiological axes – parts 1 and 2. Tech. Rep. pp. 170–171. CIE 170-1:2006. Vienna, Austria: Central Bureau of the Commission Internationale de l’Éclairage.
26. Vos JJ , Estévez O , Walraven PL . 1990 Improved color fundamentals offer a new view on photometric additivity. Vision Res. 30 , 937–943. (10.1016/0042-6989(90)90059-t)2385931
27. Stockman A , MacLeod DI , Johnson NE . 1993 Spectral sensitivities of the human cones. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 10 , 2491–2521. (10.1364/josaa.10.002491)8301403
28. Stockman A . 2001 Colour and vision research laboratory. See http://www.cvrl.org (accessed 19 February 2019).
29. Webster MA , MacLeod DIA . 1988 Factors underlying individual differences in the color matches of normal observers. J. Opt. Soc. Am. A 5 , 1722–1735. (10.1364/JOSAA.5.001722)3204435
30. Asano Y , Fairchild MD , Blondé L . 2016 Individual colorimetric observer model. PLoS One 11 , e0145671. (10.1371/journal.pone.0145671)26862905
31. Stockman A , Rider AT . 2023 Formulae for generating standard and individual human cone spectral sensitivities. Color Res. Appl. 48 , 818–840. (10.1002/col.22879)38504724
32. Wandell BA , Brainard DH , Cottaris NP . 2022 Visual encoding: principles and software. Prog. Brain Res. 273 , 199–229. (10.1016/bs.pbr.2022.04.006)35940717
33. Krantz DH . 1975 Color measurement and color theory: I. Representation theorem for Grassmann structures. J. Math. Psychol. 12 , 283–303. (10.1016/0022-2496(75)90026-7)
34. Strang G . 2022 Introduction to linear algebra, 6th edn. SIAM. See https://epubs.siam.org/doi/pdf/10.1137/1.9781733146678.fm.
35. Wyszecki G , Stiles WS . 1982 Color science: concepts and methods, quantitative data and formulae, 2nd edn. New York, NY: John Wiley & Sons.
36. Moreira H , Álvaro L , Melnikova A , Lillo J . 2018 Colorimetry and dichromatic vision. In Colorimetry and image processing (ed. CM Travieso-Gonzalez ), pp. 3–21. Rijeka, Croatia: InTechOpen. (10.5772/intechopen.71563)
37. Wright WD . 1938 Research on normal and defective colour vision. London. UK: Henry Kimpton. See https://play.google.com/store/books/details?id=UTxjXwAACAAJ.
38. Wright WD . 1952 The characteristics of tritanopia. J. Opt. Soc. Am. 42 , 509–521. (10.1364/josa.42.000509)14946611
39. Pitt F . 1935 Characteristics of dichromatic vision. In Reports of the committee upon the physiologyof vision, pp. 1–55, vol. 14 . Medical Research Council. See https://www.cabdirect.org/cabdirect/abstract/19352701859.
40. Baylor DA . 1987 Photoreceptor signals and vision. Proctor Lecture. Invest. Ophthalmol. Vis. Sci. 28 , 34–49.3026986
41. Hering E . 1964 Outlines of a theory of the light sense. Cambridge, MA: Harvard University Press.
42. Howard IP . 1999 The Helmholtz--Hering debate in retrospect. Perception 28 , 543–549. (10.1068/p2805ed)10664753
43. Brown MS . 2023 Color processing for digital cameras. In Fundamentals and applications of colour engineering (ed. P Green ), pp. 81–98. Hoboken, NJ: Wiley. See https://onlinelibrary.wiley.com/doi/10.1002/9781119827214.ch5.
44. Delbracio M , Kelly D , Brown MS , Milanfar P . 2021 Mobile computational photography: a tour. Annu. Rev. Vis. Sci. 7 , 571–604. (10.1146/annurev-vision-093019-115521)34524880
45. Afifi M , Brown MS . 2019 Sensor-independent illumination estimation for DNN models. arXiv 1912.06888 [cs.CV]. (10.48550/arXiv.1912.06888)
46. Grassmann H . 1853 Zür theorie der farbenmischung. Ann. Phys. 165 , 69–84. (10.1002/andp.18531650505). [In German].
47. isetbio . 2024 Isetfundamentals. GitHub. See https://github.com/isetbio/isetfundamentals/wiki.
48. Wandell B , Goossens T , Brainard D . 2024 Data from: Deriving the cone fundamentals: a subspace intersection method. Digital Dryad Repository. (10.25740/jz111ct9401)
