Coly Technologies – Technical Manual
PSYCHOMETRIC ASSESSMENT – THEORETICAL FOUNDATION
Coly ME is a digital tool that maps personality and values through a psychometric assessment. The device uses the collected data points to form compatible groups of tenants for shared living and to produce unique personality & values profiles that provide personalized guidance to tenants.
The psychometric assessment maps; personality, values, motives, and preferences. The assessment is statistically examined and constructed to be objective and unbiased. The Coly assessment uses standard testing methods; all respondents use the same format, sequence, questions/items, and instructions for completing the assessment.
Personality refers to individual differences in characteristic thinking, feeling, and behavior patterns (APA, American Psychologist Association).
Personality traits are predispositions to act in particular ways consistent across different situations and stable over time.
The Big Five personality traits are about answering the question: "Who are you?" The different main characteristics of personality form the acronym OCEAN.
Openness to experience - a general appreciation for art, emotion, adventure, unusual ideas, imagination, curiosity, and variety of experience
Conscientiousness - a tendency to display self-discipline, act dutifully, and strive for achievement against measures or outside expectations
Extraversion - is a broad personality trait that exists on a continuum of attitudes and behaviors. Extraverts are outgoing, assertive, lively, and expressive, while introverts tend to be quiet, deliberate, and low-key.
Agreeableness - reflects individual differences in general concern for social harmony.
Emotional Stability (Neuroticism) - the tendency to be either stress-tolerant or experience negative emotions, such as anger, anxiety, or depression
The Coly ME tool measures values with PVQ. It is based on The Ten Universal Values theory and is one of the most common tools for assessing people ́s values in studies. The theory divides the ten fundamental values into four higher-order groups.
Self-Transcendence
Universalism - Appreciation of tolerance and protection of all people and nature. The commitment to equality, striving to understand people different from oneself.
Benevolence - Preservation and enhancement of the well-being of people that one is close to.
Conservation
Conformity - Preference for following social expectations, rules, and norms.
Tradition - Preference for maintaining and preserving cultural, family, or religious traditions.
Security - Preference for safety, Stability, and low-risk-taking.
Self-enhancement
Power - Control or dominance over people and resources.
Achievement - The importance of personal success and demonstrating competence according to social standards.
Hedonism - The preference for experiencing entertainment and thinking it is essential to have fun.
Openness to Change
Activity - To prefer excitement, novelty, and challenge in life.
Self-Direction - To prioritize independent choices and actions, determining one ́s own actions and cultivating own ideas.
Test Quality
How do we know that the Coly ME tool is a reliable and valid test instrument?
Convergent validity refers to how closely the new scale relates to other measures of the same psychological construct - personality.
Procedure: In 2021, Coly recruited 100+ study participants who completed the Coly ME assessment and the world-class standard in the science of personality, the NEO -120 test. The Pearson Correlation Coefficient was used when calculating the correlation between Coly ME and the standard.
Results: The five scales (The Big Five personality traits) showed significantly high convergent validity between Coly ME Assessment and the Neo Scales.
Conclusions: Coly ME has high convergent validity with the golden standard personality test, according to global standard recommendations of at least 0,7 as a measure of a good convergent validity of the measurements.All of the scales had values well over 0,7.
Openness R=0,89
Conscientiouasness R= 0,90
Extraversion R= 0,92
Agreeableness R=0,85
Emotional Stability R=0,91
*All results are significant on a 0,01 Level
Scale Reliability
Reliability captures the trustworthiness or consistency of a measure. Internal consistency is an index of the reliability of a test and measures homogeneity among the items on a test, such that they are consistent with one another and measuring the same thing. The Cronbach Alpha value is a reliability coefficient that measures the internal consistency of tests and measures. A Cronbach ́sAlpha value above 0,6 is strived for, and a value between 0,7-0,8 is interpreted as sound.
Conclusions: The Coly ME assessment has high reliability!
For the global golden version NEO FFI (the 60-item version), the internalconsistencies reported in the manual are;N (E.S) = 0.79, E = 0.79, O = 0.80, A = 0.75, C = 0.83.Thus, the internal reliability of Coly is excellent and comparable to the samestandards of reliability as the golden version of the Big five personality test.
Openness α = 0,76
Conscientiousness α = 0,81
Extraversion α = 0,86
Agreeableness α = 0,79
Emotional Stability α = 0,84
Construct Validity
Confirmatory factor analysis (CFA) isa statistical technique used in testdevelopment to verify that a set ofquestions/items provide evidencefor the test's construct validity. Itmeans that some items that aresupposed to measure the samepsychological construct Big fivepersonality traits should clustertogether and have shared variance.
Results: For N=135 people takingColy’s Personality assessment, theFactor Loadings of the test itemsclustered data in a factor structurethat corresponds with the Big five.The result shows that the items thatare supposed to measure the sametraits are intercorrelated.
Matching Algorithm
RANDOM FOREST & DECISION TREE MODELING
Coly is collecting data and evolving the matching algorithm using one of the most potent machine-learning models: random forests. A random forest is a supervised machine-learning algorithm constructed from decision trees and utilizes ensemble learning. The Model combines many classifiers to provide solutions to complex problems, which is perfect for the complex setting of matching people. The Model is trained using data from the psychometric assessments to optimize tenant living groups based on social function, NPS, and matching satisfaction (Net Promoter Score).
The algorithm currently used has been found to improve social function and NPS by 30 and 35 %, respectively. Social function is defined as team satisfaction, cooperation, conflict management ability, team cohesion, team viability, and well-functioning everyday interactions and routines.
Moreover, NPS and Social Function are strongly correlated with a sense of community, general living satisfaction, feeling at home in shared living, and good conflict management.
Coly gathers data on social function with items with a very high correlation with the entire Social Function scale. That way, it ensures that the Model is trained on validated target information but still gets a simple feedback loop for the tenant's answer. Coly will also gather more information in collaboration with some operators to ensure the quality of measurements.
Have questions?
Please e-mail any questions you may have to our Customer Service department and we'll get back to you within 24 hours.