| 1. Domain | 1.1 Scope of the Domain | Boundaries | The range of phenomena the science includes and excludes. | Examines how behavior is acquired, modified, strengthened, or extinguished through experience, reinforcement, punishment, contingencies, cues, and environmental shaping. Includes classical conditioning, operant conditioning, reinforcement schedules, habit formation, extinction, stimulus generalization, shaping, and behavioral modeling. Excludes cognitive processes unless mediated through observable learning mechanisms. |
| | Scale | The spatial, temporal, or organizational level at which the science operates (e.g., quantum, cellular, social, cosmic). | Operates at organism-level behavioral timescales (milliseconds to weeks), trial-by-trial learning curves, repeated exposure cycles, and stable behavioral adaptation patterns across contexts. |
| 1.2 Ontological Commitments | Entities | The kinds of things assumed to exist within the domain (particles, organisms, agents, fields, etc.). | Stimuli, responses, reinforcers, punishers, cues, contingencies, conditioned/unconditioned stimuli, learned associations, habit loops, discriminative stimuli, reinforcement schedules, behavioral chains. |
| | Properties | The fundamental attributes these entities possess (mass, charge, genotype, preference, etc.). | Response strength, reinforcement value, contingency strength, learning rate, generalization gradients, extinction resistance, habit strength, discriminability, latency, frequency, reward prediction error. |
| | Categories | The basic ontological types used to classify domain elements (substances, processes, relations, structures). | Classical conditioning, operant conditioning, reinforcement schedules, extinction processes, discriminative control, stimulus generalization/discrimination, habit-formation mechanisms, behavioral shaping chains. |
| 1.3 State-Variables | Variables | The measurable or definable properties that describe system conditions. | Response frequency, response latency, reward magnitude, probability of reinforcement, rate of learning, error rates, associative strength (e.g., Rescorla–Wagner values), habit stability, extinction duration, discriminative stimulus value. |
| | Parameterization | How variables encode and represent the system’s state. | Encoded through trial-by-trial logs, reinforcement-rate parameters, schedule values (FR, VR, FI, VI), associative-strength equations, reward-prediction error signals, stimulus intensity gradients, probability functions. |
| 1.4 Admissible Idealizations | Simplifications | Conceptual reductions used to make the domain tractable (point masses, rational agents, perfect gases). | Treating organisms as behavior-only systems; assuming stable reinforcement values; ignoring internal cognitive states; simplifying environments to single cues; assuming constant motivation; modeling learning with linear or simple associative rules. |
| | Validity Conditions | The limits and contexts in which idealizations hold or break down. | Breakdown occurs in complex environments, shifting motivations, multi-cue contexts, cognitive reinterpretation of stimuli, social learning influences, or when reinforcement loses meaning (e.g., satiation). |
| 1.5 Domain Assumptions | Structural Assumptions | Background ontological stances such as determinism, continuity, randomness, discreteness. | Assumes behavior is shaped by contingencies; learning is systematic and measurable; associations strengthen or weaken predictably; reinforcement controls frequency; extinction mechanisms are reliable; organisms respond to environmental structure. |
| | Implicit Commitments | Unstated but necessary assumptions that shape the field’s conceptual structure. | Assumes environmental contingencies dominate over internal states; associations form similarly across individuals; reinforcement histories fully explain behavior; external observation captures learning processes. |
| 1.6 Internal Coherence Requirements | Consistency | The demand that domain concepts do not contradict one another. | Reinforcement models must align with observed behavior curves; associative-strength changes must match learning rates; extinction and generalization must follow predicted patterns; reinforcement schedules must produce consistent behavioral signatures. |
| | Compatibility | The requirement that entities, variables, and assumptions fit together into a unified descriptive framework. | Requires alignment among conditioning models, reinforcement rules, generalization mechanisms, extinction processes, shaping procedures, and habit-formation frameworks; models must integrate into a coherent behavioral account. |
| 2. Evidence Layer | 2.1 Observable Phenomena | Observables | The aspects of the domain that can produce detectable signals accessible to measurement. | Response latency, response frequency, acquisition curves, extinction curves, reinforcement-response patterns, generalization gradients, discrimination performance, shaping progressions, reward-seeking/punishment-avoidance behaviors. |
| | Detection Limits | The boundaries of what can be resolved or sensed by current instruments or methods. | Internal cognitive states unobservable; reinforcement value may vary without behavioral indication; covert learning undetected; subtle discriminations hard to measure; noise masks learning on short timescales; spontaneous recovery can mimic new learning. |
| 2.2 Measurement Systems | Units | Standardized quantifications (meters, seconds, volts, decibels, dollars, etc.) necessary for consistent comparison. | Response counts, response latency (ms), reinforcement magnitude, reinforcement probability, error rates, learning-rate parameters, associative-strength values, extinction duration, discrimination accuracy percentages. |
| | Instruments | Devices and tools (microscopes, spectrometers, sensors, surveys, detectors) used to produce measurements. | Operant chambers, response levers/buttons, automated reinforcement devices, tracking software, classical-conditioning rigs, behavioral coding systems, video analysis tools, clicker-training devices, animal-tracking sensors. |
| 2.3 Operational Definitions | Definitions | Terms defined by specific measurement procedures, ensuring empirical clarity. | Definitions of “response,” “reinforcer,” “punisher,” “discriminative stimulus,” “conditioned stimulus,” “association strength,” “extinction,” “generalization,” “shaping step.” |
| | Procedures | The explicit steps required to perform a measurement in a reproducible way. | Administering reinforcement schedules; manipulating stimuli; measuring response frequency; shaping complex behaviors stepwise; applying extinction contingencies; assessing generalization/discrimination; tracking learning trial-by-trial. |
| 2.4 Data Acquisition | Protocols | Formal processes for gathering data under controlled or standardized conditions. | Controlled behavioral experiments; repeated trials; randomized stimulus presentation; counterbalancing reinforcement conditions; long-term habit-formation paradigms; session-level logging of responses and reinforcers. |
| | Sampling | Rules determining which subset of the domain is measured and how representative it is. | Sampling across individuals, species, reinforcement histories, environmental contexts, stimulus intensities, reinforcement schedules, and time intervals; repeated-measures sampling for learning curves. |
| 2.5 Data Character & Format | Data Types | The form raw evidence takes (time series, spectra, images, counts, qualitative records). | Trial-by-trial logs, response-frequency tables, latency distributions, reinforcement histories, extinction curves, generalization gradients, discrimination matrices, coded behavioral videos. |
| | Resolution | The granularity or precision with which data is captured. | Determined by sampling rate, trial count, temporal precision of recording devices, granularity of reinforcement categories, clarity of stimuli, and stability of environmental conditions. |
| 2.6 Reliability & Calibration | Calibration | Adjustment procedures ensuring instruments produce accurate results. | Ensuring reinforcement devices deliver consistent magnitude; calibrating latency timers; validating stimulus intensity; confirming accurate response detection; checking inter-rater consistency in coded behavior. |
| | Error Characterization | Identification and quantification of noise, uncertainty, bias, and measurement error. | Instrument misfires, inconsistent reinforcer delivery, missed responses, observer bias, behavioral fatigue, accidental cues from experimenters, session-to-session variability, misclassification in discrimination tasks. |
| 3. Structural Layer | 3.1 Patterns & Regularities | Laws / Relations | Stable, repeatable patterns governing how observables behave across conditions. | Law of effect; acquisition and extinction curves; reinforcement–response contingencies; stimulus generalization gradients; discrimination learning patterns; predictable shaping sequences; habit strengthening through repetition. |
| | Invariants | Quantities or properties that remain constant under transformations (symmetries, conservation laws). | Response patterns under fixed schedules; stable discrimination boundaries; consistent reinforcement–response sensitivities; extinction-rate signatures; asymptotic performance levels; habitual behavioral loops. |
| 3.2 Causal Architecture | Mechanisms | Underlying processes or structures that produce the observed regularities. | Associative-strength mechanisms (Rescorla–Wagner); reinforcement and punishment mechanisms; prediction-error mechanisms; stimulus–response chaining; discriminative control; shaping through successive approximations. |
| | Pathways | Organized sequences of interactions forming a causal chain or network. | Cue → association → response reinforcement pathways; extinction pathways; shaping-step pathways; reinforcement-schedule escalation pathways; generalization-to-discrimination refinement pathways. |
| 3.3 Theoretical Vocabulary | Concepts | Core terms that encode the domain’s structure (force, gene, equilibrium, field). | Conditioning, reinforcement, punishment, discriminative stimulus, conditioned response, habit, shaping, generalization, extinction, contingency, prediction error, reinforcement schedule. |
| | Classifications | Taxonomies, categories, or typologies that organize entities and relations. | Classical vs operant conditioning; positive vs negative reinforcement; fixed vs variable schedules; ratio vs interval schedules; primary vs secondary reinforcers; simple vs chained behaviors; high vs low extinction resistance. |
| 3.4 Formal Representations | Equations | Mathematical constructs expressing laws, relations, or mechanisms. | Associative-strength update equations (e.g., ΔV = αβ(λ–V)); reinforcement-probability functions; extinction-rate curves; generalization-gradient functions; prediction-error formulas; habit-strength growth models. |
| | Models | Structured representations—mathematical, computational, or conceptual—used to predict and explain phenomena. | Rescorla–Wagner model; temporal-difference learning; Skinnerian operant models; habit-loop models; stimulus–response chain models; reinforcement-learning analogues (behavioral RL). |
| 3.5 Idealized Structures | Simplified Models | Purposeful abstractions that capture essential dynamics while omitting irrelevant detail. | Single-cue conditioning; noise-free reinforcement delivery; idealized reward values; linear learning curves; frictionless shaping sequences; perfectly stable reinforcement schedules; homogeneous motivation. |
| | Limit Conditions | Regimes where specific models or approximations hold (classical vs. quantum, linear vs. nonlinear). | Breakdowns with cognitive interference, motivational shifts, multi-cue complexity, changing environments, inconsistent contingencies, satiation, or when reinforcement loses discriminability or meaning. |
| 3.6 Integrative Frameworks | Unifying Theories | Higher-order structures that connect disparate laws or mechanisms under a coherent whole. | Associative-learning frameworks; reinforcement-learning paradigms; behaviorist theory; habit-formation frameworks; prediction-error learning theories; stimulus–response integration models. |
| | Interdisciplinary Links | Points where the theory connects to adjacent sciences or larger explanatory systems. | Links to neuroscience (dopamine RL circuits), cognitive psychology (attention and expectation), AI/ML (RL algorithms), behavioral economics (reward structure), and ethology (animal learning patterns). |
| 4. Method Layer | 4.1 Inquiry Design | Experimental Design | Structured plans for manipulating variables to test causal claims. | Manipulating reinforcement magnitude and probability; altering discriminative stimuli; varying reinforcement schedules (FR, VR, FI, VI); introducing extinction procedures; shaping behaviors via successive approximations; testing generalization gradients through stimulus variation. |
| | Observational Design | Systematic approaches for gathering non-manipulated data (surveys, field studies, natural experiments). | Observing naturally occurring reinforcement histories; measuring spontaneous behavioral frequencies; tracking habit patterns; monitoring environmental contingencies; observing extinction and recovery phenomena in real contexts. |
| 4.2 Testing & Validation | Hypothesis Testing | Procedures for evaluating whether evidence supports or contradicts specific claims. | Testing predictions from associative-strength models; validating reinforcement–response contingencies; checking extinction-rate predictions; evaluating discrimination accuracy; confirming generalization gradients; testing habit-formation speed under controlled schedules. |
| | Replication | The requirement that results be independently reproducible under similar conditions. | Repeating conditioning paradigms across subjects; rerunning reinforcement schedules; replicating extinction curves; reproducing generalization-discrimination tests; verifying associative-strength updates in multiple datasets. |
| 4.3 Inference & Evaluation | Statistical Inference | Rules for drawing conclusions from noisy or incomplete data. | Analyzing learning curves; estimating associative-strength parameters; modeling response distributions; evaluating reinforcement effects; computing generalization gradients; fitting extinction models; measuring prediction-error dynamics. |
| | Model Comparison | Criteria (fit, simplicity, predictive accuracy, robustness) used to evaluate competing models. | Comparing Rescorla–Wagner vs temporal-difference learning; comparing reinforcement schedules; evaluating habit-loop models vs associative models; contrasting S–R chains vs cognitive-RL hybrids; comparing discrimination-learning models. |
| 4.4 Error Management | Error Analysis | Identification and quantification of random and systematic errors. | Missed responses; inconsistent reinforcement delivery; latency-timer drift; ambiguous stimuli; unintentional cues; reward devaluation; participant fatigue; behavioral variability masking true learning effects. |
| | Bias Control | Methods for minimizing subjective, instrumental, or procedural biases. | Randomizing stimulus sequences; counterbalancing reinforcement conditions; standardizing reinforcer delivery; blinding coders; preventing inadvertent experimenter cues; controlling for satiation or motivational shifts. |
| 4.5 Adjudication & Revision | Peer Scrutiny | Collective evaluation of claims through critique, review, and debate. | Independent coding of behaviors; replication by separate labs; review of reinforcement procedures; reanalysis of learning curves; critique of modeling assumptions; reevaluation of extinction/generalization findings. |
| | Theory Revision | Procedures for modifying, replacing, or discarding models based on new evidence. | Updating associative-learning equations; refining prediction-error frameworks; revising extinction mechanisms; modifying reinforcement-schedule interpretations; integrating cognitive influences into behavioral models. |
| 4.6 Integrity Conditions | Transparency | Requirements to disclose methods, data, assumptions, and limitations. | Full disclosure of reinforcement schedules, stimulus parameters, trial counts, exclusion criteria, apparatus calibration, and modeling assumptions; clear reporting of motivational controls. |
| | Ethical Standards | Norms ensuring responsible conduct in experimentation, data handling, and publication. | Humane treatment (for animal studies); minimizing stress; ensuring informed consent (for humans); avoiding coercive reinforcers; honest reporting; careful management of punishment-based protocols. |