Re: [R] Estimating regression with constraints in model coefficients

2025-04-24 Thread Gregg Powell via R-help
Christofer, That was a detailed follow-up — you clarified the requirements precisely enough providing a position to proceed from... To implement this, a constrained optimization procedure to estimate an ordinal logistic regression model is needed (cumulative logit), based on: 1. Estimated Cut

Re: [R] Estimating regression with constraints in model coefficients

2025-04-24 Thread Christofer Bogaso
Hi Gregg, Many thanks for your detail feedback, those are really super helpful. I have ordered a copy of Agresti from our local library, however it appears that I would need to wait for a few days. Regrading my queries, it would be super helpful if we can build a optimization algo based on below

Re: [R] Estimating regression with constraints in model coefficients

2025-04-23 Thread Gregg Powell via R-help
Hello again Christofer, Thanks for your thoughtful note — I’m glad the outline was helpful. Apologies for the long delay getting back to you. Had to do a small bit of research… Recommended Text on Ordinal Log-Likelihoods: You're right that most online sources jump straight to code or canned func

Re: [R] Estimating regression with constraints in model coefficients

2025-04-21 Thread Jeff Newmiller via R-help
Logarithms are being referred to in two contexts here... log of likelihood, and log of domain variables. I just wanted to highlight that the latter has a surprisingly simple theoretical basis in optimization. If you have a function that you want to find an optimum of, but an input variable need

Re: [R] Estimating regression with constraints in model coefficients

2025-04-21 Thread Ben Bolker
Section 2 of the vignette for the ordinal package: https://cran.r-project.org/web/packages/ordinal/vignettes/clm_article.pdf gives a reasonably complete, if short, definition/discussion of the log-likelihood framework for ordinal models. It's probably also discussed in Venables and Ripley

Re: [R] Estimating regression with constraints in model coefficients

2025-04-21 Thread Christofer Bogaso
Hi Gregg, I am sincerely thankful for this workout. Could you please suggest any text book on how to create log-likelihood for an ordinal model like this? Most of my online search point me directly to some R function etc, but a theoretical discussion on this subject would be really helpful to con

Re: [R] Estimating regression with constraints in model coefficients

2025-04-21 Thread Gregg Powell via R-help
Christofer, Given the constraints you mentioned—bounded parameters, no intercept, and a sum constraint—you're outside the capabilities of most off-the-shelf ordinal logistic regression functions in R like vglm or polr. The most flexible recommendation at this point is to implement custom likel

Re: [R] Estimating regression with constraints in model coefficients

2025-04-21 Thread J C Nash
It may be overkill, but package nlsr has function nlxb() that can handle various models and bound the parameters. Note that bounds can sometimes give weird results if the bounds and initial parameter guesses are such that the minimization of the sum of squares gets "stuck". JN On 2025-04-21 09:

Re: [R] Estimating regression with constraints in model coefficients

2025-04-21 Thread Christofer Bogaso
Hi Gregg, I thank you for for information about the function vglm() However it appears that my constraints are a little different. My parameters have lower and upper bounds and also sum of the estimated coefficients should be equal to some predefined value. Other than that, there is no Intercep

Re: [R] Estimating regression with constraints in model coefficients

2025-04-08 Thread Gregg Powell via R-help
there are ways to implement constraints on parameter estimates in ordinal logistic regression in R. Here are a few approaches: The rms package (Regression Modeling Strategies) by Frank Harrell offers the lrm function which can handle constraints through its penalty parameter, though it's primar

[R] Estimating regression with constraints in model coefficients

2025-04-08 Thread Christofer Bogaso
Hi, I have below fit with ordinal logistic regression dat = foreign::read.dta("https://stats.idre.ucla.edu/stat/data/ologit.dta";) summary(MASS::polr(formula = apply ~ pared + public + gpa, data = dat)) However, instead of obtaining unconstrained estimates of model parameters, I would like to i